2024-04-25T12:07:07.956 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-25T12:07:07.956 DEBUG:teuthology.run:Teuthology command: teuthology --name leonidus-2024-04-25_11:13:36-fs-wip-lusov-quiescer-distro-default-smithi --owner scheduled_leonidus@teuthology --archive /home/teuthworker/archive/leonidus-2024-04-25_11:13:36-fs-wip-lusov-quiescer-distro-default-smithi/7673357 --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/with-quiesce 2-workunit/suites/fsstress}} --verbose -- /home/teuthworker/archive/leonidus-2024-04-25_11:13:36-fs-wip-lusov-quiescer-distro-default-smithi/7673357/orig.config.yaml 2024-04-25T12:07:08.005 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T12:07:08.096 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/leonidus-2024-04-25_11:13:36-fs-wip-lusov-quiescer-distro-default-smithi/7673357 branch: wip-lusov-quiescer description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/with-quiesce 2-workunit/suites/fsstress}} email: null first_in_suite: false job_id: '7673357' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: leonidus-2024-04-25_11:13:36-fs-wip-lusov-quiescer-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-lusov-quiescer ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 5 session_timeout: 300 conf: client: client mount timeout: 600 client_shutdown_timeout: 120 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds oft prefetch dirfrags: true mds op complaint time: 180 mds verify scatter: true mds_dir_prefetch: true mds_sleep_rank_change: 5000000.0 mon client directed command retry: 5 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds osd ms inject socket failures: 2500 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon client directed command retry: 5 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds ms inject socket failures: 2500 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum sha1: d69f13d827952bb07bb9b7973bca14f97d764d6f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs check-counter: counters: mds: - mds.exported - mds.imported install: ceph: flavor: default sha1: d69f13d827952bb07bb9b7973bca14f97d764d6f thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-lusov-quiescer sha1: df40303764f976ac2e973c1ef2b40d1ebbda473b owner: scheduled_leonidus@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 2866 sha1: d69f13d827952bb07bb9b7973bca14f97d764d6f sleep_before_teardown: 0 subset: 200/111111 suite: fs suite_branch: wip-lusov-quiescer suite_path: /home/teuthworker/src/github.com_ceph_ceph_df40303764f976ac2e973c1ef2b40d1ebbda473b/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph suite_sha1: df40303764f976ac2e973c1ef2b40d1ebbda473b syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi086.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHo8N7c/YWSybwHA+a7Tv1+st7ysgPgiVfCZFBdeUqjAZ2binlyWG7lz9dvyIy3nH4cop4tjWeGSX2zpk3pj0oM= smithi134.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ25y5bcI/9cypDnUvYlftagGEe4lLgZ1W6VOuDVCDHlhivGEkgVG1JqQRcGpEpPD10DkKnJf5LAZ5gLdjt54UI= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - quiescer: null - workunit: clients: all: - suites/fsstress.sh timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-25_11:13:36 tube: smithi user: leonidus verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-25T12:07:08.096 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph_df40303764f976ac2e973c1ef2b40d1ebbda473b/qa; will attempt to use it 2024-04-25T12:07:08.097 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph_df40303764f976ac2e973c1ef2b40d1ebbda473b/qa/tasks 2024-04-25T12:07:08.097 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-25T12:07:08.099 INFO:teuthology.task.internal:Checking packages... 2024-04-25T12:07:08.121 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'd69f13d827952bb07bb9b7973bca14f97d764d6f' 2024-04-25T12:07:08.121 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T12:07:08.121 INFO:teuthology.packaging:ref: None 2024-04-25T12:07:08.121 INFO:teuthology.packaging:tag: None 2024-04-25T12:07:08.121 INFO:teuthology.packaging:branch: wip-lusov-quiescer 2024-04-25T12:07:08.121 INFO:teuthology.packaging:sha1: d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-25T12:07:08.121 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-lusov-quiescer 2024-04-25T12:07:08.373 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3156-gd69f13d8-1jammy 2024-04-25T12:07:08.375 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-25T12:07:08.381 INFO:teuthology.task.internal:no buildpackages task found 2024-04-25T12:07:08.381 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-25T12:07:08.396 INFO:teuthology.task.internal:Saving configuration 2024-04-25T12:07:08.413 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-25T12:07:08.419 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T12:07:08.442 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi086.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-25_11:13:36-fs-wip-lusov-quiescer-distro-default-smithi/7673357', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 12:01:37.755735', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIMXKlX9he0BYEkHENYEBbVdW03RHq09ZTfEeaC6TWaZ2'} 2024-04-25T12:07:08.465 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi134.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-25_11:13:36-fs-wip-lusov-quiescer-distro-default-smithi/7673357', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 12:01:37.753702', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOR0YFwb7F4ZHzvxqTGRvhMqRXGiiMSsI5Mw47UWWALS'} 2024-04-25T12:07:08.465 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-25T12:07:08.470 INFO:teuthology.task.internal:roles: ubuntu@smithi086.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-04-25T12:07:08.471 INFO:teuthology.task.internal:roles: ubuntu@smithi134.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-04-25T12:07:08.471 INFO:teuthology.run_tasks:Running task console_log... 2024-04-25T12:07:08.547 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7efc800b80d0>, signals=[15]) 2024-04-25T12:07:08.548 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-25T12:07:08.554 INFO:teuthology.task.internal:Opening connections... 2024-04-25T12:07:08.554 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi086.front.sepia.ceph.com 2024-04-25T12:07:08.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T12:07:08.637 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi134.front.sepia.ceph.com 2024-04-25T12:07:08.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T12:07:08.718 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-25T12:07:08.724 DEBUG:teuthology.orchestra.run.smithi086:> uname -m 2024-04-25T12:07:08.730 INFO:teuthology.orchestra.run.smithi086.stdout:x86_64 2024-04-25T12:07:08.730 DEBUG:teuthology.orchestra.run.smithi086:> cat /etc/os-release 2024-04-25T12:07:08.777 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-25T12:07:08.777 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="Ubuntu" 2024-04-25T12:07:08.777 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="22.04" 2024-04-25T12:07:08.777 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-25T12:07:08.777 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_CODENAME=jammy 2024-04-25T12:07:08.777 INFO:teuthology.orchestra.run.smithi086.stdout:ID=ubuntu 2024-04-25T12:07:08.777 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE=debian 2024-04-25T12:07:08.777 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-25T12:07:08.777 INFO:teuthology.orchestra.run.smithi086.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-25T12:07:08.777 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-25T12:07:08.777 INFO:teuthology.orchestra.run.smithi086.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-25T12:07:08.777 INFO:teuthology.orchestra.run.smithi086.stdout:UBUNTU_CODENAME=jammy 2024-04-25T12:07:08.778 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server 2024-04-25T12:07:08.801 DEBUG:teuthology.orchestra.run.smithi134:> uname -m 2024-04-25T12:07:08.806 INFO:teuthology.orchestra.run.smithi134.stdout:x86_64 2024-04-25T12:07:08.807 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release 2024-04-25T12:07:08.852 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-25T12:07:08.853 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="Ubuntu" 2024-04-25T12:07:08.853 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="22.04" 2024-04-25T12:07:08.853 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-25T12:07:08.853 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_CODENAME=jammy 2024-04-25T12:07:08.853 INFO:teuthology.orchestra.run.smithi134.stdout:ID=ubuntu 2024-04-25T12:07:08.853 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE=debian 2024-04-25T12:07:08.853 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-25T12:07:08.853 INFO:teuthology.orchestra.run.smithi134.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-25T12:07:08.853 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-25T12:07:08.853 INFO:teuthology.orchestra.run.smithi134.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-25T12:07:08.853 INFO:teuthology.orchestra.run.smithi134.stdout:UBUNTU_CODENAME=jammy 2024-04-25T12:07:08.854 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2024-04-25T12:07:08.893 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-25T12:07:08.902 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-25T12:07:08.918 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-25T12:07:08.919 DEBUG:teuthology.orchestra.run.smithi086:> test '!' -e /home/ubuntu/cephtest 2024-04-25T12:07:08.922 DEBUG:teuthology.orchestra.run.smithi134:> test '!' -e /home/ubuntu/cephtest 2024-04-25T12:07:08.926 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-25T12:07:08.932 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-25T12:07:08.932 DEBUG:teuthology.orchestra.run.smithi086:> test -z $(ls -A /var/lib/ceph) 2024-04-25T12:07:08.966 DEBUG:teuthology.orchestra.run.smithi134:> test -z $(ls -A /var/lib/ceph) 2024-04-25T12:07:08.981 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-25T12:07:09.035 INFO:teuthology.run_tasks:Running task kernel... 2024-04-25T12:07:09.051 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-04-25T12:07:09.051 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-04-25T12:07:09.051 DEBUG:teuthology.orchestra.run.smithi086:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T12:07:09.051 DEBUG:teuthology.orchestra.run.smithi134:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T12:07:09.056 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T12:07:09.056 DEBUG:teuthology.orchestra.run.smithi086:> uname -r 2024-04-25T12:07:09.057 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T12:07:09.057 DEBUG:teuthology.orchestra.run.smithi134:> uname -r 2024-04-25T12:07:09.102 INFO:teuthology.orchestra.run.smithi086.stdout:5.15.0-56-generic 2024-04-25T12:07:09.102 INFO:teuthology.task.kernel:Running kernel on smithi086: 5.15.0-56-generic 2024-04-25T12:07:09.102 DEBUG:teuthology.orchestra.run.smithi086:> sudo apt-get clean 2024-04-25T12:07:09.109 INFO:teuthology.orchestra.run.smithi134.stdout:5.15.0-56-generic 2024-04-25T12:07:09.109 INFO:teuthology.task.kernel:Running kernel on smithi134: 5.15.0-56-generic 2024-04-25T12:07:09.109 DEBUG:teuthology.orchestra.run.smithi134:> sudo apt-get clean 2024-04-25T12:07:09.239 DEBUG:teuthology.orchestra.run.smithi086:> sudo apt-get update 2024-04-25T12:07:09.247 DEBUG:teuthology.orchestra.run.smithi134:> sudo apt-get update 2024-04-25T12:07:09.390 INFO:teuthology.orchestra.run.smithi086.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T12:07:09.390 INFO:teuthology.orchestra.run.smithi086.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-25T12:07:09.394 INFO:teuthology.orchestra.run.smithi086.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-25T12:07:09.483 INFO:teuthology.orchestra.run.smithi086.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-25T12:07:09.527 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T12:07:09.527 INFO:teuthology.orchestra.run.smithi134.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-25T12:07:09.584 INFO:teuthology.orchestra.run.smithi134.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-25T12:07:09.617 INFO:teuthology.orchestra.run.smithi086.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [452 kB] 2024-04-25T12:07:09.687 INFO:teuthology.orchestra.run.smithi086.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,610 kB] 2024-04-25T12:07:09.702 INFO:teuthology.orchestra.run.smithi086.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,394 kB] 2024-04-25T12:07:09.746 INFO:teuthology.orchestra.run.smithi086.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [243 kB] 2024-04-25T12:07:09.748 INFO:teuthology.orchestra.run.smithi086.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-25T12:07:09.748 INFO:teuthology.orchestra.run.smithi086.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-25T12:07:09.749 INFO:teuthology.orchestra.run.smithi086.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,773 kB] 2024-04-25T12:07:09.771 INFO:teuthology.orchestra.run.smithi086.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [300 kB] 2024-04-25T12:07:09.773 INFO:teuthology.orchestra.run.smithi086.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-25T12:07:09.773 INFO:teuthology.orchestra.run.smithi086.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-25T12:07:09.780 INFO:teuthology.orchestra.run.smithi086.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [601 kB] 2024-04-25T12:07:09.787 INFO:teuthology.orchestra.run.smithi086.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-25T12:07:09.788 INFO:teuthology.orchestra.run.smithi086.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-25T12:07:09.831 INFO:teuthology.orchestra.run.smithi086.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-25T12:07:09.831 INFO:teuthology.orchestra.run.smithi086.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [619 kB] 2024-04-25T12:07:09.831 INFO:teuthology.orchestra.run.smithi086.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-25T12:07:09.832 INFO:teuthology.orchestra.run.smithi086.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-25T12:07:09.832 INFO:teuthology.orchestra.run.smithi086.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-25T12:07:09.842 INFO:teuthology.orchestra.run.smithi086.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [303 kB] 2024-04-25T12:07:09.847 INFO:teuthology.orchestra.run.smithi086.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-25T12:07:09.848 INFO:teuthology.orchestra.run.smithi086.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-25T12:07:09.849 INFO:teuthology.orchestra.run.smithi086.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,830 kB] 2024-04-25T12:07:09.881 INFO:teuthology.orchestra.run.smithi086.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [311 kB] 2024-04-25T12:07:09.885 INFO:teuthology.orchestra.run.smithi086.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-25T12:07:09.885 INFO:teuthology.orchestra.run.smithi086.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [700 kB] 2024-04-25T12:07:09.893 INFO:teuthology.orchestra.run.smithi086.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,070 kB] 2024-04-25T12:07:09.903 INFO:teuthology.orchestra.run.smithi086.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-25T12:07:09.906 INFO:teuthology.orchestra.run.smithi086.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-25T12:07:09.906 INFO:teuthology.orchestra.run.smithi086.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-25T12:07:09.907 INFO:teuthology.orchestra.run.smithi086.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-25T12:07:09.907 INFO:teuthology.orchestra.run.smithi086.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-25T12:07:09.907 INFO:teuthology.orchestra.run.smithi086.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-25T12:07:09.928 INFO:teuthology.orchestra.run.smithi086.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [82.9 kB] 2024-04-25T12:07:09.929 INFO:teuthology.orchestra.run.smithi086.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [90.8 kB] 2024-04-25T12:07:09.930 INFO:teuthology.orchestra.run.smithi086.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-25T12:07:09.930 INFO:teuthology.orchestra.run.smithi086.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-25T12:07:09.930 INFO:teuthology.orchestra.run.smithi086.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [29.8 kB] 2024-04-25T12:07:09.934 INFO:teuthology.orchestra.run.smithi086.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [18.5 kB] 2024-04-25T12:07:09.938 INFO:teuthology.orchestra.run.smithi134.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-25T12:07:09.942 INFO:teuthology.orchestra.run.smithi134.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,394 kB] 2024-04-25T12:07:09.949 INFO:teuthology.orchestra.run.smithi086.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-25T12:07:09.949 INFO:teuthology.orchestra.run.smithi086.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-25T12:07:10.078 INFO:teuthology.orchestra.run.smithi134.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [619 kB] 2024-04-25T12:07:10.281 INFO:teuthology.orchestra.run.smithi134.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,610 kB] 2024-04-25T12:07:10.364 INFO:teuthology.orchestra.run.smithi134.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [452 kB] 2024-04-25T12:07:10.381 INFO:teuthology.orchestra.run.smithi134.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [243 kB] 2024-04-25T12:07:10.391 INFO:teuthology.orchestra.run.smithi134.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-25T12:07:10.391 INFO:teuthology.orchestra.run.smithi134.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-25T12:07:10.392 INFO:teuthology.orchestra.run.smithi134.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,773 kB] 2024-04-25T12:07:10.428 INFO:teuthology.orchestra.run.smithi134.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [303 kB] 2024-04-25T12:07:10.443 INFO:teuthology.orchestra.run.smithi134.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-25T12:07:10.444 INFO:teuthology.orchestra.run.smithi134.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-25T12:07:10.445 INFO:teuthology.orchestra.run.smithi134.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,830 kB] 2024-04-25T12:07:10.486 INFO:teuthology.orchestra.run.smithi134.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [300 kB] 2024-04-25T12:07:10.508 INFO:teuthology.orchestra.run.smithi134.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [311 kB] 2024-04-25T12:07:10.508 INFO:teuthology.orchestra.run.smithi134.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-25T12:07:10.508 INFO:teuthology.orchestra.run.smithi134.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-25T12:07:10.515 INFO:teuthology.orchestra.run.smithi134.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-25T12:07:10.524 INFO:teuthology.orchestra.run.smithi134.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [601 kB] 2024-04-25T12:07:10.679 INFO:teuthology.orchestra.run.smithi134.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [700 kB] 2024-04-25T12:07:10.701 INFO:teuthology.orchestra.run.smithi134.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-25T12:07:11.107 INFO:teuthology.orchestra.run.smithi134.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-25T12:07:11.112 INFO:teuthology.orchestra.run.smithi134.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-25T12:07:11.126 INFO:teuthology.orchestra.run.smithi134.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-25T12:07:11.127 INFO:teuthology.orchestra.run.smithi134.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-25T12:07:11.129 INFO:teuthology.orchestra.run.smithi134.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-25T12:07:11.344 INFO:teuthology.orchestra.run.smithi134.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,070 kB] 2024-04-25T12:07:11.977 INFO:teuthology.orchestra.run.smithi134.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-25T12:07:12.069 INFO:teuthology.orchestra.run.smithi134.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-25T12:07:12.152 INFO:teuthology.orchestra.run.smithi134.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-25T12:07:12.233 INFO:teuthology.orchestra.run.smithi134.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-25T12:07:12.317 INFO:teuthology.orchestra.run.smithi134.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-25T12:07:12.399 INFO:teuthology.orchestra.run.smithi134.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-25T12:07:12.481 INFO:teuthology.orchestra.run.smithi134.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [90.8 kB] 2024-04-25T12:07:12.567 INFO:teuthology.orchestra.run.smithi134.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [82.9 kB] 2024-04-25T12:07:12.652 INFO:teuthology.orchestra.run.smithi134.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-25T12:07:12.734 INFO:teuthology.orchestra.run.smithi134.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-25T12:07:12.898 INFO:teuthology.orchestra.run.smithi134.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [29.8 kB] 2024-04-25T12:07:13.087 INFO:teuthology.orchestra.run.smithi134.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [18.5 kB] 2024-04-25T12:07:13.198 INFO:teuthology.orchestra.run.smithi134.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-25T12:07:13.305 INFO:teuthology.orchestra.run.smithi134.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-25T12:07:15.321 INFO:teuthology.orchestra.run.smithi086.stdout:Fetched 13.3 MB in 2s (7,322 kB/s) 2024-04-25T12:07:16.664 INFO:teuthology.orchestra.run.smithi086.stdout:Reading package lists... 2024-04-25T12:07:16.682 DEBUG:teuthology.orchestra.run.smithi086:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-25T12:07:16.743 INFO:teuthology.orchestra.run.smithi086.stdout:Reading package lists... 2024-04-25T12:07:16.928 INFO:teuthology.orchestra.run.smithi086.stdout:Building dependency tree... 2024-04-25T12:07:16.929 INFO:teuthology.orchestra.run.smithi086.stdout:Reading state information... 2024-04-25T12:07:17.085 INFO:teuthology.orchestra.run.smithi086.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T12:07:17.085 INFO:teuthology.orchestra.run.smithi086.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T12:07:17.086 INFO:teuthology.orchestra.run.smithi086.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T12:07:17.086 INFO:teuthology.orchestra.run.smithi086.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T12:07:17.086 INFO:teuthology.orchestra.run.smithi086.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-25T12:07:17.086 INFO:teuthology.orchestra.run.smithi086.stdout: python2.7-minimal 2024-04-25T12:07:17.086 INFO:teuthology.orchestra.run.smithi086.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T12:07:17.087 INFO:teuthology.orchestra.run.smithi086.stdout:The following additional packages will be installed: 2024-04-25T12:07:17.087 INFO:teuthology.orchestra.run.smithi086.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-25T12:07:17.087 INFO:teuthology.orchestra.run.smithi086.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-25T12:07:17.088 INFO:teuthology.orchestra.run.smithi086.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-25T12:07:17.089 INFO:teuthology.orchestra.run.smithi086.stdout:Suggested packages: 2024-04-25T12:07:17.089 INFO:teuthology.orchestra.run.smithi086.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-25T12:07:17.089 INFO:teuthology.orchestra.run.smithi086.stdout:Recommended packages: 2024-04-25T12:07:17.089 INFO:teuthology.orchestra.run.smithi086.stdout: thermald 2024-04-25T12:07:17.137 INFO:teuthology.orchestra.run.smithi086.stdout:The following NEW packages will be installed: 2024-04-25T12:07:17.137 INFO:teuthology.orchestra.run.smithi086.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-25T12:07:17.137 INFO:teuthology.orchestra.run.smithi086.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-25T12:07:17.137 INFO:teuthology.orchestra.run.smithi086.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-25T12:07:17.139 INFO:teuthology.orchestra.run.smithi086.stdout:The following packages will be upgraded: 2024-04-25T12:07:17.140 INFO:teuthology.orchestra.run.smithi086.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-25T12:07:17.201 INFO:teuthology.orchestra.run.smithi086.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-25T12:07:17.201 INFO:teuthology.orchestra.run.smithi086.stdout:Need to get 113 MB of archives. 2024-04-25T12:07:17.201 INFO:teuthology.orchestra.run.smithi086.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-25T12:07:17.201 INFO:teuthology.orchestra.run.smithi086.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-25T12:07:17.705 INFO:teuthology.orchestra.run.smithi086.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-25T12:07:17.709 INFO:teuthology.orchestra.run.smithi134.stdout:Fetched 13.3 MB in 4s (3,336 kB/s) 2024-04-25T12:07:17.807 INFO:teuthology.orchestra.run.smithi086.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-25T12:07:18.715 INFO:teuthology.orchestra.run.smithi086.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-25T12:07:18.715 INFO:teuthology.orchestra.run.smithi086.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-25T12:07:18.716 INFO:teuthology.orchestra.run.smithi086.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-25T12:07:18.860 INFO:teuthology.orchestra.run.smithi086.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-25T12:07:18.884 INFO:teuthology.orchestra.run.smithi086.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-25T12:07:19.147 INFO:teuthology.orchestra.run.smithi134.stdout:Reading package lists... 2024-04-25T12:07:19.164 DEBUG:teuthology.orchestra.run.smithi134:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-25T12:07:19.224 INFO:teuthology.orchestra.run.smithi134.stdout:Reading package lists... 2024-04-25T12:07:19.357 INFO:teuthology.orchestra.run.smithi086.stdout:Fetched 113 MB in 2s (62.9 MB/s) 2024-04-25T12:07:19.404 INFO:teuthology.orchestra.run.smithi134.stdout:Building dependency tree... 2024-04-25T12:07:19.405 INFO:teuthology.orchestra.run.smithi134.stdout:Reading state information... 2024-04-25T12:07:19.529 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-25T12:07:19.558 INFO:teuthology.orchestra.run.smithi134.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T12:07:19.558 INFO:teuthology.orchestra.run.smithi134.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T12:07:19.558 INFO:teuthology.orchestra.run.smithi134.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T12:07:19.558 INFO:teuthology.orchestra.run.smithi134.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T12:07:19.558 INFO:teuthology.orchestra.run.smithi134.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-25T12:07:19.558 INFO:teuthology.orchestra.run.smithi134.stdout: python2.7-minimal 2024-04-25T12:07:19.559 INFO:teuthology.orchestra.run.smithi134.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T12:07:19.560 INFO:teuthology.orchestra.run.smithi134.stdout:The following additional packages will be installed: 2024-04-25T12:07:19.560 INFO:teuthology.orchestra.run.smithi134.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-25T12:07:19.560 INFO:teuthology.orchestra.run.smithi134.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-25T12:07:19.560 INFO:teuthology.orchestra.run.smithi134.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-25T12:07:19.561 INFO:teuthology.orchestra.run.smithi134.stdout:Suggested packages: 2024-04-25T12:07:19.561 INFO:teuthology.orchestra.run.smithi134.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-25T12:07:19.561 INFO:teuthology.orchestra.run.smithi134.stdout:Recommended packages: 2024-04-25T12:07:19.561 INFO:teuthology.orchestra.run.smithi134.stdout: thermald 2024-04-25T12:07:19.611 INFO:teuthology.orchestra.run.smithi134.stdout:The following NEW packages will be installed: 2024-04-25T12:07:19.611 INFO:teuthology.orchestra.run.smithi134.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-25T12:07:19.611 INFO:teuthology.orchestra.run.smithi134.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-25T12:07:19.611 INFO:teuthology.orchestra.run.smithi134.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-25T12:07:19.613 INFO:teuthology.orchestra.run.smithi134.stdout:The following packages will be upgraded: 2024-04-25T12:07:19.613 INFO:teuthology.orchestra.run.smithi134.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-25T12:07:19.670 INFO:teuthology.orchestra.run.smithi134.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-25T12:07:19.670 INFO:teuthology.orchestra.run.smithi134.stdout:Need to get 113 MB of archives. 2024-04-25T12:07:19.670 INFO:teuthology.orchestra.run.smithi134.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-25T12:07:19.670 INFO:teuthology.orchestra.run.smithi134.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-25T12:07:20.127 INFO:teuthology.orchestra.run.smithi134.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-25T12:07:20.228 INFO:teuthology.orchestra.run.smithi134.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-25T12:07:21.142 INFO:teuthology.orchestra.run.smithi134.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-25T12:07:21.143 INFO:teuthology.orchestra.run.smithi134.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-25T12:07:21.143 INFO:teuthology.orchestra.run.smithi134.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-25T12:07:21.324 INFO:teuthology.orchestra.run.smithi134.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-25T12:07:21.371 INFO:teuthology.orchestra.run.smithi134.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-25T12:07:21.497 INFO:teuthology.orchestra.run.smithi086.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-25T12:07:21.501 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T12:07:21.593 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T12:07:21.756 INFO:teuthology.orchestra.run.smithi134.stdout:Fetched 113 MB in 2s (64.7 MB/s) 2024-04-25T12:07:21.954 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-25T12:07:23.947 INFO:teuthology.orchestra.run.smithi134.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-25T12:07:23.951 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T12:07:24.084 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T12:07:24.161 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-25T12:07:24.182 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T12:07:24.266 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T12:07:24.714 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-25T12:07:24.734 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T12:07:24.772 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T12:07:26.634 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-25T12:07:26.655 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T12:07:26.754 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T12:07:27.289 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-25T12:07:27.309 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T12:07:27.354 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T12:07:30.938 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T12:07:31.066 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T12:07:31.398 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T12:07:31.519 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T12:07:31.847 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-25T12:07:31.869 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-25T12:07:31.913 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-25T12:07:34.036 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T12:07:34.188 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T12:07:34.554 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T12:07:34.683 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T12:07:34.969 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-25T12:07:34.991 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-25T12:07:35.027 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-25T12:07:37.791 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-25T12:07:37.827 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T12:07:37.857 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T12:07:40.509 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T12:07:40.643 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T12:07:40.993 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-25T12:07:41.114 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T12:07:41.241 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-25T12:07:41.301 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-25T12:07:41.338 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T12:07:41.368 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T12:07:41.375 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T12:07:42.744 INFO:teuthology.orchestra.run.smithi086.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-25T12:07:42.744 INFO:teuthology.orchestra.run.smithi086.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-25T12:07:42.744 INFO:teuthology.orchestra.run.smithi086.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-25T12:07:42.744 INFO:teuthology.orchestra.run.smithi086.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-25T12:07:42.904 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T12:07:44.090 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T12:07:44.222 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T12:07:44.305 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T12:07:44.613 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-25T12:07:44.735 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T12:07:45.686 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-25T12:07:45.840 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T12:07:46.040 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-25T12:07:46.166 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-25T12:07:46.292 INFO:teuthology.orchestra.run.smithi086.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T12:07:46.348 INFO:teuthology.orchestra.run.smithi086.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-25T12:07:46.348 INFO:teuthology.orchestra.run.smithi086.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-25T12:07:47.149 INFO:teuthology.orchestra.run.smithi134.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-25T12:07:47.149 INFO:teuthology.orchestra.run.smithi134.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-25T12:07:47.149 INFO:teuthology.orchestra.run.smithi134.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-25T12:07:47.149 INFO:teuthology.orchestra.run.smithi134.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-25T12:07:47.334 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T12:07:48.736 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T12:07:50.179 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-25T12:07:50.302 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-25T12:07:50.423 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T12:07:50.480 INFO:teuthology.orchestra.run.smithi134.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-25T12:07:50.480 INFO:teuthology.orchestra.run.smithi134.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-25T12:08:00.642 INFO:teuthology.orchestra.run.smithi086.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-25T12:08:00.642 INFO:teuthology.orchestra.run.smithi086.stdout:Sourcing file `/etc/default/grub' 2024-04-25T12:08:00.660 INFO:teuthology.orchestra.run.smithi086.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T12:08:00.688 INFO:teuthology.orchestra.run.smithi086.stdout:Generating grub configuration file ... 2024-04-25T12:08:00.944 INFO:teuthology.orchestra.run.smithi086.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-25T12:08:00.964 INFO:teuthology.orchestra.run.smithi086.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-25T12:08:01.260 INFO:teuthology.orchestra.run.smithi086.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T12:08:01.266 INFO:teuthology.orchestra.run.smithi086.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T12:08:01.336 INFO:teuthology.orchestra.run.smithi086.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T12:08:01.341 INFO:teuthology.orchestra.run.smithi086.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T12:08:01.517 INFO:teuthology.orchestra.run.smithi086.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T12:08:01.517 INFO:teuthology.orchestra.run.smithi086.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T12:08:01.517 INFO:teuthology.orchestra.run.smithi086.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T12:08:01.553 INFO:teuthology.orchestra.run.smithi086.stdout:done 2024-04-25T12:08:02.018 DEBUG:teuthology.orchestra.run.smithi086:> dpkg -s linux-image-generic 2024-04-25T12:08:02.041 INFO:teuthology.orchestra.run.smithi086.stdout:Package: linux-image-generic 2024-04-25T12:08:02.041 INFO:teuthology.orchestra.run.smithi086.stdout:Status: install ok installed 2024-04-25T12:08:02.042 INFO:teuthology.orchestra.run.smithi086.stdout:Priority: optional 2024-04-25T12:08:02.042 INFO:teuthology.orchestra.run.smithi086.stdout:Section: kernel 2024-04-25T12:08:02.042 INFO:teuthology.orchestra.run.smithi086.stdout:Installed-Size: 21 2024-04-25T12:08:02.042 INFO:teuthology.orchestra.run.smithi086.stdout:Maintainer: Ubuntu Kernel Team 2024-04-25T12:08:02.042 INFO:teuthology.orchestra.run.smithi086.stdout:Architecture: amd64 2024-04-25T12:08:02.042 INFO:teuthology.orchestra.run.smithi086.stdout:Source: linux-meta 2024-04-25T12:08:02.042 INFO:teuthology.orchestra.run.smithi086.stdout:Version: 5.15.0.105.102 2024-04-25T12:08:02.042 INFO:teuthology.orchestra.run.smithi086.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-25T12:08:02.042 INFO:teuthology.orchestra.run.smithi086.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-25T12:08:02.042 INFO:teuthology.orchestra.run.smithi086.stdout:Recommends: thermald 2024-04-25T12:08:02.042 INFO:teuthology.orchestra.run.smithi086.stdout:Description: Generic Linux kernel image 2024-04-25T12:08:02.042 INFO:teuthology.orchestra.run.smithi086.stdout: This package will always depend on the latest generic kernel image 2024-04-25T12:08:02.042 INFO:teuthology.orchestra.run.smithi086.stdout: available. 2024-04-25T12:08:02.043 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-25T12:08:02.043 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-25T12:08:02.043 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-25T12:08:02.043 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-04-25T12:08:02.043 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi086.front.sepia.ceph.com, path=None, version=distro) 2024-04-25T12:08:02.043 DEBUG:teuthology.orchestra.run.smithi086:> sudo apt-get clean 2024-04-25T12:08:02.207 DEBUG:teuthology.orchestra.run.smithi086:> sudo apt-get update 2024-04-25T12:08:02.376 INFO:teuthology.orchestra.run.smithi086.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T12:08:02.401 INFO:teuthology.orchestra.run.smithi086.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-25T12:08:02.433 INFO:teuthology.orchestra.run.smithi086.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-25T12:08:02.479 INFO:teuthology.orchestra.run.smithi086.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-25T12:08:03.782 INFO:teuthology.orchestra.run.smithi086.stdout:Reading package lists... 2024-04-25T12:08:03.799 DEBUG:teuthology.orchestra.run.smithi086:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-25T12:08:03.862 INFO:teuthology.orchestra.run.smithi086.stdout:Reading package lists... 2024-04-25T12:08:04.059 INFO:teuthology.orchestra.run.smithi086.stdout:Building dependency tree... 2024-04-25T12:08:04.060 INFO:teuthology.orchestra.run.smithi086.stdout:Reading state information... 2024-04-25T12:08:04.215 INFO:teuthology.orchestra.run.smithi086.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-25T12:08:04.216 INFO:teuthology.orchestra.run.smithi086.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T12:08:04.216 INFO:teuthology.orchestra.run.smithi086.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T12:08:04.216 INFO:teuthology.orchestra.run.smithi086.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T12:08:04.216 INFO:teuthology.orchestra.run.smithi086.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T12:08:04.216 INFO:teuthology.orchestra.run.smithi086.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T12:08:04.216 INFO:teuthology.orchestra.run.smithi086.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T12:08:04.216 INFO:teuthology.orchestra.run.smithi086.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T12:08:04.255 INFO:teuthology.orchestra.run.smithi086.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-25T12:08:04.257 DEBUG:teuthology.orchestra.run.smithi086:> dpkg -s linux-image-generic 2024-04-25T12:08:04.269 INFO:teuthology.orchestra.run.smithi086.stdout:Package: linux-image-generic 2024-04-25T12:08:04.269 INFO:teuthology.orchestra.run.smithi086.stdout:Status: install ok installed 2024-04-25T12:08:04.269 INFO:teuthology.orchestra.run.smithi086.stdout:Priority: optional 2024-04-25T12:08:04.269 INFO:teuthology.orchestra.run.smithi086.stdout:Section: kernel 2024-04-25T12:08:04.269 INFO:teuthology.orchestra.run.smithi086.stdout:Installed-Size: 21 2024-04-25T12:08:04.269 INFO:teuthology.orchestra.run.smithi086.stdout:Maintainer: Ubuntu Kernel Team 2024-04-25T12:08:04.269 INFO:teuthology.orchestra.run.smithi086.stdout:Architecture: amd64 2024-04-25T12:08:04.269 INFO:teuthology.orchestra.run.smithi086.stdout:Source: linux-meta 2024-04-25T12:08:04.269 INFO:teuthology.orchestra.run.smithi086.stdout:Version: 5.15.0.105.102 2024-04-25T12:08:04.270 INFO:teuthology.orchestra.run.smithi086.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-25T12:08:04.270 INFO:teuthology.orchestra.run.smithi086.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-25T12:08:04.270 INFO:teuthology.orchestra.run.smithi086.stdout:Recommends: thermald 2024-04-25T12:08:04.270 INFO:teuthology.orchestra.run.smithi086.stdout:Description: Generic Linux kernel image 2024-04-25T12:08:04.270 INFO:teuthology.orchestra.run.smithi086.stdout: This package will always depend on the latest generic kernel image 2024-04-25T12:08:04.270 INFO:teuthology.orchestra.run.smithi086.stdout: available. 2024-04-25T12:08:04.270 DEBUG:teuthology.orchestra.run.smithi086:> mktemp 2024-04-25T12:08:04.316 INFO:teuthology.orchestra.run.smithi086.stdout:/tmp/tmp.GAN00lHAI7 2024-04-25T12:08:04.317 DEBUG:teuthology.orchestra.run.smithi086:> sudo cp /boot/grub/grub.cfg /tmp/tmp.GAN00lHAI7 2024-04-25T12:08:04.371 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 0666 /tmp/tmp.GAN00lHAI7 2024-04-25T12:08:04.479 DEBUG:teuthology.orchestra.remote:smithi086:/tmp/tmp.GAN00lHAI7 is 10KB 2024-04-25T12:08:04.492 DEBUG:teuthology.orchestra.run.smithi086:> rm -fr /tmp/tmp.GAN00lHAI7 2024-04-25T12:08:04.498 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-25T12:08:04.552 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-04-25T12:08:04.552 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-25T12:08:04.552 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-25T12:08:04.573 INFO:teuthology.orchestra.run.smithi134.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-25T12:08:04.573 INFO:teuthology.orchestra.run.smithi134.stdout:Sourcing file `/etc/default/grub' 2024-04-25T12:08:04.582 INFO:teuthology.orchestra.run.smithi134.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T12:08:04.620 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-25T12:08:04.620 DEBUG:teuthology.orchestra.run.smithi086:> sudo update-grub 2024-04-25T12:08:04.644 INFO:teuthology.orchestra.run.smithi134.stdout:Generating grub configuration file ... 2024-04-25T12:08:05.018 INFO:teuthology.orchestra.run.smithi134.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-25T12:08:05.039 INFO:teuthology.orchestra.run.smithi134.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-25T12:08:05.466 INFO:teuthology.orchestra.run.smithi134.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T12:08:05.471 INFO:teuthology.orchestra.run.smithi134.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T12:08:05.543 INFO:teuthology.orchestra.run.smithi134.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T12:08:05.549 INFO:teuthology.orchestra.run.smithi134.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T12:08:05.713 INFO:teuthology.orchestra.run.smithi134.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T12:08:05.714 INFO:teuthology.orchestra.run.smithi134.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T12:08:05.714 INFO:teuthology.orchestra.run.smithi134.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T12:08:05.760 INFO:teuthology.orchestra.run.smithi134.stdout:done 2024-04-25T12:08:05.779 INFO:teuthology.orchestra.run.smithi086.stderr:Sourcing file `/etc/default/grub' 2024-04-25T12:08:05.780 INFO:teuthology.orchestra.run.smithi086.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T12:08:05.781 INFO:teuthology.orchestra.run.smithi086.stderr:Generating grub configuration file ... 2024-04-25T12:08:05.980 INFO:teuthology.orchestra.run.smithi086.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-25T12:08:05.986 INFO:teuthology.orchestra.run.smithi086.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-25T12:08:06.222 INFO:teuthology.orchestra.run.smithi086.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T12:08:06.224 DEBUG:teuthology.orchestra.run.smithi134:> dpkg -s linux-image-generic 2024-04-25T12:08:06.227 INFO:teuthology.orchestra.run.smithi086.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T12:08:06.243 INFO:teuthology.orchestra.run.smithi134.stdout:Package: linux-image-generic 2024-04-25T12:08:06.243 INFO:teuthology.orchestra.run.smithi134.stdout:Status: install ok installed 2024-04-25T12:08:06.243 INFO:teuthology.orchestra.run.smithi134.stdout:Priority: optional 2024-04-25T12:08:06.243 INFO:teuthology.orchestra.run.smithi134.stdout:Section: kernel 2024-04-25T12:08:06.243 INFO:teuthology.orchestra.run.smithi134.stdout:Installed-Size: 21 2024-04-25T12:08:06.243 INFO:teuthology.orchestra.run.smithi134.stdout:Maintainer: Ubuntu Kernel Team 2024-04-25T12:08:06.243 INFO:teuthology.orchestra.run.smithi134.stdout:Architecture: amd64 2024-04-25T12:08:06.243 INFO:teuthology.orchestra.run.smithi134.stdout:Source: linux-meta 2024-04-25T12:08:06.244 INFO:teuthology.orchestra.run.smithi134.stdout:Version: 5.15.0.105.102 2024-04-25T12:08:06.244 INFO:teuthology.orchestra.run.smithi134.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-25T12:08:06.244 INFO:teuthology.orchestra.run.smithi134.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-25T12:08:06.244 INFO:teuthology.orchestra.run.smithi134.stdout:Recommends: thermald 2024-04-25T12:08:06.244 INFO:teuthology.orchestra.run.smithi134.stdout:Description: Generic Linux kernel image 2024-04-25T12:08:06.244 INFO:teuthology.orchestra.run.smithi134.stdout: This package will always depend on the latest generic kernel image 2024-04-25T12:08:06.244 INFO:teuthology.orchestra.run.smithi134.stdout: available. 2024-04-25T12:08:06.245 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-25T12:08:06.245 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-25T12:08:06.245 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-25T12:08:06.245 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-04-25T12:08:06.245 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi134.front.sepia.ceph.com, path=None, version=distro) 2024-04-25T12:08:06.245 DEBUG:teuthology.orchestra.run.smithi134:> sudo apt-get clean 2024-04-25T12:08:06.268 INFO:teuthology.orchestra.run.smithi086.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T12:08:06.273 INFO:teuthology.orchestra.run.smithi086.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T12:08:06.430 INFO:teuthology.orchestra.run.smithi086.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T12:08:06.430 INFO:teuthology.orchestra.run.smithi086.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T12:08:06.430 INFO:teuthology.orchestra.run.smithi086.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T12:08:06.450 INFO:teuthology.orchestra.run.smithi086.stderr:done 2024-04-25T12:08:06.466 DEBUG:teuthology.orchestra.run.smithi134:> sudo apt-get update 2024-04-25T12:08:06.467 DEBUG:teuthology.orchestra.run.smithi086:> sudo shutdown -r now 2024-04-25T12:08:06.591 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-25T12:08:06.591 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T12:08:06.606 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-25T12:08:06.627 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-25T12:08:07.929 INFO:teuthology.orchestra.run.smithi134.stdout:Reading package lists... 2024-04-25T12:08:07.947 DEBUG:teuthology.orchestra.run.smithi134:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-25T12:08:08.010 INFO:teuthology.orchestra.run.smithi134.stdout:Reading package lists... 2024-04-25T12:08:08.210 INFO:teuthology.orchestra.run.smithi134.stdout:Building dependency tree... 2024-04-25T12:08:08.211 INFO:teuthology.orchestra.run.smithi134.stdout:Reading state information... 2024-04-25T12:08:08.385 INFO:teuthology.orchestra.run.smithi134.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-25T12:08:08.385 INFO:teuthology.orchestra.run.smithi134.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T12:08:08.385 INFO:teuthology.orchestra.run.smithi134.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T12:08:08.385 INFO:teuthology.orchestra.run.smithi134.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T12:08:08.386 INFO:teuthology.orchestra.run.smithi134.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T12:08:08.386 INFO:teuthology.orchestra.run.smithi134.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T12:08:08.386 INFO:teuthology.orchestra.run.smithi134.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T12:08:08.386 INFO:teuthology.orchestra.run.smithi134.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T12:08:08.429 INFO:teuthology.orchestra.run.smithi134.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-25T12:08:08.431 DEBUG:teuthology.orchestra.run.smithi134:> dpkg -s linux-image-generic 2024-04-25T12:08:08.443 INFO:teuthology.orchestra.run.smithi134.stdout:Package: linux-image-generic 2024-04-25T12:08:08.443 INFO:teuthology.orchestra.run.smithi134.stdout:Status: install ok installed 2024-04-25T12:08:08.443 INFO:teuthology.orchestra.run.smithi134.stdout:Priority: optional 2024-04-25T12:08:08.443 INFO:teuthology.orchestra.run.smithi134.stdout:Section: kernel 2024-04-25T12:08:08.443 INFO:teuthology.orchestra.run.smithi134.stdout:Installed-Size: 21 2024-04-25T12:08:08.443 INFO:teuthology.orchestra.run.smithi134.stdout:Maintainer: Ubuntu Kernel Team 2024-04-25T12:08:08.443 INFO:teuthology.orchestra.run.smithi134.stdout:Architecture: amd64 2024-04-25T12:08:08.443 INFO:teuthology.orchestra.run.smithi134.stdout:Source: linux-meta 2024-04-25T12:08:08.443 INFO:teuthology.orchestra.run.smithi134.stdout:Version: 5.15.0.105.102 2024-04-25T12:08:08.443 INFO:teuthology.orchestra.run.smithi134.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-25T12:08:08.444 INFO:teuthology.orchestra.run.smithi134.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-25T12:08:08.444 INFO:teuthology.orchestra.run.smithi134.stdout:Recommends: thermald 2024-04-25T12:08:08.444 INFO:teuthology.orchestra.run.smithi134.stdout:Description: Generic Linux kernel image 2024-04-25T12:08:08.444 INFO:teuthology.orchestra.run.smithi134.stdout: This package will always depend on the latest generic kernel image 2024-04-25T12:08:08.444 INFO:teuthology.orchestra.run.smithi134.stdout: available. 2024-04-25T12:08:08.444 DEBUG:teuthology.orchestra.run.smithi134:> mktemp 2024-04-25T12:08:08.487 INFO:teuthology.orchestra.run.smithi134.stdout:/tmp/tmp.i12HKn6OzC 2024-04-25T12:08:08.488 DEBUG:teuthology.orchestra.run.smithi134:> sudo cp /boot/grub/grub.cfg /tmp/tmp.i12HKn6OzC 2024-04-25T12:08:08.542 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0666 /tmp/tmp.i12HKn6OzC 2024-04-25T12:08:08.655 DEBUG:teuthology.orchestra.remote:smithi134:/tmp/tmp.i12HKn6OzC is 10KB 2024-04-25T12:08:08.668 DEBUG:teuthology.orchestra.run.smithi134:> rm -fr /tmp/tmp.i12HKn6OzC 2024-04-25T12:08:08.672 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-25T12:08:08.727 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-25T12:08:08.728 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-25T12:08:08.728 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-25T12:08:08.816 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-25T12:08:08.816 DEBUG:teuthology.orchestra.run.smithi134:> sudo update-grub 2024-04-25T12:08:10.123 INFO:teuthology.orchestra.run.smithi134.stderr:Sourcing file `/etc/default/grub' 2024-04-25T12:08:10.131 INFO:teuthology.orchestra.run.smithi134.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T12:08:10.135 INFO:teuthology.orchestra.run.smithi134.stderr:Generating grub configuration file ... 2024-04-25T12:08:10.354 INFO:teuthology.orchestra.run.smithi134.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-25T12:08:10.359 INFO:teuthology.orchestra.run.smithi134.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-25T12:08:10.691 INFO:teuthology.orchestra.run.smithi134.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T12:08:10.696 INFO:teuthology.orchestra.run.smithi134.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T12:08:10.733 INFO:teuthology.orchestra.run.smithi134.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T12:08:10.738 INFO:teuthology.orchestra.run.smithi134.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T12:08:10.843 INFO:teuthology.orchestra.run.smithi134.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T12:08:10.844 INFO:teuthology.orchestra.run.smithi134.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T12:08:10.844 INFO:teuthology.orchestra.run.smithi134.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T12:08:10.883 INFO:teuthology.orchestra.run.smithi134.stderr:done 2024-04-25T12:08:10.884 DEBUG:teuthology.orchestra.run.smithi134:> sudo shutdown -r now 2024-04-25T12:08:36.495 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-25T12:08:36.496 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-04-25T12:08:36.497 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T12:08:40.890 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-04-25T12:08:40.890 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-04-25T12:08:40.891 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T12:08:54.815 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-04-25T12:08:59.422 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.134 2024-04-25T12:09:03.818 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-04-25T12:09:03.819 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T12:09:06.882 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-04-25T12:09:08.425 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-04-25T12:09:08.427 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T12:09:11.490 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.134 2024-04-25T12:09:18.886 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-04-25T12:09:18.887 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T12:09:23.497 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-04-25T12:09:23.498 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T12:09:37.315 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-04-25T12:09:41.922 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.134 2024-04-25T12:09:52.322 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-04-25T12:09:52.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T12:09:52.698 DEBUG:teuthology.orchestra.run.smithi086:> true 2024-04-25T12:09:53.684 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-04-25T12:09:53.684 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-105-generic"... 2024-04-25T12:09:53.684 DEBUG:teuthology.orchestra.run.smithi086:> uname -r 2024-04-25T12:09:53.731 INFO:teuthology.orchestra.run.smithi086.stdout:5.15.0-105-generic 2024-04-25T12:09:53.731 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-25T12:09:53.731 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-25T12:09:53.731 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-25T12:09:54.733 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-25T12:09:54.733 DEBUG:teuthology.orchestra.run.smithi086:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-25T12:09:54.914 INFO:teuthology.orchestra.run.smithi086.stdout:ttyS1 2024-04-25T12:09:54.945 DEBUG:teuthology.parallel:result is None 2024-04-25T12:09:56.923 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-04-25T12:09:56.923 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T12:09:57.234 DEBUG:teuthology.orchestra.run.smithi134:> true 2024-04-25T12:09:57.898 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-04-25T12:09:57.898 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-105-generic"... 2024-04-25T12:09:57.898 DEBUG:teuthology.orchestra.run.smithi134:> uname -r 2024-04-25T12:09:57.945 INFO:teuthology.orchestra.run.smithi134.stdout:5.15.0-105-generic 2024-04-25T12:09:57.945 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-25T12:09:57.945 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-25T12:09:57.945 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-25T12:09:58.946 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-04-25T12:09:58.947 DEBUG:teuthology.orchestra.run.smithi134:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-25T12:09:59.019 INFO:teuthology.orchestra.run.smithi134.stdout:ttyS1 2024-04-25T12:09:59.050 DEBUG:teuthology.parallel:result is None 2024-04-25T12:09:59.051 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-25T12:09:59.058 INFO:teuthology.task.internal:Creating test directory... 2024-04-25T12:09:59.058 DEBUG:teuthology.orchestra.run.smithi086:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T12:09:59.061 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T12:09:59.066 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-25T12:09:59.072 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-25T12:09:59.079 INFO:teuthology.task.internal:Creating archive directory... 2024-04-25T12:09:59.079 DEBUG:teuthology.orchestra.run.smithi086:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T12:09:59.107 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T12:09:59.201 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-25T12:09:59.209 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-25T12:09:59.209 DEBUG:teuthology.orchestra.run.smithi086:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T12:09:59.212 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T12:09:59.232 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T12:09:59.239 INFO:teuthology.orchestra.run.smithi086.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T12:09:59.240 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T12:09:59.246 INFO:teuthology.orchestra.run.smithi086.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T12:09:59.248 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-25T12:09:59.255 INFO:teuthology.task.internal:Configuring sudo... 2024-04-25T12:09:59.255 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T12:09:59.292 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T12:09:59.305 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-25T12:09:59.315 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-25T12:09:59.315 DEBUG:teuthology.orchestra.run.smithi086:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T12:09:59.348 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T12:09:59.353 DEBUG:teuthology.orchestra.run.smithi086:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T12:09:59.398 DEBUG:teuthology.orchestra.run.smithi086:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T12:09:59.446 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-04-25T12:09:59.447 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T12:09:59.518 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T12:09:59.524 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T12:09:59.574 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-25T12:09:59.574 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T12:09:59.642 DEBUG:teuthology.orchestra.run.smithi086:> sudo service rsyslog restart 2024-04-25T12:09:59.649 DEBUG:teuthology.orchestra.run.smithi134:> sudo service rsyslog restart 2024-04-25T12:09:59.725 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-25T12:09:59.804 INFO:teuthology.task.internal:Starting timer... 2024-04-25T12:09:59.804 INFO:teuthology.run_tasks:Running task pcp... 2024-04-25T12:10:00.007 INFO:teuthology.run_tasks:Running task selinux... 2024-04-25T12:10:00.162 DEBUG:teuthology.task.selinux:Excluding smithi086: OS 'ubuntu' does not support SELinux 2024-04-25T12:10:00.162 DEBUG:teuthology.task.selinux:Excluding smithi134: OS 'ubuntu' does not support SELinux 2024-04-25T12:10:00.162 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-25T12:10:00.163 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-04-25T12:10:00.163 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-25T12:10:00.163 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-25T12:10:00.209 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-04-25T12:10:00.263 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-04-25T12:10:00.559 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-25T12:10:00.575 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-25T12:10:00.577 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi086.front.sepia.ceph.com,smithi134.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-25T12:17:09.883 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi086.front.sepia.ceph.com'), Remote(name='ubuntu@smithi134.front.sepia.ceph.com')] 2024-04-25T12:17:09.884 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-04-25T12:17:09.885 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T12:17:09.969 DEBUG:teuthology.orchestra.run.smithi086:> true 2024-04-25T12:17:10.046 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-04-25T12:17:10.047 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-04-25T12:17:10.047 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T12:17:10.125 DEBUG:teuthology.orchestra.run.smithi134:> true 2024-04-25T12:17:10.206 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-04-25T12:17:10.206 INFO:teuthology.run_tasks:Running task clock... 2024-04-25T12:17:10.217 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-25T12:17:10.217 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T12:17:10.218 DEBUG:teuthology.orchestra.run.smithi086:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T12:17:10.220 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T12:17:10.220 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T12:17:10.249 INFO:teuthology.orchestra.run.smithi086.stdout:25 Apr 12:17:10 ntpd[17207]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-25T12:17:10.249 INFO:teuthology.orchestra.run.smithi086.stdout:25 Apr 12:17:10 ntpd[17207]: Command line: ntpd -gq 2024-04-25T12:17:10.249 INFO:teuthology.orchestra.run.smithi086.stdout:25 Apr 12:17:10 ntpd[17207]: ---------------------------------------------------- 2024-04-25T12:17:10.249 INFO:teuthology.orchestra.run.smithi086.stdout:25 Apr 12:17:10 ntpd[17207]: ntp-4 is maintained by Network Time Foundation, 2024-04-25T12:17:10.249 INFO:teuthology.orchestra.run.smithi086.stdout:25 Apr 12:17:10 ntpd[17207]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-25T12:17:10.249 INFO:teuthology.orchestra.run.smithi086.stdout:25 Apr 12:17:10 ntpd[17207]: corporation. Support and training for ntp-4 are 2024-04-25T12:17:10.249 INFO:teuthology.orchestra.run.smithi086.stdout:25 Apr 12:17:10 ntpd[17207]: available at https://www.nwtime.org/support 2024-04-25T12:17:10.249 INFO:teuthology.orchestra.run.smithi086.stdout:25 Apr 12:17:10 ntpd[17207]: ---------------------------------------------------- 2024-04-25T12:17:10.250 INFO:teuthology.orchestra.run.smithi086.stdout:25 Apr 12:17:10 ntpd[17207]: proto: precision = 0.060 usec (-24) 2024-04-25T12:17:10.250 INFO:teuthology.orchestra.run.smithi086.stdout:25 Apr 12:17:10 ntpd[17207]: basedate set to 2022-02-04 2024-04-25T12:17:10.250 INFO:teuthology.orchestra.run.smithi086.stdout:25 Apr 12:17:10 ntpd[17207]: gps base set to 2022-02-06 (week 2196) 2024-04-25T12:17:10.250 INFO:teuthology.orchestra.run.smithi086.stdout:25 Apr 12:17:10 ntpd[17207]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T12:17:10.251 INFO:teuthology.orchestra.run.smithi086.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T12:17:10.251 INFO:teuthology.orchestra.run.smithi086.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-25T12:17:10.252 INFO:teuthology.orchestra.run.smithi086.stdout:25 Apr 12:17:10 ntpd[17207]: restrict ::: KOD does nothing without LIMITED. 2024-04-25T12:17:10.252 INFO:teuthology.orchestra.run.smithi086.stdout:25 Apr 12:17:10 ntpd[17207]: Listen and drop on 0 v6wildcard [::]:123 2024-04-25T12:17:10.252 INFO:teuthology.orchestra.run.smithi086.stdout:25 Apr 12:17:10 ntpd[17207]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-25T12:17:10.252 INFO:teuthology.orchestra.run.smithi086.stdout:25 Apr 12:17:10 ntpd[17207]: Listen normally on 2 lo 127.0.0.1:123 2024-04-25T12:17:10.252 INFO:teuthology.orchestra.run.smithi086.stdout:25 Apr 12:17:10 ntpd[17207]: Listen normally on 3 enp3s0f1 172.21.15.86:123 2024-04-25T12:17:10.252 INFO:teuthology.orchestra.run.smithi086.stdout:25 Apr 12:17:10 ntpd[17207]: Listen normally on 4 lo [::1]:123 2024-04-25T12:17:10.252 INFO:teuthology.orchestra.run.smithi086.stdout:25 Apr 12:17:10 ntpd[17207]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d809%5]:123 2024-04-25T12:17:10.252 INFO:teuthology.orchestra.run.smithi086.stdout:25 Apr 12:17:10 ntpd[17207]: Listening on routing socket on fd #22 for interface updates 2024-04-25T12:17:10.272 INFO:teuthology.orchestra.run.smithi134.stdout:25 Apr 12:17:10 ntpd[17208]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-25T12:17:10.272 INFO:teuthology.orchestra.run.smithi134.stdout:25 Apr 12:17:10 ntpd[17208]: Command line: ntpd -gq 2024-04-25T12:17:10.272 INFO:teuthology.orchestra.run.smithi134.stdout:25 Apr 12:17:10 ntpd[17208]: ---------------------------------------------------- 2024-04-25T12:17:10.272 INFO:teuthology.orchestra.run.smithi134.stdout:25 Apr 12:17:10 ntpd[17208]: ntp-4 is maintained by Network Time Foundation, 2024-04-25T12:17:10.272 INFO:teuthology.orchestra.run.smithi134.stdout:25 Apr 12:17:10 ntpd[17208]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-25T12:17:10.273 INFO:teuthology.orchestra.run.smithi134.stdout:25 Apr 12:17:10 ntpd[17208]: corporation. Support and training for ntp-4 are 2024-04-25T12:17:10.273 INFO:teuthology.orchestra.run.smithi134.stdout:25 Apr 12:17:10 ntpd[17208]: available at https://www.nwtime.org/support 2024-04-25T12:17:10.273 INFO:teuthology.orchestra.run.smithi134.stdout:25 Apr 12:17:10 ntpd[17208]: ---------------------------------------------------- 2024-04-25T12:17:10.273 INFO:teuthology.orchestra.run.smithi134.stdout:25 Apr 12:17:10 ntpd[17208]: proto: precision = 0.045 usec (-24) 2024-04-25T12:17:10.273 INFO:teuthology.orchestra.run.smithi134.stdout:25 Apr 12:17:10 ntpd[17208]: basedate set to 2022-02-04 2024-04-25T12:17:10.274 INFO:teuthology.orchestra.run.smithi134.stdout:25 Apr 12:17:10 ntpd[17208]: gps base set to 2022-02-06 (week 2196) 2024-04-25T12:17:10.274 INFO:teuthology.orchestra.run.smithi134.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T12:17:10.274 INFO:teuthology.orchestra.run.smithi134.stdout:25 Apr 12:17:10 ntpd[17208]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T12:17:10.274 INFO:teuthology.orchestra.run.smithi134.stdout:25 Apr 12:17:10 ntpd[17208]: restrict ::: KOD does nothing without LIMITED. 2024-04-25T12:17:10.275 INFO:teuthology.orchestra.run.smithi134.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-25T12:17:10.275 INFO:teuthology.orchestra.run.smithi134.stdout:25 Apr 12:17:10 ntpd[17208]: Listen and drop on 0 v6wildcard [::]:123 2024-04-25T12:17:10.276 INFO:teuthology.orchestra.run.smithi134.stdout:25 Apr 12:17:10 ntpd[17208]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-25T12:17:10.276 INFO:teuthology.orchestra.run.smithi134.stdout:25 Apr 12:17:10 ntpd[17208]: Listen normally on 2 lo 127.0.0.1:123 2024-04-25T12:17:10.276 INFO:teuthology.orchestra.run.smithi134.stdout:25 Apr 12:17:10 ntpd[17208]: Listen normally on 3 enp3s0f1 172.21.15.134:123 2024-04-25T12:17:10.276 INFO:teuthology.orchestra.run.smithi134.stdout:25 Apr 12:17:10 ntpd[17208]: Listen normally on 4 lo [::1]:123 2024-04-25T12:17:10.276 INFO:teuthology.orchestra.run.smithi134.stdout:25 Apr 12:17:10 ntpd[17208]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6de9%5]:123 2024-04-25T12:17:10.276 INFO:teuthology.orchestra.run.smithi134.stdout:25 Apr 12:17:10 ntpd[17208]: Listening on routing socket on fd #22 for interface updates 2024-04-25T12:17:11.250 INFO:teuthology.orchestra.run.smithi086.stderr:25 Apr 12:17:11 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:17:11.250 INFO:teuthology.orchestra.run.smithi086.stderr:25 Apr 12:17:11 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:17:11.250 INFO:teuthology.orchestra.run.smithi086.stderr:25 Apr 12:17:11 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:17:11.250 INFO:teuthology.orchestra.run.smithi086.stderr:25 Apr 12:17:11 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:17:11.250 INFO:teuthology.orchestra.run.smithi086.stderr:25 Apr 12:17:11 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:17:11.250 INFO:teuthology.orchestra.run.smithi086.stderr:25 Apr 12:17:11 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:17:11.250 INFO:teuthology.orchestra.run.smithi086.stderr:25 Apr 12:17:11 ntpd[17207]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T12:17:11.250 INFO:teuthology.orchestra.run.smithi086.stderr:25 Apr 12:17:11 ntpd[17207]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T12:17:11.273 INFO:teuthology.orchestra.run.smithi134.stderr:25 Apr 12:17:11 ntpd[17208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:17:11.273 INFO:teuthology.orchestra.run.smithi134.stderr:25 Apr 12:17:11 ntpd[17208]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:17:11.273 INFO:teuthology.orchestra.run.smithi134.stderr:25 Apr 12:17:11 ntpd[17208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:17:11.273 INFO:teuthology.orchestra.run.smithi134.stderr:25 Apr 12:17:11 ntpd[17208]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:17:11.273 INFO:teuthology.orchestra.run.smithi134.stderr:25 Apr 12:17:11 ntpd[17208]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T12:17:11.273 INFO:teuthology.orchestra.run.smithi134.stderr:25 Apr 12:17:11 ntpd[17208]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T12:17:12.274 INFO:teuthology.orchestra.run.smithi134.stderr:25 Apr 12:17:12 ntpd[17208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:17:12.274 INFO:teuthology.orchestra.run.smithi134.stderr:25 Apr 12:17:12 ntpd[17208]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:17:12.274 INFO:teuthology.orchestra.run.smithi134.stderr:25 Apr 12:17:12 ntpd[17208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:17:12.274 INFO:teuthology.orchestra.run.smithi134.stderr:25 Apr 12:17:12 ntpd[17208]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:17:12.274 INFO:teuthology.orchestra.run.smithi134.stderr:25 Apr 12:17:12 ntpd[17208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:17:12.274 INFO:teuthology.orchestra.run.smithi134.stderr:25 Apr 12:17:12 ntpd[17208]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:17:12.274 INFO:teuthology.orchestra.run.smithi134.stderr:25 Apr 12:17:12 ntpd[17208]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T12:17:12.274 INFO:teuthology.orchestra.run.smithi134.stderr:25 Apr 12:17:12 ntpd[17208]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T12:17:12.274 INFO:teuthology.orchestra.run.smithi134.stderr:25 Apr 12:17:12 ntpd[17208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:17:12.274 INFO:teuthology.orchestra.run.smithi134.stderr:25 Apr 12:17:12 ntpd[17208]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:17:12.274 INFO:teuthology.orchestra.run.smithi134.stderr:25 Apr 12:17:12 ntpd[17208]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T12:17:12.275 INFO:teuthology.orchestra.run.smithi134.stderr:25 Apr 12:17:12 ntpd[17208]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T12:17:13.250 INFO:teuthology.orchestra.run.smithi086.stderr:25 Apr 12:17:13 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:17:13.251 INFO:teuthology.orchestra.run.smithi086.stderr:25 Apr 12:17:13 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:17:13.251 INFO:teuthology.orchestra.run.smithi086.stderr:25 Apr 12:17:13 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:17:13.251 INFO:teuthology.orchestra.run.smithi086.stderr:25 Apr 12:17:13 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:17:13.251 INFO:teuthology.orchestra.run.smithi086.stderr:25 Apr 12:17:13 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:17:13.251 INFO:teuthology.orchestra.run.smithi086.stderr:25 Apr 12:17:13 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:17:13.251 INFO:teuthology.orchestra.run.smithi086.stderr:25 Apr 12:17:13 ntpd[17207]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T12:17:13.251 INFO:teuthology.orchestra.run.smithi086.stderr:25 Apr 12:17:13 ntpd[17207]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T12:17:13.251 INFO:teuthology.orchestra.run.smithi086.stderr:25 Apr 12:17:13 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:17:13.251 INFO:teuthology.orchestra.run.smithi086.stderr:25 Apr 12:17:13 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:17:13.251 INFO:teuthology.orchestra.run.smithi086.stderr:25 Apr 12:17:13 ntpd[17207]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T12:17:13.251 INFO:teuthology.orchestra.run.smithi086.stderr:25 Apr 12:17:13 ntpd[17207]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T12:17:13.273 INFO:teuthology.orchestra.run.smithi134.stderr:25 Apr 12:17:13 ntpd[17208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:17:13.273 INFO:teuthology.orchestra.run.smithi134.stderr:25 Apr 12:17:13 ntpd[17208]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:17:13.274 INFO:teuthology.orchestra.run.smithi134.stderr:25 Apr 12:17:13 ntpd[17208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:17:13.274 INFO:teuthology.orchestra.run.smithi134.stderr:25 Apr 12:17:13 ntpd[17208]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:17:13.274 INFO:teuthology.orchestra.run.smithi134.stderr:25 Apr 12:17:13 ntpd[17208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:17:13.274 INFO:teuthology.orchestra.run.smithi134.stderr:25 Apr 12:17:13 ntpd[17208]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:17:13.274 INFO:teuthology.orchestra.run.smithi134.stderr:25 Apr 12:17:13 ntpd[17208]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T12:17:13.274 INFO:teuthology.orchestra.run.smithi134.stderr:25 Apr 12:17:13 ntpd[17208]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T12:17:14.250 INFO:teuthology.orchestra.run.smithi086.stderr:25 Apr 12:17:14 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:17:14.250 INFO:teuthology.orchestra.run.smithi086.stderr:25 Apr 12:17:14 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:17:14.250 INFO:teuthology.orchestra.run.smithi086.stderr:25 Apr 12:17:14 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:17:14.250 INFO:teuthology.orchestra.run.smithi086.stderr:25 Apr 12:17:14 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:17:14.250 INFO:teuthology.orchestra.run.smithi086.stderr:25 Apr 12:17:14 ntpd[17207]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T12:17:14.250 INFO:teuthology.orchestra.run.smithi086.stderr:25 Apr 12:17:14 ntpd[17207]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T12:17:14.273 INFO:teuthology.orchestra.run.smithi134.stderr:25 Apr 12:17:14 ntpd[17208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:17:14.274 INFO:teuthology.orchestra.run.smithi134.stderr:25 Apr 12:17:14 ntpd[17208]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:17:14.274 INFO:teuthology.orchestra.run.smithi134.stderr:25 Apr 12:17:14 ntpd[17208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:17:14.274 INFO:teuthology.orchestra.run.smithi134.stderr:25 Apr 12:17:14 ntpd[17208]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:17:14.274 INFO:teuthology.orchestra.run.smithi134.stderr:25 Apr 12:17:14 ntpd[17208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:17:14.274 INFO:teuthology.orchestra.run.smithi134.stderr:25 Apr 12:17:14 ntpd[17208]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:17:14.274 INFO:teuthology.orchestra.run.smithi134.stderr:25 Apr 12:17:14 ntpd[17208]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T12:17:14.274 INFO:teuthology.orchestra.run.smithi134.stderr:25 Apr 12:17:14 ntpd[17208]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T12:17:14.274 INFO:teuthology.orchestra.run.smithi134.stderr:25 Apr 12:17:14 ntpd[17208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:17:14.274 INFO:teuthology.orchestra.run.smithi134.stderr:25 Apr 12:17:14 ntpd[17208]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:17:14.274 INFO:teuthology.orchestra.run.smithi134.stderr:25 Apr 12:17:14 ntpd[17208]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T12:17:14.274 INFO:teuthology.orchestra.run.smithi134.stderr:25 Apr 12:17:14 ntpd[17208]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T12:17:15.250 INFO:teuthology.orchestra.run.smithi086.stderr:25 Apr 12:17:15 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:17:15.250 INFO:teuthology.orchestra.run.smithi086.stderr:25 Apr 12:17:15 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:17:15.251 INFO:teuthology.orchestra.run.smithi086.stderr:25 Apr 12:17:15 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:17:15.251 INFO:teuthology.orchestra.run.smithi086.stderr:25 Apr 12:17:15 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:17:15.251 INFO:teuthology.orchestra.run.smithi086.stderr:25 Apr 12:17:15 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:17:15.251 INFO:teuthology.orchestra.run.smithi086.stderr:25 Apr 12:17:15 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:17:15.251 INFO:teuthology.orchestra.run.smithi086.stderr:25 Apr 12:17:15 ntpd[17207]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T12:17:15.251 INFO:teuthology.orchestra.run.smithi086.stderr:25 Apr 12:17:15 ntpd[17207]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T12:17:15.251 INFO:teuthology.orchestra.run.smithi086.stderr:25 Apr 12:17:15 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:17:15.251 INFO:teuthology.orchestra.run.smithi086.stderr:25 Apr 12:17:15 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:17:15.251 INFO:teuthology.orchestra.run.smithi086.stderr:25 Apr 12:17:15 ntpd[17207]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T12:17:15.251 INFO:teuthology.orchestra.run.smithi086.stderr:25 Apr 12:17:15 ntpd[17207]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T12:17:15.273 INFO:teuthology.orchestra.run.smithi134.stderr:25 Apr 12:17:15 ntpd[17208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:17:15.273 INFO:teuthology.orchestra.run.smithi134.stderr:25 Apr 12:17:15 ntpd[17208]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:17:15.273 INFO:teuthology.orchestra.run.smithi134.stderr:25 Apr 12:17:15 ntpd[17208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:17:15.273 INFO:teuthology.orchestra.run.smithi134.stderr:25 Apr 12:17:15 ntpd[17208]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:17:15.274 INFO:teuthology.orchestra.run.smithi134.stderr:25 Apr 12:17:15 ntpd[17208]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T12:17:15.274 INFO:teuthology.orchestra.run.smithi134.stderr:25 Apr 12:17:15 ntpd[17208]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T12:17:16.250 INFO:teuthology.orchestra.run.smithi086.stderr:25 Apr 12:17:16 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:17:16.250 INFO:teuthology.orchestra.run.smithi086.stderr:25 Apr 12:17:16 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:17:16.250 INFO:teuthology.orchestra.run.smithi086.stderr:25 Apr 12:17:16 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:17:16.250 INFO:teuthology.orchestra.run.smithi086.stderr:25 Apr 12:17:16 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:17:16.250 INFO:teuthology.orchestra.run.smithi086.stderr:25 Apr 12:17:16 ntpd[17207]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T12:17:16.250 INFO:teuthology.orchestra.run.smithi086.stderr:25 Apr 12:17:16 ntpd[17207]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T12:17:16.274 INFO:teuthology.orchestra.run.smithi134.stderr:25 Apr 12:17:16 ntpd[17208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:17:16.274 INFO:teuthology.orchestra.run.smithi134.stderr:25 Apr 12:17:16 ntpd[17208]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:17:16.274 INFO:teuthology.orchestra.run.smithi134.stderr:25 Apr 12:17:16 ntpd[17208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:17:16.274 INFO:teuthology.orchestra.run.smithi134.stderr:25 Apr 12:17:16 ntpd[17208]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:17:16.274 INFO:teuthology.orchestra.run.smithi134.stderr:25 Apr 12:17:16 ntpd[17208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:17:16.274 INFO:teuthology.orchestra.run.smithi134.stderr:25 Apr 12:17:16 ntpd[17208]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:17:16.274 INFO:teuthology.orchestra.run.smithi134.stderr:25 Apr 12:17:16 ntpd[17208]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T12:17:16.275 INFO:teuthology.orchestra.run.smithi134.stderr:25 Apr 12:17:16 ntpd[17208]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T12:17:16.275 INFO:teuthology.orchestra.run.smithi134.stderr:25 Apr 12:17:16 ntpd[17208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:17:16.275 INFO:teuthology.orchestra.run.smithi134.stderr:25 Apr 12:17:16 ntpd[17208]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:17:16.275 INFO:teuthology.orchestra.run.smithi134.stderr:25 Apr 12:17:16 ntpd[17208]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T12:17:16.275 INFO:teuthology.orchestra.run.smithi134.stderr:25 Apr 12:17:16 ntpd[17208]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T12:17:17.250 INFO:teuthology.orchestra.run.smithi086.stderr:25 Apr 12:17:17 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:17:17.250 INFO:teuthology.orchestra.run.smithi086.stderr:25 Apr 12:17:17 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:17:17.250 INFO:teuthology.orchestra.run.smithi086.stderr:25 Apr 12:17:17 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:17:17.251 INFO:teuthology.orchestra.run.smithi086.stderr:25 Apr 12:17:17 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:17:17.251 INFO:teuthology.orchestra.run.smithi086.stderr:25 Apr 12:17:17 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:17:17.251 INFO:teuthology.orchestra.run.smithi086.stderr:25 Apr 12:17:17 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:17:17.251 INFO:teuthology.orchestra.run.smithi086.stderr:25 Apr 12:17:17 ntpd[17207]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T12:17:17.251 INFO:teuthology.orchestra.run.smithi086.stderr:25 Apr 12:17:17 ntpd[17207]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T12:17:17.251 INFO:teuthology.orchestra.run.smithi086.stdout:25 Apr 12:17:17 ntpd[17207]: ntpd: time slew -0.001113 s 2024-04-25T12:17:17.251 INFO:teuthology.orchestra.run.smithi086.stdout:ntpd: time slew -0.001113s 2024-04-25T12:17:17.252 INFO:teuthology.orchestra.run.smithi086.stderr:25 Apr 12:17:17 ntpd[17207]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-25T12:17:17.252 INFO:teuthology.orchestra.run.smithi086.stderr:25 Apr 12:17:17 ntpd[17207]: can't open /var/log/ntpstats/loopstats.20240425: Permission denied 2024-04-25T12:17:17.273 INFO:teuthology.orchestra.run.smithi134.stderr:25 Apr 12:17:17 ntpd[17208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:17:17.273 INFO:teuthology.orchestra.run.smithi134.stderr:25 Apr 12:17:17 ntpd[17208]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:17:17.273 INFO:teuthology.orchestra.run.smithi134.stderr:25 Apr 12:17:17 ntpd[17208]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:17:17.273 INFO:teuthology.orchestra.run.smithi134.stderr:25 Apr 12:17:17 ntpd[17208]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:17:17.273 INFO:teuthology.orchestra.run.smithi134.stderr:25 Apr 12:17:17 ntpd[17208]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T12:17:17.273 INFO:teuthology.orchestra.run.smithi134.stderr:25 Apr 12:17:17 ntpd[17208]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T12:17:17.274 INFO:teuthology.orchestra.run.smithi134.stdout:25 Apr 12:17:17 ntpd[17208]: ntpd: time slew -0.001055 s 2024-04-25T12:17:17.274 INFO:teuthology.orchestra.run.smithi134.stdout:ntpd: time slew -0.001055s 2024-04-25T12:17:17.274 INFO:teuthology.orchestra.run.smithi134.stderr:25 Apr 12:17:17 ntpd[17208]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-25T12:17:17.274 INFO:teuthology.orchestra.run.smithi134.stderr:25 Apr 12:17:17 ntpd[17208]: can't open /var/log/ntpstats/loopstats.20240425: Permission denied 2024-04-25T12:17:17.293 INFO:teuthology.orchestra.run.smithi086.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T12:17:17.293 INFO:teuthology.orchestra.run.smithi086.stdout:============================================================================== 2024-04-25T12:17:17.293 INFO:teuthology.orchestra.run.smithi086.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T12:17:17.293 INFO:teuthology.orchestra.run.smithi086.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T12:17:17.293 INFO:teuthology.orchestra.run.smithi086.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T12:17:17.294 INFO:teuthology.orchestra.run.smithi086.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T12:17:17.328 INFO:teuthology.orchestra.run.smithi134.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T12:17:17.328 INFO:teuthology.orchestra.run.smithi134.stdout:============================================================================== 2024-04-25T12:17:17.328 INFO:teuthology.orchestra.run.smithi134.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T12:17:17.328 INFO:teuthology.orchestra.run.smithi134.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T12:17:17.328 INFO:teuthology.orchestra.run.smithi134.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T12:17:17.328 INFO:teuthology.orchestra.run.smithi134.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T12:17:17.329 INFO:teuthology.run_tasks:Running task install... 2024-04-25T12:17:17.339 DEBUG:teuthology.task.install:project ceph 2024-04-25T12:17:17.339 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f'}} 2024-04-25T12:17:17.339 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f'} 2024-04-25T12:17:17.339 INFO:teuthology.task.install:Using flavor: default 2024-04-25T12:17:17.347 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-25T12:17:17.347 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-25T12:17:17.347 DEBUG:teuthology.orchestra.run.smithi086:> sudo apt-key list | grep Ceph 2024-04-25T12:17:17.348 DEBUG:teuthology.orchestra.run.smithi134:> sudo apt-key list | grep Ceph 2024-04-25T12:17:17.406 INFO:teuthology.orchestra.run.smithi086.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-25T12:17:17.427 INFO:teuthology.orchestra.run.smithi134.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-25T12:17:17.433 INFO:teuthology.orchestra.run.smithi086.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-25T12:17:17.433 INFO:teuthology.orchestra.run.smithi086.stdout:uid [ unknown] Ceph.com (release key) 2024-04-25T12:17:17.433 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-25T12:17:17.433 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-25T12:17:17.434 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-25T12:17:17.455 INFO:teuthology.orchestra.run.smithi134.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-25T12:17:17.455 INFO:teuthology.orchestra.run.smithi134.stdout:uid [ unknown] Ceph.com (release key) 2024-04-25T12:17:17.456 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-25T12:17:17.456 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-25T12:17:17.456 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-25T12:17:17.576 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default/ 2024-04-25T12:17:17.576 INFO:teuthology.task.install.deb:Package version is 19.0.0-3156-gd69f13d8-1jammy 2024-04-25T12:17:17.598 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default/ 2024-04-25T12:17:17.598 INFO:teuthology.task.install.deb:Package version is 19.0.0-3156-gd69f13d8-1jammy 2024-04-25T12:17:17.704 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-25T12:17:17.704 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-25T12:17:17.717 DEBUG:teuthology.orchestra.run.smithi134:> sudo apt-get update 2024-04-25T12:17:17.833 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-04-25T12:17:17.833 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-25T12:17:17.847 DEBUG:teuthology.orchestra.run.smithi086:> sudo apt-get update 2024-04-25T12:17:17.944 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-25T12:17:17.945 INFO:teuthology.orchestra.run.smithi134.stdout:Ign:2 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy InRelease 2024-04-25T12:17:17.967 INFO:teuthology.orchestra.run.smithi134.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-25T12:17:17.989 INFO:teuthology.orchestra.run.smithi134.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-25T12:17:18.004 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T12:17:18.013 INFO:teuthology.orchestra.run.smithi134.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,417 B] 2024-04-25T12:17:18.063 INFO:teuthology.orchestra.run.smithi134.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-04-25T12:17:18.086 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-25T12:17:18.144 INFO:teuthology.orchestra.run.smithi086.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T12:17:18.144 INFO:teuthology.orchestra.run.smithi086.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-25T12:17:18.167 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-25T12:17:18.215 INFO:teuthology.orchestra.run.smithi086.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-25T12:17:18.245 INFO:teuthology.orchestra.run.smithi086.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy InRelease 2024-04-25T12:17:18.303 INFO:teuthology.orchestra.run.smithi134.stdout:Fetched 29.3 kB in 0s (71.7 kB/s) 2024-04-25T12:17:18.318 INFO:teuthology.orchestra.run.smithi086.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-25T12:17:18.393 INFO:teuthology.orchestra.run.smithi086.stdout:Ign:6 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-25T12:17:18.470 INFO:teuthology.orchestra.run.smithi086.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-04-25T12:17:18.557 INFO:teuthology.orchestra.run.smithi086.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,417 B] 2024-04-25T12:17:18.581 INFO:teuthology.orchestra.run.smithi086.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-25T12:17:18.800 INFO:teuthology.orchestra.run.smithi086.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-25T12:17:18.912 INFO:teuthology.orchestra.run.smithi086.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-04-25T12:17:18.937 INFO:teuthology.orchestra.run.smithi086.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-04-25T12:17:18.949 INFO:teuthology.orchestra.run.smithi086.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-04-25T12:17:19.058 INFO:teuthology.orchestra.run.smithi086.stdout:Fetched 426 kB in 1s (423 kB/s) 2024-04-25T12:17:19.224 INFO:teuthology.orchestra.run.smithi134.stdout:Reading package lists... 2024-04-25T12:17:19.240 DEBUG:teuthology.orchestra.run.smithi134:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3156-gd69f13d8-1jammy cephadm=19.0.0-3156-gd69f13d8-1jammy ceph-mds=19.0.0-3156-gd69f13d8-1jammy ceph-mgr=19.0.0-3156-gd69f13d8-1jammy ceph-common=19.0.0-3156-gd69f13d8-1jammy ceph-fuse=19.0.0-3156-gd69f13d8-1jammy ceph-test=19.0.0-3156-gd69f13d8-1jammy ceph-volume=19.0.0-3156-gd69f13d8-1jammy radosgw=19.0.0-3156-gd69f13d8-1jammy python3-rados=19.0.0-3156-gd69f13d8-1jammy python3-rgw=19.0.0-3156-gd69f13d8-1jammy python3-cephfs=19.0.0-3156-gd69f13d8-1jammy python3-rbd=19.0.0-3156-gd69f13d8-1jammy libcephfs2=19.0.0-3156-gd69f13d8-1jammy libcephfs-dev=19.0.0-3156-gd69f13d8-1jammy librados2=19.0.0-3156-gd69f13d8-1jammy librbd1=19.0.0-3156-gd69f13d8-1jammy rbd-fuse=19.0.0-3156-gd69f13d8-1jammy python3-cephfs=19.0.0-3156-gd69f13d8-1jammy cephfs-shell=19.0.0-3156-gd69f13d8-1jammy cephfs-top=19.0.0-3156-gd69f13d8-1jammy cephfs-mirror=19.0.0-3156-gd69f13d8-1jammy 2024-04-25T12:17:19.292 INFO:teuthology.orchestra.run.smithi134.stdout:Reading package lists... 2024-04-25T12:17:19.469 INFO:teuthology.orchestra.run.smithi134.stdout:Building dependency tree... 2024-04-25T12:17:19.470 INFO:teuthology.orchestra.run.smithi134.stdout:Reading state information... 2024-04-25T12:17:19.642 INFO:teuthology.orchestra.run.smithi134.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T12:17:19.642 INFO:teuthology.orchestra.run.smithi134.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T12:17:19.642 INFO:teuthology.orchestra.run.smithi134.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T12:17:19.642 INFO:teuthology.orchestra.run.smithi134.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T12:17:19.642 INFO:teuthology.orchestra.run.smithi134.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T12:17:19.643 INFO:teuthology.orchestra.run.smithi134.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T12:17:19.643 INFO:teuthology.orchestra.run.smithi134.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T12:17:19.643 INFO:teuthology.orchestra.run.smithi134.stdout:The following additional packages will be installed: 2024-04-25T12:17:19.643 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-25T12:17:19.643 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-25T12:17:19.645 INFO:teuthology.orchestra.run.smithi134.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-25T12:17:19.645 INFO:teuthology.orchestra.run.smithi134.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-25T12:17:19.645 INFO:teuthology.orchestra.run.smithi134.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-25T12:17:19.645 INFO:teuthology.orchestra.run.smithi134.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-25T12:17:19.645 INFO:teuthology.orchestra.run.smithi134.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-25T12:17:19.645 INFO:teuthology.orchestra.run.smithi134.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-25T12:17:19.645 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-25T12:17:19.646 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-25T12:17:19.646 INFO:teuthology.orchestra.run.smithi134.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-25T12:17:19.646 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-25T12:17:19.646 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-25T12:17:19.646 INFO:teuthology.orchestra.run.smithi134.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-25T12:17:19.646 INFO:teuthology.orchestra.run.smithi134.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-25T12:17:19.646 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-25T12:17:19.646 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-25T12:17:19.646 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-25T12:17:19.646 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-25T12:17:19.646 INFO:teuthology.orchestra.run.smithi134.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-25T12:17:19.647 INFO:teuthology.orchestra.run.smithi134.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-25T12:17:19.647 INFO:teuthology.orchestra.run.smithi134.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-25T12:17:19.647 INFO:teuthology.orchestra.run.smithi134.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-25T12:17:19.647 INFO:teuthology.orchestra.run.smithi134.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-04-25T12:17:19.647 INFO:teuthology.orchestra.run.smithi134.stdout:Suggested packages: 2024-04-25T12:17:19.647 INFO:teuthology.orchestra.run.smithi134.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-25T12:17:19.647 INFO:teuthology.orchestra.run.smithi134.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-25T12:17:19.647 INFO:teuthology.orchestra.run.smithi134.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-25T12:17:19.647 INFO:teuthology.orchestra.run.smithi134.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-25T12:17:19.647 INFO:teuthology.orchestra.run.smithi134.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-25T12:17:19.648 INFO:teuthology.orchestra.run.smithi134.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-25T12:17:19.648 INFO:teuthology.orchestra.run.smithi134.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-25T12:17:19.648 INFO:teuthology.orchestra.run.smithi134.stdout:Recommended packages: 2024-04-25T12:17:19.648 INFO:teuthology.orchestra.run.smithi134.stdout: btrfs-tools 2024-04-25T12:17:19.749 INFO:teuthology.orchestra.run.smithi134.stdout:The following NEW packages will be installed: 2024-04-25T12:17:19.749 INFO:teuthology.orchestra.run.smithi134.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-25T12:17:19.749 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-25T12:17:19.749 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-25T12:17:19.749 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-25T12:17:19.751 INFO:teuthology.orchestra.run.smithi134.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-25T12:17:19.751 INFO:teuthology.orchestra.run.smithi134.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-25T12:17:19.751 INFO:teuthology.orchestra.run.smithi134.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-04-25T12:17:19.751 INFO:teuthology.orchestra.run.smithi134.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-25T12:17:19.751 INFO:teuthology.orchestra.run.smithi134.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-25T12:17:19.751 INFO:teuthology.orchestra.run.smithi134.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-25T12:17:19.751 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-25T12:17:19.751 INFO:teuthology.orchestra.run.smithi134.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-25T12:17:19.751 INFO:teuthology.orchestra.run.smithi134.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-25T12:17:19.752 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-25T12:17:19.752 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-25T12:17:19.752 INFO:teuthology.orchestra.run.smithi134.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-25T12:17:19.752 INFO:teuthology.orchestra.run.smithi134.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-25T12:17:19.752 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-25T12:17:19.752 INFO:teuthology.orchestra.run.smithi134.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-25T12:17:19.752 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-25T12:17:19.752 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-25T12:17:19.752 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-25T12:17:19.752 INFO:teuthology.orchestra.run.smithi134.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-25T12:17:19.752 INFO:teuthology.orchestra.run.smithi134.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-25T12:17:19.752 INFO:teuthology.orchestra.run.smithi134.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-25T12:17:19.752 INFO:teuthology.orchestra.run.smithi134.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-25T12:17:19.752 INFO:teuthology.orchestra.run.smithi134.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-25T12:17:19.752 INFO:teuthology.orchestra.run.smithi134.stdout: socat unzip xmlstarlet zip 2024-04-25T12:17:19.873 INFO:teuthology.orchestra.run.smithi134.stdout:0 upgraded, 124 newly installed, 0 to remove and 302 not upgraded. 2024-04-25T12:17:19.873 INFO:teuthology.orchestra.run.smithi134.stdout:Need to get 182 MB of archives. 2024-04-25T12:17:19.873 INFO:teuthology.orchestra.run.smithi134.stdout:After this operation, 830 MB of additional disk space will be used. 2024-04-25T12:17:19.873 INFO:teuthology.orchestra.run.smithi134.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-25T12:17:19.920 INFO:teuthology.orchestra.run.smithi134.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-25T12:17:19.945 INFO:teuthology.orchestra.run.smithi134.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3156-gd69f13d8-1jammy [3,555 kB] 2024-04-25T12:17:19.948 INFO:teuthology.orchestra.run.smithi134.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-25T12:17:20.032 INFO:teuthology.orchestra.run.smithi086.stdout:Reading package lists... 2024-04-25T12:17:20.049 DEBUG:teuthology.orchestra.run.smithi086:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3156-gd69f13d8-1jammy cephadm=19.0.0-3156-gd69f13d8-1jammy ceph-mds=19.0.0-3156-gd69f13d8-1jammy ceph-mgr=19.0.0-3156-gd69f13d8-1jammy ceph-common=19.0.0-3156-gd69f13d8-1jammy ceph-fuse=19.0.0-3156-gd69f13d8-1jammy ceph-test=19.0.0-3156-gd69f13d8-1jammy ceph-volume=19.0.0-3156-gd69f13d8-1jammy radosgw=19.0.0-3156-gd69f13d8-1jammy python3-rados=19.0.0-3156-gd69f13d8-1jammy python3-rgw=19.0.0-3156-gd69f13d8-1jammy python3-cephfs=19.0.0-3156-gd69f13d8-1jammy python3-rbd=19.0.0-3156-gd69f13d8-1jammy libcephfs2=19.0.0-3156-gd69f13d8-1jammy libcephfs-dev=19.0.0-3156-gd69f13d8-1jammy librados2=19.0.0-3156-gd69f13d8-1jammy librbd1=19.0.0-3156-gd69f13d8-1jammy rbd-fuse=19.0.0-3156-gd69f13d8-1jammy python3-cephfs=19.0.0-3156-gd69f13d8-1jammy cephfs-shell=19.0.0-3156-gd69f13d8-1jammy cephfs-top=19.0.0-3156-gd69f13d8-1jammy cephfs-mirror=19.0.0-3156-gd69f13d8-1jammy 2024-04-25T12:17:20.061 INFO:teuthology.orchestra.run.smithi134.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-25T12:17:20.100 INFO:teuthology.orchestra.run.smithi086.stdout:Reading package lists... 2024-04-25T12:17:20.127 INFO:teuthology.orchestra.run.smithi134.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-25T12:17:20.135 INFO:teuthology.orchestra.run.smithi134.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-25T12:17:20.169 INFO:teuthology.orchestra.run.smithi134.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-25T12:17:20.204 INFO:teuthology.orchestra.run.smithi134.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3156-gd69f13d8-1jammy [3,224 kB] 2024-04-25T12:17:20.275 INFO:teuthology.orchestra.run.smithi086.stdout:Building dependency tree... 2024-04-25T12:17:20.276 INFO:teuthology.orchestra.run.smithi086.stdout:Reading state information... 2024-04-25T12:17:20.302 INFO:teuthology.orchestra.run.smithi134.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-25T12:17:20.312 INFO:teuthology.orchestra.run.smithi134.stdout:Get:11 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3156-gd69f13d8-1jammy [712 kB] 2024-04-25T12:17:20.335 INFO:teuthology.orchestra.run.smithi134.stdout:Get:12 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3156-gd69f13d8-1jammy [356 kB] 2024-04-25T12:17:20.347 INFO:teuthology.orchestra.run.smithi134.stdout:Get:13 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3156-gd69f13d8-1jammy [32.8 kB] 2024-04-25T12:17:20.348 INFO:teuthology.orchestra.run.smithi134.stdout:Get:14 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3156-gd69f13d8-1jammy [180 kB] 2024-04-25T12:17:20.353 INFO:teuthology.orchestra.run.smithi134.stdout:Get:15 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3156-gd69f13d8-1jammy [66.9 kB] 2024-04-25T12:17:20.358 INFO:teuthology.orchestra.run.smithi134.stdout:Get:16 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3156-gd69f13d8-1jammy [330 kB] 2024-04-25T12:17:20.365 INFO:teuthology.orchestra.run.smithi134.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-25T12:17:20.366 INFO:teuthology.orchestra.run.smithi134.stdout:Get:18 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3156-gd69f13d8-1jammy [6,894 kB] 2024-04-25T12:17:20.383 INFO:teuthology.orchestra.run.smithi134.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-25T12:17:20.389 INFO:teuthology.orchestra.run.smithi134.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-25T12:17:20.390 INFO:teuthology.orchestra.run.smithi134.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-25T12:17:20.405 INFO:teuthology.orchestra.run.smithi134.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-25T12:17:20.408 INFO:teuthology.orchestra.run.smithi134.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-25T12:17:20.412 INFO:teuthology.orchestra.run.smithi134.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-25T12:17:20.414 INFO:teuthology.orchestra.run.smithi134.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-25T12:17:20.414 INFO:teuthology.orchestra.run.smithi134.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-25T12:17:20.418 INFO:teuthology.orchestra.run.smithi134.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-25T12:17:20.445 INFO:teuthology.orchestra.run.smithi086.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T12:17:20.446 INFO:teuthology.orchestra.run.smithi086.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T12:17:20.446 INFO:teuthology.orchestra.run.smithi086.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T12:17:20.446 INFO:teuthology.orchestra.run.smithi086.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T12:17:20.446 INFO:teuthology.orchestra.run.smithi086.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T12:17:20.447 INFO:teuthology.orchestra.run.smithi086.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T12:17:20.447 INFO:teuthology.orchestra.run.smithi086.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T12:17:20.447 INFO:teuthology.orchestra.run.smithi086.stdout:The following additional packages will be installed: 2024-04-25T12:17:20.447 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-25T12:17:20.447 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-25T12:17:20.448 INFO:teuthology.orchestra.run.smithi086.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-25T12:17:20.448 INFO:teuthology.orchestra.run.smithi086.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-25T12:17:20.448 INFO:teuthology.orchestra.run.smithi086.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-25T12:17:20.448 INFO:teuthology.orchestra.run.smithi086.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-25T12:17:20.448 INFO:teuthology.orchestra.run.smithi086.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-25T12:17:20.449 INFO:teuthology.orchestra.run.smithi086.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-25T12:17:20.449 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-25T12:17:20.449 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-25T12:17:20.449 INFO:teuthology.orchestra.run.smithi086.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-25T12:17:20.449 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-25T12:17:20.449 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-25T12:17:20.449 INFO:teuthology.orchestra.run.smithi086.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-25T12:17:20.449 INFO:teuthology.orchestra.run.smithi086.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-25T12:17:20.449 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-25T12:17:20.449 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-25T12:17:20.449 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-25T12:17:20.449 INFO:teuthology.orchestra.run.smithi086.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-25T12:17:20.449 INFO:teuthology.orchestra.run.smithi086.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-25T12:17:20.449 INFO:teuthology.orchestra.run.smithi086.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-25T12:17:20.449 INFO:teuthology.orchestra.run.smithi086.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-25T12:17:20.450 INFO:teuthology.orchestra.run.smithi086.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-25T12:17:20.450 INFO:teuthology.orchestra.run.smithi086.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-04-25T12:17:20.450 INFO:teuthology.orchestra.run.smithi086.stdout:Suggested packages: 2024-04-25T12:17:20.450 INFO:teuthology.orchestra.run.smithi086.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-25T12:17:20.450 INFO:teuthology.orchestra.run.smithi086.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-25T12:17:20.450 INFO:teuthology.orchestra.run.smithi086.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-25T12:17:20.450 INFO:teuthology.orchestra.run.smithi086.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-25T12:17:20.450 INFO:teuthology.orchestra.run.smithi086.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-25T12:17:20.450 INFO:teuthology.orchestra.run.smithi086.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-25T12:17:20.450 INFO:teuthology.orchestra.run.smithi086.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-25T12:17:20.451 INFO:teuthology.orchestra.run.smithi086.stdout:Recommended packages: 2024-04-25T12:17:20.451 INFO:teuthology.orchestra.run.smithi086.stdout: btrfs-tools 2024-04-25T12:17:20.454 INFO:teuthology.orchestra.run.smithi134.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-25T12:17:20.458 INFO:teuthology.orchestra.run.smithi134.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-25T12:17:20.459 INFO:teuthology.orchestra.run.smithi134.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-25T12:17:20.459 INFO:teuthology.orchestra.run.smithi134.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-25T12:17:20.461 INFO:teuthology.orchestra.run.smithi134.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-25T12:17:20.461 INFO:teuthology.orchestra.run.smithi134.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-25T12:17:20.487 INFO:teuthology.orchestra.run.smithi134.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-25T12:17:20.487 INFO:teuthology.orchestra.run.smithi134.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-25T12:17:20.488 INFO:teuthology.orchestra.run.smithi134.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-25T12:17:20.488 INFO:teuthology.orchestra.run.smithi134.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-25T12:17:20.521 INFO:teuthology.orchestra.run.smithi134.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-25T12:17:20.525 INFO:teuthology.orchestra.run.smithi134.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-25T12:17:20.527 INFO:teuthology.orchestra.run.smithi134.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-25T12:17:20.527 INFO:teuthology.orchestra.run.smithi134.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-25T12:17:20.528 INFO:teuthology.orchestra.run.smithi134.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-25T12:17:20.530 INFO:teuthology.orchestra.run.smithi134.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-25T12:17:20.553 INFO:teuthology.orchestra.run.smithi134.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-25T12:17:20.553 INFO:teuthology.orchestra.run.smithi086.stdout:The following NEW packages will be installed: 2024-04-25T12:17:20.553 INFO:teuthology.orchestra.run.smithi086.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-25T12:17:20.553 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-25T12:17:20.553 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-25T12:17:20.554 INFO:teuthology.orchestra.run.smithi134.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-25T12:17:20.555 INFO:teuthology.orchestra.run.smithi086.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-25T12:17:20.556 INFO:teuthology.orchestra.run.smithi086.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-25T12:17:20.556 INFO:teuthology.orchestra.run.smithi086.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-25T12:17:20.556 INFO:teuthology.orchestra.run.smithi086.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-04-25T12:17:20.556 INFO:teuthology.orchestra.run.smithi086.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-25T12:17:20.556 INFO:teuthology.orchestra.run.smithi086.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-25T12:17:20.556 INFO:teuthology.orchestra.run.smithi086.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-25T12:17:20.556 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-25T12:17:20.556 INFO:teuthology.orchestra.run.smithi086.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-25T12:17:20.556 INFO:teuthology.orchestra.run.smithi086.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-25T12:17:20.556 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-25T12:17:20.556 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-25T12:17:20.556 INFO:teuthology.orchestra.run.smithi086.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-25T12:17:20.556 INFO:teuthology.orchestra.run.smithi086.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-25T12:17:20.556 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-25T12:17:20.557 INFO:teuthology.orchestra.run.smithi086.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-25T12:17:20.557 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-25T12:17:20.557 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-25T12:17:20.557 INFO:teuthology.orchestra.run.smithi086.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-25T12:17:20.557 INFO:teuthology.orchestra.run.smithi086.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-25T12:17:20.557 INFO:teuthology.orchestra.run.smithi086.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-25T12:17:20.557 INFO:teuthology.orchestra.run.smithi086.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-25T12:17:20.557 INFO:teuthology.orchestra.run.smithi086.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-25T12:17:20.557 INFO:teuthology.orchestra.run.smithi086.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-25T12:17:20.557 INFO:teuthology.orchestra.run.smithi086.stdout: socat unzip xmlstarlet zip 2024-04-25T12:17:20.558 INFO:teuthology.orchestra.run.smithi134.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-25T12:17:20.558 INFO:teuthology.orchestra.run.smithi134.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-25T12:17:20.585 INFO:teuthology.orchestra.run.smithi134.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-25T12:17:20.608 INFO:teuthology.orchestra.run.smithi134.stdout:Get:49 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3156-gd69f13d8-1jammy [112 kB] 2024-04-25T12:17:20.609 INFO:teuthology.orchestra.run.smithi134.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-25T12:17:20.609 INFO:teuthology.orchestra.run.smithi134.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-25T12:17:20.609 INFO:teuthology.orchestra.run.smithi134.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-25T12:17:20.611 INFO:teuthology.orchestra.run.smithi134.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-25T12:17:20.611 INFO:teuthology.orchestra.run.smithi134.stdout:Get:54 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3156-gd69f13d8-1jammy [466 kB] 2024-04-25T12:17:20.613 INFO:teuthology.orchestra.run.smithi134.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-25T12:17:20.621 INFO:teuthology.orchestra.run.smithi134.stdout:Get:56 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3156-gd69f13d8-1jammy [25.8 MB] 2024-04-25T12:17:20.624 INFO:teuthology.orchestra.run.smithi134.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-25T12:17:20.626 INFO:teuthology.orchestra.run.smithi134.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-25T12:17:20.628 INFO:teuthology.orchestra.run.smithi134.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-25T12:17:20.630 INFO:teuthology.orchestra.run.smithi134.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-25T12:17:20.663 INFO:teuthology.orchestra.run.smithi134.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-25T12:17:20.664 INFO:teuthology.orchestra.run.smithi134.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-25T12:17:20.666 INFO:teuthology.orchestra.run.smithi134.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-25T12:17:20.671 INFO:teuthology.orchestra.run.smithi134.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-25T12:17:20.745 INFO:teuthology.orchestra.run.smithi086.stdout:0 upgraded, 124 newly installed, 0 to remove and 302 not upgraded. 2024-04-25T12:17:20.745 INFO:teuthology.orchestra.run.smithi086.stdout:Need to get 182 MB of archives. 2024-04-25T12:17:20.745 INFO:teuthology.orchestra.run.smithi086.stdout:After this operation, 830 MB of additional disk space will be used. 2024-04-25T12:17:20.745 INFO:teuthology.orchestra.run.smithi086.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-25T12:17:20.767 INFO:teuthology.orchestra.run.smithi134.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-25T12:17:20.769 INFO:teuthology.orchestra.run.smithi134.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-25T12:17:20.770 INFO:teuthology.orchestra.run.smithi134.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-25T12:17:20.771 INFO:teuthology.orchestra.run.smithi134.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-25T12:17:20.772 INFO:teuthology.orchestra.run.smithi134.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-25T12:17:20.815 INFO:teuthology.orchestra.run.smithi134.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-25T12:17:20.818 INFO:teuthology.orchestra.run.smithi134.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-25T12:17:20.818 INFO:teuthology.orchestra.run.smithi134.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-25T12:17:20.827 INFO:teuthology.orchestra.run.smithi086.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-25T12:17:20.874 INFO:teuthology.orchestra.run.smithi086.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-25T12:17:20.911 INFO:teuthology.orchestra.run.smithi134.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-25T12:17:20.912 INFO:teuthology.orchestra.run.smithi134.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-25T12:17:20.913 INFO:teuthology.orchestra.run.smithi134.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-25T12:17:20.914 INFO:teuthology.orchestra.run.smithi134.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-25T12:17:20.915 INFO:teuthology.orchestra.run.smithi134.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-25T12:17:20.916 INFO:teuthology.orchestra.run.smithi134.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-25T12:17:20.917 INFO:teuthology.orchestra.run.smithi134.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-25T12:17:20.919 INFO:teuthology.orchestra.run.smithi134.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-25T12:17:20.926 INFO:teuthology.orchestra.run.smithi134.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-25T12:17:20.942 INFO:teuthology.orchestra.run.smithi134.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-25T12:17:20.961 INFO:teuthology.orchestra.run.smithi134.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-25T12:17:20.962 INFO:teuthology.orchestra.run.smithi134.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-25T12:17:20.970 INFO:teuthology.orchestra.run.smithi134.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-25T12:17:20.975 INFO:teuthology.orchestra.run.smithi134.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-25T12:17:20.976 INFO:teuthology.orchestra.run.smithi134.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-25T12:17:20.978 INFO:teuthology.orchestra.run.smithi134.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-25T12:17:20.979 INFO:teuthology.orchestra.run.smithi134.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-25T12:17:20.990 INFO:teuthology.orchestra.run.smithi134.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-25T12:17:20.990 INFO:teuthology.orchestra.run.smithi134.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-25T12:17:21.017 INFO:teuthology.orchestra.run.smithi134.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-25T12:17:21.017 INFO:teuthology.orchestra.run.smithi134.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-25T12:17:21.019 INFO:teuthology.orchestra.run.smithi134.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-25T12:17:21.019 INFO:teuthology.orchestra.run.smithi134.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-25T12:17:21.022 INFO:teuthology.orchestra.run.smithi134.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-25T12:17:21.024 INFO:teuthology.orchestra.run.smithi134.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-25T12:17:21.036 INFO:teuthology.orchestra.run.smithi134.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-25T12:17:21.053 INFO:teuthology.orchestra.run.smithi134.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-25T12:17:21.054 INFO:teuthology.orchestra.run.smithi134.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-25T12:17:21.058 INFO:teuthology.orchestra.run.smithi134.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-25T12:17:21.072 INFO:teuthology.orchestra.run.smithi086.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-25T12:17:21.081 INFO:teuthology.orchestra.run.smithi134.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-25T12:17:21.115 INFO:teuthology.orchestra.run.smithi086.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3156-gd69f13d8-1jammy [3,555 kB] 2024-04-25T12:17:21.175 INFO:teuthology.orchestra.run.smithi086.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-25T12:17:21.189 INFO:teuthology.orchestra.run.smithi086.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-25T12:17:21.243 INFO:teuthology.orchestra.run.smithi086.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-25T12:17:21.424 INFO:teuthology.orchestra.run.smithi086.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-25T12:17:21.433 INFO:teuthology.orchestra.run.smithi086.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-25T12:17:21.461 INFO:teuthology.orchestra.run.smithi086.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-25T12:17:21.470 INFO:teuthology.orchestra.run.smithi086.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-25T12:17:21.640 INFO:teuthology.orchestra.run.smithi086.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-25T12:17:21.647 INFO:teuthology.orchestra.run.smithi134.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3156-gd69f13d8-1jammy [5,094 kB] 2024-04-25T12:17:21.737 INFO:teuthology.orchestra.run.smithi134.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3156-gd69f13d8-1jammy [244 kB] 2024-04-25T12:17:21.743 INFO:teuthology.orchestra.run.smithi134.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3156-gd69f13d8-1jammy [124 kB] 2024-04-25T12:17:21.748 INFO:teuthology.orchestra.run.smithi134.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3156-gd69f13d8-1jammy [1,527 kB] 2024-04-25T12:17:21.833 INFO:teuthology.orchestra.run.smithi134.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3156-gd69f13d8-1jammy [6,260 kB] 2024-04-25T12:17:22.095 INFO:teuthology.orchestra.run.smithi086.stdout:Get:14 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3156-gd69f13d8-1jammy [3,224 kB] 2024-04-25T12:17:22.170 INFO:teuthology.orchestra.run.smithi134.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3156-gd69f13d8-1jammy [22.8 MB] 2024-04-25T12:17:22.233 INFO:teuthology.orchestra.run.smithi086.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-25T12:17:22.248 INFO:teuthology.orchestra.run.smithi086.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-25T12:17:22.263 INFO:teuthology.orchestra.run.smithi086.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-25T12:17:22.273 INFO:teuthology.orchestra.run.smithi086.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-25T12:17:22.273 INFO:teuthology.orchestra.run.smithi086.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-25T12:17:22.289 INFO:teuthology.orchestra.run.smithi086.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-25T12:17:22.330 INFO:teuthology.orchestra.run.smithi086.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-25T12:17:22.343 INFO:teuthology.orchestra.run.smithi086.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-25T12:17:22.347 INFO:teuthology.orchestra.run.smithi086.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-25T12:17:22.347 INFO:teuthology.orchestra.run.smithi086.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-25T12:17:22.523 INFO:teuthology.orchestra.run.smithi086.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-25T12:17:22.608 INFO:teuthology.orchestra.run.smithi086.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-25T12:17:22.624 INFO:teuthology.orchestra.run.smithi086.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-25T12:17:22.692 INFO:teuthology.orchestra.run.smithi086.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-25T12:17:22.721 INFO:teuthology.orchestra.run.smithi086.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-25T12:17:22.741 INFO:teuthology.orchestra.run.smithi086.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-25T12:17:22.766 INFO:teuthology.orchestra.run.smithi086.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-25T12:17:22.953 INFO:teuthology.orchestra.run.smithi086.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-25T12:17:22.970 INFO:teuthology.orchestra.run.smithi086.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-25T12:17:22.977 INFO:teuthology.orchestra.run.smithi086.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-25T12:17:22.981 INFO:teuthology.orchestra.run.smithi086.stdout:Get:35 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3156-gd69f13d8-1jammy [712 kB] 2024-04-25T12:17:22.983 INFO:teuthology.orchestra.run.smithi086.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-25T12:17:23.172 INFO:teuthology.orchestra.run.smithi086.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-25T12:17:23.173 INFO:teuthology.orchestra.run.smithi086.stdout:Get:38 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3156-gd69f13d8-1jammy [356 kB] 2024-04-25T12:17:23.257 INFO:teuthology.orchestra.run.smithi086.stdout:Get:39 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3156-gd69f13d8-1jammy [32.8 kB] 2024-04-25T12:17:23.257 INFO:teuthology.orchestra.run.smithi086.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-25T12:17:23.258 INFO:teuthology.orchestra.run.smithi086.stdout:Get:41 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3156-gd69f13d8-1jammy [180 kB] 2024-04-25T12:17:23.273 INFO:teuthology.orchestra.run.smithi086.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-25T12:17:23.327 INFO:teuthology.orchestra.run.smithi086.stdout:Get:43 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3156-gd69f13d8-1jammy [66.9 kB] 2024-04-25T12:17:23.332 INFO:teuthology.orchestra.run.smithi086.stdout:Get:44 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3156-gd69f13d8-1jammy [330 kB] 2024-04-25T12:17:23.366 INFO:teuthology.orchestra.run.smithi086.stdout:Get:45 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3156-gd69f13d8-1jammy [6,894 kB] 2024-04-25T12:17:23.461 INFO:teuthology.orchestra.run.smithi086.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-25T12:17:23.512 INFO:teuthology.orchestra.run.smithi086.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-25T12:17:23.526 INFO:teuthology.orchestra.run.smithi086.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-25T12:17:23.687 INFO:teuthology.orchestra.run.smithi086.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-25T12:17:23.688 INFO:teuthology.orchestra.run.smithi086.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-25T12:17:23.693 INFO:teuthology.orchestra.run.smithi086.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-25T12:17:23.697 INFO:teuthology.orchestra.run.smithi086.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-25T12:17:23.712 INFO:teuthology.orchestra.run.smithi086.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-25T12:17:23.900 INFO:teuthology.orchestra.run.smithi086.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-25T12:17:23.933 INFO:teuthology.orchestra.run.smithi134.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3156-gd69f13d8-1jammy [14.0 kB] 2024-04-25T12:17:23.934 INFO:teuthology.orchestra.run.smithi134.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3156-gd69f13d8-1jammy [870 kB] 2024-04-25T12:17:23.950 INFO:teuthology.orchestra.run.smithi134.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3156-gd69f13d8-1jammy [2,435 kB] 2024-04-25T12:17:24.158 INFO:teuthology.orchestra.run.smithi086.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-25T12:17:24.272 INFO:teuthology.orchestra.run.smithi086.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-25T12:17:24.304 INFO:teuthology.orchestra.run.smithi134.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3156-gd69f13d8-1jammy [791 kB] 2024-04-25T12:17:24.316 INFO:teuthology.orchestra.run.smithi086.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-25T12:17:24.400 INFO:teuthology.orchestra.run.smithi086.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-25T12:17:24.409 INFO:teuthology.orchestra.run.smithi134.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3156-gd69f13d8-1jammy [148 kB] 2024-04-25T12:17:24.413 INFO:teuthology.orchestra.run.smithi086.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-25T12:17:24.426 INFO:teuthology.orchestra.run.smithi086.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-25T12:17:24.454 INFO:teuthology.orchestra.run.smithi134.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3156-gd69f13d8-1jammy [2,324 kB] 2024-04-25T12:17:24.467 INFO:teuthology.orchestra.run.smithi086.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-25T12:17:24.727 INFO:teuthology.orchestra.run.smithi134.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3156-gd69f13d8-1jammy [8,625 kB] 2024-04-25T12:17:24.731 INFO:teuthology.orchestra.run.smithi086.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-25T12:17:24.733 INFO:teuthology.orchestra.run.smithi086.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-25T12:17:24.735 INFO:teuthology.orchestra.run.smithi086.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-25T12:17:24.901 INFO:teuthology.orchestra.run.smithi086.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-25T12:17:24.981 INFO:teuthology.orchestra.run.smithi086.stdout:Get:66 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3156-gd69f13d8-1jammy [112 kB] 2024-04-25T12:17:25.027 INFO:teuthology.orchestra.run.smithi086.stdout:Get:67 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3156-gd69f13d8-1jammy [466 kB] 2024-04-25T12:17:25.124 INFO:teuthology.orchestra.run.smithi086.stdout:Get:68 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3156-gd69f13d8-1jammy [25.8 MB] 2024-04-25T12:17:25.241 INFO:teuthology.orchestra.run.smithi086.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-25T12:17:25.673 INFO:teuthology.orchestra.run.smithi086.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-25T12:17:25.682 INFO:teuthology.orchestra.run.smithi086.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-25T12:17:25.684 INFO:teuthology.orchestra.run.smithi086.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-25T12:17:25.763 INFO:teuthology.orchestra.run.smithi086.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-25T12:17:25.764 INFO:teuthology.orchestra.run.smithi086.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-25T12:17:25.766 INFO:teuthology.orchestra.run.smithi086.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-25T12:17:25.767 INFO:teuthology.orchestra.run.smithi086.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-25T12:17:25.768 INFO:teuthology.orchestra.run.smithi086.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-25T12:17:25.875 INFO:teuthology.orchestra.run.smithi134.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3156-gd69f13d8-1jammy [14.2 kB] 2024-04-25T12:17:25.875 INFO:teuthology.orchestra.run.smithi134.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3156-gd69f13d8-1jammy [51.6 MB] 2024-04-25T12:17:25.936 INFO:teuthology.orchestra.run.smithi086.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-25T12:17:26.025 INFO:teuthology.orchestra.run.smithi086.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-25T12:17:26.123 INFO:teuthology.orchestra.run.smithi086.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-25T12:17:26.373 INFO:teuthology.orchestra.run.smithi086.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-25T12:17:26.416 INFO:teuthology.orchestra.run.smithi086.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-25T12:17:26.441 INFO:teuthology.orchestra.run.smithi086.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-25T12:17:26.450 INFO:teuthology.orchestra.run.smithi086.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-25T12:17:26.494 INFO:teuthology.orchestra.run.smithi086.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-25T12:17:26.520 INFO:teuthology.orchestra.run.smithi086.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-25T12:17:26.521 INFO:teuthology.orchestra.run.smithi086.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-25T12:17:26.528 INFO:teuthology.orchestra.run.smithi086.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-25T12:17:26.695 INFO:teuthology.orchestra.run.smithi086.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-25T12:17:27.235 INFO:teuthology.orchestra.run.smithi086.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-25T12:17:27.241 INFO:teuthology.orchestra.run.smithi086.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-25T12:17:27.282 INFO:teuthology.orchestra.run.smithi086.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-25T12:17:27.283 INFO:teuthology.orchestra.run.smithi086.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-25T12:17:27.290 INFO:teuthology.orchestra.run.smithi086.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-25T12:17:27.291 INFO:teuthology.orchestra.run.smithi086.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-25T12:17:27.331 INFO:teuthology.orchestra.run.smithi086.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-25T12:17:27.341 INFO:teuthology.orchestra.run.smithi086.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-25T12:17:27.415 INFO:teuthology.orchestra.run.smithi086.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-25T12:17:27.416 INFO:teuthology.orchestra.run.smithi086.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-25T12:17:27.584 INFO:teuthology.orchestra.run.smithi086.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-25T12:17:28.032 INFO:teuthology.orchestra.run.smithi086.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-25T12:17:28.048 INFO:teuthology.orchestra.run.smithi086.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-25T12:17:34.019 INFO:teuthology.orchestra.run.smithi086.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3156-gd69f13d8-1jammy [5,094 kB] 2024-04-25T12:17:34.625 INFO:teuthology.orchestra.run.smithi134.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3156-gd69f13d8-1jammy [124 kB] 2024-04-25T12:17:34.627 INFO:teuthology.orchestra.run.smithi134.stdout:Get:119 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-3156-gd69f13d8-1jammy [232 kB] 2024-04-25T12:17:34.632 INFO:teuthology.orchestra.run.smithi134.stdout:Get:120 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-3156-gd69f13d8-1jammy [33.9 kB] 2024-04-25T12:17:34.633 INFO:teuthology.orchestra.run.smithi134.stdout:Get:121 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-3156-gd69f13d8-1jammy [23.4 kB] 2024-04-25T12:17:34.634 INFO:teuthology.orchestra.run.smithi134.stdout:Get:122 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3156-gd69f13d8-1jammy [38.9 kB] 2024-04-25T12:17:34.635 INFO:teuthology.orchestra.run.smithi134.stdout:Get:123 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3156-gd69f13d8-1jammy [13.6 MB] 2024-04-25T12:17:36.498 INFO:teuthology.orchestra.run.smithi134.stdout:Get:124 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3156-gd69f13d8-1jammy [91.6 kB] 2024-04-25T12:17:37.115 INFO:teuthology.orchestra.run.smithi134.stdout:Fetched 182 MB in 17s (10.8 MB/s) 2024-04-25T12:17:37.250 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-25T12:17:37.347 INFO:teuthology.orchestra.run.smithi134.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-25T12:17:37.352 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-25T12:17:37.398 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-25T12:17:37.668 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-25T12:17:37.695 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-25T12:17:37.726 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T12:17:37.808 INFO:teuthology.orchestra.run.smithi086.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3156-gd69f13d8-1jammy [244 kB] 2024-04-25T12:17:37.941 INFO:teuthology.orchestra.run.smithi086.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3156-gd69f13d8-1jammy [124 kB] 2024-04-25T12:17:38.012 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-cmd2. 2024-04-25T12:17:38.013 INFO:teuthology.orchestra.run.smithi086.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3156-gd69f13d8-1jammy [1,527 kB] 2024-04-25T12:17:38.039 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-25T12:17:38.079 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-25T12:17:38.390 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-25T12:17:38.416 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-25T12:17:38.482 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T12:17:38.811 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-25T12:17:38.831 INFO:teuthology.orchestra.run.smithi086.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3156-gd69f13d8-1jammy [6,260 kB] 2024-04-25T12:17:38.837 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-25T12:17:38.877 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T12:17:39.205 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-25T12:17:39.231 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-25T12:17:39.271 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T12:17:39.650 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-25T12:17:39.677 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T12:17:39.716 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T12:17:40.103 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-25T12:17:40.130 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T12:17:40.170 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T12:17:40.498 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-25T12:17:40.525 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T12:17:40.564 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T12:17:40.892 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-25T12:17:40.919 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-25T12:17:40.959 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T12:17:41.098 INFO:teuthology.orchestra.run.smithi086.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3156-gd69f13d8-1jammy [22.8 MB] 2024-04-25T12:17:41.253 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package librados2. 2024-04-25T12:17:41.280 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../010-librados2_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:17:41.320 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking librados2 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:17:41.814 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package librbd1. 2024-04-25T12:17:41.841 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../011-librbd1_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:17:41.881 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking librbd1 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:17:42.484 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libcephfs2. 2024-04-25T12:17:42.510 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:17:42.550 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libcephfs2 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:17:42.822 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-rados. 2024-04-25T12:17:42.846 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../013-python3-rados_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:17:42.878 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-rados (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:17:43.180 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-25T12:17:43.206 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-25T12:17:43.247 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-ceph-argparse (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:17:43.499 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-cephfs. 2024-04-25T12:17:43.525 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:17:43.566 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-cephfs (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:17:43.902 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-25T12:17:43.928 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-25T12:17:43.969 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-ceph-common (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:17:44.263 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-prettytable. 2024-04-25T12:17:44.278 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-25T12:17:44.313 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-25T12:17:44.540 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-rbd. 2024-04-25T12:17:44.556 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:17:44.599 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-rbd (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:17:44.944 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-25T12:17:44.970 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-25T12:17:45.010 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T12:17:45.288 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-25T12:17:45.303 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-25T12:17:45.363 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T12:17:45.657 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-25T12:17:45.672 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-25T12:17:45.707 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T12:17:46.004 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package lua5.1. 2024-04-25T12:17:46.030 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-25T12:17:46.070 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-25T12:17:46.365 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package lua-any. 2024-04-25T12:17:46.380 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-25T12:17:46.415 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-25T12:17:46.626 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package zip. 2024-04-25T12:17:46.652 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-25T12:17:46.684 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking zip (3.0-12build2) ... 2024-04-25T12:17:46.987 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package unzip. 2024-04-25T12:17:47.014 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-25T12:17:47.054 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-25T12:17:47.441 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package luarocks. 2024-04-25T12:17:47.467 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-25T12:17:47.499 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-25T12:17:47.865 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package librgw2. 2024-04-25T12:17:47.892 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../027-librgw2_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:17:47.932 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking librgw2 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:17:48.471 INFO:teuthology.orchestra.run.smithi086.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3156-gd69f13d8-1jammy [14.0 kB] 2024-04-25T12:17:48.472 INFO:teuthology.orchestra.run.smithi086.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3156-gd69f13d8-1jammy [870 kB] 2024-04-25T12:17:48.509 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-rgw. 2024-04-25T12:17:48.524 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:17:48.567 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-rgw (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:17:48.641 INFO:teuthology.orchestra.run.smithi086.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3156-gd69f13d8-1jammy [2,435 kB] 2024-04-25T12:17:48.903 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-25T12:17:48.930 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-25T12:17:48.978 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T12:17:49.248 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libradosstriper1. 2024-04-25T12:17:49.274 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:17:49.310 INFO:teuthology.orchestra.run.smithi086.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3156-gd69f13d8-1jammy [791 kB] 2024-04-25T12:17:49.314 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libradosstriper1 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:17:49.473 INFO:teuthology.orchestra.run.smithi086.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3156-gd69f13d8-1jammy [148 kB] 2024-04-25T12:17:49.512 INFO:teuthology.orchestra.run.smithi086.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3156-gd69f13d8-1jammy [2,324 kB] 2024-04-25T12:17:49.734 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-common. 2024-04-25T12:17:49.761 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../031-ceph-common_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:17:49.800 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-common (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:17:50.053 INFO:teuthology.orchestra.run.smithi086.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3156-gd69f13d8-1jammy [8,625 kB] 2024-04-25T12:17:51.148 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-base. 2024-04-25T12:17:51.174 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../032-ceph-base_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:17:51.223 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-base (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:17:51.760 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-25T12:17:51.775 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-25T12:17:51.807 INFO:teuthology.orchestra.run.smithi086.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3156-gd69f13d8-1jammy [14.2 kB] 2024-04-25T12:17:51.808 INFO:teuthology.orchestra.run.smithi086.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3156-gd69f13d8-1jammy [51.6 MB] 2024-04-25T12:17:51.810 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-25T12:17:52.096 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-cheroot. 2024-04-25T12:17:52.123 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-25T12:17:52.163 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T12:17:52.670 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-25T12:17:52.697 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-25T12:17:52.782 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-25T12:17:53.068 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-25T12:17:53.095 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-25T12:17:53.135 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-25T12:17:54.080 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-25T12:17:54.107 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-25T12:17:54.138 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-25T12:17:54.424 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-tempora. 2024-04-25T12:17:54.451 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-25T12:17:54.490 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-25T12:17:54.793 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-portend. 2024-04-25T12:17:54.820 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-25T12:17:54.860 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-25T12:17:55.121 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-25T12:17:55.136 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-25T12:17:55.171 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-25T12:17:55.407 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-25T12:17:55.422 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-25T12:17:55.465 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-25T12:17:55.768 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-natsort. 2024-04-25T12:17:55.792 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-25T12:17:55.827 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-25T12:17:56.163 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-logutils. 2024-04-25T12:17:56.190 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-25T12:17:56.230 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-25T12:17:56.541 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-25T12:17:56.568 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-25T12:17:56.607 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-25T12:17:56.910 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-mako. 2024-04-25T12:17:56.937 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-25T12:17:56.977 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T12:17:57.305 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-25T12:17:57.332 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-25T12:17:57.372 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-25T12:17:57.674 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-25T12:17:57.701 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-25T12:17:57.741 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-25T12:17:58.061 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-webob. 2024-04-25T12:17:58.087 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-25T12:17:58.127 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-25T12:17:58.455 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-waitress. 2024-04-25T12:17:58.482 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-25T12:17:58.517 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T12:17:58.553 INFO:teuthology.orchestra.run.smithi086.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3156-gd69f13d8-1jammy [124 kB] 2024-04-25T12:17:58.555 INFO:teuthology.orchestra.run.smithi086.stdout:Get:119 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-3156-gd69f13d8-1jammy [232 kB] 2024-04-25T12:17:58.560 INFO:teuthology.orchestra.run.smithi086.stdout:Get:120 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-3156-gd69f13d8-1jammy [33.9 kB] 2024-04-25T12:17:58.560 INFO:teuthology.orchestra.run.smithi086.stdout:Get:121 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-3156-gd69f13d8-1jammy [23.4 kB] 2024-04-25T12:17:58.561 INFO:teuthology.orchestra.run.smithi086.stdout:Get:122 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3156-gd69f13d8-1jammy [38.9 kB] 2024-04-25T12:17:58.562 INFO:teuthology.orchestra.run.smithi086.stdout:Get:123 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3156-gd69f13d8-1jammy [13.6 MB] 2024-04-25T12:17:58.758 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-tempita. 2024-04-25T12:17:58.773 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-25T12:17:58.816 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T12:17:59.119 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-paste. 2024-04-25T12:17:59.145 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-25T12:17:59.185 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T12:17:59.277 INFO:teuthology.orchestra.run.smithi086.stdout:Get:124 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3156-gd69f13d8-1jammy [91.6 kB] 2024-04-25T12:17:59.480 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-25T12:17:59.496 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-25T12:17:59.530 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T12:17:59.850 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-25T12:17:59.876 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-25T12:17:59.895 INFO:teuthology.orchestra.run.smithi086.stdout:Fetched 182 MB in 39s (4,690 kB/s) 2024-04-25T12:17:59.916 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-25T12:18:00.016 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-25T12:18:00.103 INFO:teuthology.orchestra.run.smithi086.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-25T12:18:00.108 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-25T12:18:00.148 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-25T12:18:00.219 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-webtest. 2024-04-25T12:18:00.246 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-25T12:18:00.285 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-25T12:18:00.392 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-25T12:18:00.418 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-25T12:18:00.450 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T12:18:00.622 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pecan. 2024-04-25T12:18:00.648 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-25T12:18:00.688 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T12:18:00.745 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-cmd2. 2024-04-25T12:18:00.771 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-25T12:18:00.811 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-25T12:18:01.026 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-certifi. 2024-04-25T12:18:01.042 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-25T12:18:01.076 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-25T12:18:01.164 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-25T12:18:01.190 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-25T12:18:01.273 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T12:18:01.354 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-idna. 2024-04-25T12:18:01.381 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-25T12:18:01.421 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-25T12:18:01.601 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-25T12:18:01.627 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-25T12:18:01.668 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T12:18:01.732 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-urllib3. 2024-04-25T12:18:01.758 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-25T12:18:01.798 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T12:18:01.954 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-25T12:18:01.980 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-25T12:18:02.020 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T12:18:02.118 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-requests. 2024-04-25T12:18:02.145 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-25T12:18:02.184 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T12:18:02.449 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-25T12:18:02.475 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T12:18:02.496 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-25T12:18:02.522 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-25T12:18:02.523 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T12:18:02.571 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T12:18:02.857 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-25T12:18:02.873 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-25T12:18:02.915 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:02.935 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-25T12:18:02.961 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T12:18:03.002 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T12:18:03.355 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-25T12:18:03.381 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T12:18:03.422 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T12:18:03.453 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-25T12:18:03.480 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:03.520 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:03.742 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-25T12:18:03.768 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-25T12:18:03.806 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-25T12:18:03.808 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T12:18:03.824 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-25T12:18:03.864 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-25T12:18:04.128 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package librados2. 2024-04-25T12:18:04.154 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../010-librados2_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:04.167 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-openssl. 2024-04-25T12:18:04.194 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-25T12:18:04.194 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking librados2 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:04.233 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-25T12:18:04.528 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mgr. 2024-04-25T12:18:04.555 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:04.586 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mgr (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:04.647 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package librbd1. 2024-04-25T12:18:04.673 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../011-librbd1_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:04.847 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking librbd1 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:04.948 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mon. 2024-04-25T12:18:04.974 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:05.014 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mon (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:05.241 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libcephfs2. 2024-04-25T12:18:05.257 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:05.291 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libcephfs2 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:05.544 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-rados. 2024-04-25T12:18:05.570 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../013-python3-rados_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:05.610 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-rados (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:05.618 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-osd. 2024-04-25T12:18:05.644 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:05.684 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-osd (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:05.846 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-25T12:18:05.873 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-25T12:18:05.913 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-ceph-argparse (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:06.166 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-cephfs. 2024-04-25T12:18:06.181 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:06.224 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-cephfs (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:06.535 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-25T12:18:06.561 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-25T12:18:06.601 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-ceph-common (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:06.679 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph. 2024-04-25T12:18:06.694 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../068-ceph_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:06.729 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:06.896 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-prettytable. 2024-04-25T12:18:06.923 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-25T12:18:06.962 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-25T12:18:07.040 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-fuse. 2024-04-25T12:18:07.066 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:07.106 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-fuse (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:07.209 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-rbd. 2024-04-25T12:18:07.224 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:07.267 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-rbd (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:07.476 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mds. 2024-04-25T12:18:07.503 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:07.543 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mds (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:07.645 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-25T12:18:07.671 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-25T12:18:07.711 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T12:18:07.929 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package cephadm. 2024-04-25T12:18:07.956 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../071-cephadm_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:07.980 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-25T12:18:07.995 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking cephadm (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:07.996 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-25T12:18:08.039 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T12:18:08.248 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-25T12:18:08.264 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-25T12:18:08.298 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-25T12:18:08.350 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-25T12:18:08.377 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-25T12:18:08.416 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T12:18:08.625 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-25T12:18:08.641 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T12:18:08.675 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T12:18:08.703 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package lua5.1. 2024-04-25T12:18:08.729 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-25T12:18:08.769 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-25T12:18:09.047 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package lua-any. 2024-04-25T12:18:09.070 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-25T12:18:09.113 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-25T12:18:09.375 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package zip. 2024-04-25T12:18:09.398 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-25T12:18:09.441 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking zip (3.0-12build2) ... 2024-04-25T12:18:09.647 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-babel. 2024-04-25T12:18:09.663 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T12:18:09.697 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T12:18:09.753 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package unzip. 2024-04-25T12:18:09.779 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-25T12:18:09.819 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-25T12:18:09.992 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-jinja2. 2024-04-25T12:18:10.018 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-25T12:18:10.058 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T12:18:10.206 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package luarocks. 2024-04-25T12:18:10.232 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-25T12:18:10.272 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-25T12:18:10.369 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-25T12:18:10.396 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-25T12:18:10.460 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:10.596 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package librgw2. 2024-04-25T12:18:10.612 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../027-librgw2_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:10.646 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking librgw2 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:10.781 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-25T12:18:10.808 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-25T12:18:10.847 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-25T12:18:11.150 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-routes. 2024-04-25T12:18:11.173 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-rgw. 2024-04-25T12:18:11.176 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-25T12:18:11.189 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:11.216 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T12:18:11.232 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-rgw (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:11.561 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-25T12:18:11.568 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-25T12:18:11.588 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-25T12:18:11.594 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-25T12:18:11.627 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:11.634 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T12:18:11.946 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libradosstriper1. 2024-04-25T12:18:11.972 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:12.012 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libradosstriper1 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:12.432 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-common. 2024-04-25T12:18:12.459 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../031-ceph-common_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:12.498 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-common (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:12.807 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-25T12:18:12.824 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-25T12:18:12.858 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T12:18:13.336 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-joblib. 2024-04-25T12:18:13.363 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-25T12:18:13.402 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T12:18:13.820 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-base. 2024-04-25T12:18:13.846 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../032-ceph-base_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:13.887 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-base (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:13.923 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-25T12:18:13.950 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-25T12:18:14.099 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-25T12:18:14.402 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-sklearn. 2024-04-25T12:18:14.430 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-25T12:18:14.457 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-25T12:18:14.468 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T12:18:14.484 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-25T12:18:14.524 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-25T12:18:15.152 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-cheroot. 2024-04-25T12:18:15.178 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-25T12:18:15.226 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T12:18:15.336 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-25T12:18:15.364 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-25T12:18:15.402 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:15.529 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-25T12:18:15.556 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-25T12:18:15.596 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-25T12:18:15.882 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-25T12:18:15.909 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-25T12:18:15.948 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-25T12:18:16.251 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-25T12:18:16.278 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-25T12:18:16.318 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-25T12:18:16.339 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-cachetools. 2024-04-25T12:18:16.366 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-25T12:18:16.406 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-25T12:18:16.579 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-tempora. 2024-04-25T12:18:16.605 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-25T12:18:16.637 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-25T12:18:16.658 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-25T12:18:16.674 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-25T12:18:16.708 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-25T12:18:16.940 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-portend. 2024-04-25T12:18:16.966 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-25T12:18:17.003 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-25T12:18:17.006 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-25T12:18:17.030 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-25T12:18:17.069 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T12:18:17.309 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-25T12:18:17.335 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-25T12:18:17.373 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-rsa. 2024-04-25T12:18:17.375 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-25T12:18:17.400 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-25T12:18:17.439 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-25T12:18:17.670 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-25T12:18:17.697 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-25T12:18:17.736 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-25T12:18:17.784 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-google-auth. 2024-04-25T12:18:17.812 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-25T12:18:17.851 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-25T12:18:18.090 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-natsort. 2024-04-25T12:18:18.116 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-25T12:18:18.154 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-25T12:18:18.156 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-25T12:18:18.181 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-25T12:18:18.220 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T12:18:18.476 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-logutils. 2024-04-25T12:18:18.503 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-25T12:18:18.532 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-websocket. 2024-04-25T12:18:18.542 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-25T12:18:18.559 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-25T12:18:18.598 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-25T12:18:18.820 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-25T12:18:18.835 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-25T12:18:18.868 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-25T12:18:18.870 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-25T12:18:18.896 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-25T12:18:18.926 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T12:18:19.156 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-mako. 2024-04-25T12:18:19.182 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-25T12:18:19.222 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T12:18:19.542 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-25T12:18:19.557 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-25T12:18:19.565 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-25T12:18:19.573 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-25T12:18:19.615 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:19.625 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-25T12:18:19.928 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-25T12:18:19.943 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-25T12:18:19.954 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-25T12:18:19.970 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-25T12:18:19.995 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-25T12:18:20.009 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T12:18:20.287 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-25T12:18:20.289 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-webob. 2024-04-25T12:18:20.303 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T12:18:20.315 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-25T12:18:20.337 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T12:18:20.355 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-25T12:18:20.582 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package jq. 2024-04-25T12:18:20.609 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T12:18:20.648 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-25T12:18:20.675 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-waitress. 2024-04-25T12:18:20.701 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-25T12:18:20.753 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T12:18:20.900 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package socat. 2024-04-25T12:18:20.916 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-25T12:18:20.959 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-25T12:18:21.019 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-tempita. 2024-04-25T12:18:21.046 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-25T12:18:21.086 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T12:18:21.295 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package xmlstarlet. 2024-04-25T12:18:21.323 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-25T12:18:21.362 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-25T12:18:21.372 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-paste. 2024-04-25T12:18:21.398 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-25T12:18:21.438 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T12:18:21.708 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-test. 2024-04-25T12:18:21.724 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../099-ceph-test_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:21.733 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-25T12:18:21.748 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-25T12:18:21.766 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-test (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:21.783 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T12:18:22.086 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-25T12:18:22.112 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-25T12:18:22.152 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-25T12:18:22.438 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-webtest. 2024-04-25T12:18:22.465 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-25T12:18:22.505 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-25T12:18:22.816 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-pecan. 2024-04-25T12:18:22.842 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-25T12:18:22.899 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T12:18:23.254 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-certifi. 2024-04-25T12:18:23.281 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-25T12:18:23.320 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-25T12:18:23.606 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-idna. 2024-04-25T12:18:23.622 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-25T12:18:23.656 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-25T12:18:23.959 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-urllib3. 2024-04-25T12:18:23.985 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-25T12:18:24.025 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T12:18:24.295 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-volume. 2024-04-25T12:18:24.323 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-25T12:18:24.328 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-requests. 2024-04-25T12:18:24.344 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-25T12:18:24.361 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-volume (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:24.378 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T12:18:24.665 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-25T12:18:24.691 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-25T12:18:24.722 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T12:18:24.734 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-25T12:18:24.762 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:24.817 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking cephfs-mirror (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:24.975 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-25T12:18:24.991 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-25T12:18:25.033 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:25.104 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-colorama. 2024-04-25T12:18:25.131 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-25T12:18:25.170 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-25T12:18:25.389 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package cephfs-shell. 2024-04-25T12:18:25.405 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-25T12:18:25.438 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-25T12:18:25.447 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking cephfs-shell (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:25.465 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:25.505 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:25.709 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package cephfs-top. 2024-04-25T12:18:25.737 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-25T12:18:25.775 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking cephfs-top (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:25.816 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-25T12:18:25.842 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-25T12:18:25.882 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-25T12:18:26.028 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-25T12:18:26.056 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:26.094 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libcephfs-dev (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:26.168 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-openssl. 2024-04-25T12:18:26.195 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-25T12:18:26.235 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-25T12:18:26.406 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-25T12:18:26.433 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-25T12:18:26.472 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T12:18:26.546 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-mgr. 2024-04-25T12:18:26.573 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:26.612 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-mgr (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:26.760 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-25T12:18:26.776 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-25T12:18:26.810 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-25T12:18:27.016 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-mon. 2024-04-25T12:18:27.042 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:27.082 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-mon (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:27.197 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package nvme-cli. 2024-04-25T12:18:27.225 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-25T12:18:27.263 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T12:18:27.686 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package pkg-config. 2024-04-25T12:18:27.702 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-osd. 2024-04-25T12:18:27.713 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-25T12:18:27.729 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:27.760 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T12:18:27.769 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-osd (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:28.013 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-25T12:18:28.029 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-25T12:18:28.063 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-25T12:18:28.492 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-25T12:18:28.519 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-25T12:18:28.550 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-25T12:18:28.813 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph. 2024-04-25T12:18:28.828 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pastescript. 2024-04-25T12:18:28.829 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../068-ceph_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:28.855 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-25T12:18:28.871 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:28.894 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-25T12:18:29.190 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-fuse. 2024-04-25T12:18:29.214 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pluggy. 2024-04-25T12:18:29.217 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:29.242 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-25T12:18:29.257 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-fuse (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:29.280 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-25T12:18:29.552 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-mds. 2024-04-25T12:18:29.578 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:29.600 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-psutil. 2024-04-25T12:18:29.618 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-mds (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:29.628 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-25T12:18:29.667 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-25T12:18:29.995 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-py. 2024-04-25T12:18:30.004 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package cephadm. 2024-04-25T12:18:30.021 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-25T12:18:30.031 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../071-cephadm_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:30.061 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-25T12:18:30.070 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking cephadm (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:30.407 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pygments. 2024-04-25T12:18:30.435 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-25T12:18:30.473 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T12:18:30.507 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-25T12:18:30.533 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-25T12:18:30.581 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-25T12:18:30.884 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-25T12:18:30.911 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T12:18:30.935 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-25T12:18:30.950 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T12:18:30.963 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-25T12:18:31.001 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-25T12:18:31.288 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-toml. 2024-04-25T12:18:31.316 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-25T12:18:31.346 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-25T12:18:31.641 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pytest. 2024-04-25T12:18:31.668 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-25T12:18:31.707 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T12:18:31.905 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-babel. 2024-04-25T12:18:31.933 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T12:18:31.971 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T12:18:32.019 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-simplejson. 2024-04-25T12:18:32.035 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-25T12:18:32.068 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-25T12:18:32.266 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-jinja2. 2024-04-25T12:18:32.292 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-25T12:18:32.296 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-25T12:18:32.312 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-25T12:18:32.332 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T12:18:32.346 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-25T12:18:32.678 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-25T12:18:32.704 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-25T12:18:32.743 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:33.055 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-25T12:18:33.082 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-25T12:18:33.092 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package radosgw. 2024-04-25T12:18:33.120 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../122-radosgw_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:33.121 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-25T12:18:33.150 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking radosgw (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:33.424 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-routes. 2024-04-25T12:18:33.453 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-25T12:18:33.490 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T12:18:33.828 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-25T12:18:33.855 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-25T12:18:33.893 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:33.945 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package rbd-fuse. 2024-04-25T12:18:33.973 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:34.011 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking rbd-fuse (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:34.308 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-25T12:18:34.558 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T12:18:34.668 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T12:18:34.928 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-25T12:18:35.148 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-25T12:18:35.164 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-25T12:18:35.206 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T12:18:35.236 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-25T12:18:35.663 INFO:teuthology.orchestra.run.smithi134.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-25T12:18:35.761 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up cephadm (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:35.834 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-joblib. 2024-04-25T12:18:35.862 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-25T12:18:35.893 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T12:18:36.254 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-25T12:18:36.281 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-25T12:18:36.304 INFO:teuthology.orchestra.run.smithi134.stdout:Adding system user cephadm....done 2024-04-25T12:18:36.398 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-25T12:18:36.502 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T12:18:36.709 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-sklearn. 2024-04-25T12:18:36.736 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-25T12:18:36.767 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T12:18:36.929 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-25T12:18:37.180 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-25T12:18:37.306 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-25T12:18:37.460 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-25T12:18:37.487 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-25T12:18:37.525 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:37.550 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-25T12:18:37.792 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T12:18:37.918 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-25T12:18:38.245 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T12:18:38.487 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-cachetools. 2024-04-25T12:18:38.514 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-25T12:18:38.553 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-25T12:18:38.606 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-25T12:18:38.814 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-25T12:18:38.841 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-25T12:18:38.856 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-25T12:18:38.881 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-25T12:18:39.108 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-25T12:18:39.176 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-25T12:18:39.202 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-25T12:18:39.233 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T12:18:39.375 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-25T12:18:39.478 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-rsa. 2024-04-25T12:18:39.494 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-25T12:18:39.536 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-25T12:18:39.857 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-google-auth. 2024-04-25T12:18:39.868 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-25T12:18:39.884 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-25T12:18:39.923 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-25T12:18:40.203 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-25T12:18:40.243 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-25T12:18:40.270 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-25T12:18:40.309 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T12:18:40.546 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-25T12:18:40.621 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-websocket. 2024-04-25T12:18:40.648 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-25T12:18:40.687 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-25T12:18:40.805 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-ceph-argparse (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:40.982 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-25T12:18:41.009 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-25T12:18:41.040 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T12:18:41.073 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T12:18:41.182 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T12:18:41.291 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-25T12:18:41.526 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T12:18:41.652 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-25T12:18:41.712 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-25T12:18:41.740 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-25T12:18:41.778 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:41.911 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-25T12:18:42.031 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-25T12:18:42.058 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-25T12:18:42.097 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T12:18:42.289 INFO:teuthology.orchestra.run.smithi134.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-25T12:18:42.325 INFO:teuthology.orchestra.run.smithi134.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-25T12:18:42.390 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T12:18:42.409 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-25T12:18:42.436 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T12:18:42.475 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T12:18:42.508 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-25T12:18:42.745 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package jq. 2024-04-25T12:18:42.772 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T12:18:42.811 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-25T12:18:42.850 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T12:18:42.977 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-25T12:18:43.063 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package socat. 2024-04-25T12:18:43.079 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-25T12:18:43.121 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-25T12:18:43.244 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T12:18:43.408 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package xmlstarlet. 2024-04-25T12:18:43.435 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-25T12:18:43.466 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-25T12:18:43.512 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-25T12:18:43.813 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up zip (3.0-12build2) ... 2024-04-25T12:18:43.837 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-test. 2024-04-25T12:18:43.853 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../099-ceph-test_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:43.895 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-test (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:43.939 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T12:18:44.633 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T12:18:44.917 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T12:18:45.043 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-25T12:18:45.170 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T12:18:45.470 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-25T12:18:45.863 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-25T12:18:46.091 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-volume. 2024-04-25T12:18:46.118 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-25T12:18:46.123 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T12:18:46.157 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-volume (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:46.491 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T12:18:46.538 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-25T12:18:46.566 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:46.604 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking cephfs-mirror (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:46.784 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-25T12:18:46.916 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-colorama. 2024-04-25T12:18:46.943 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-25T12:18:46.982 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-25T12:18:47.085 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T12:18:47.218 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package cephfs-shell. 2024-04-25T12:18:47.245 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-25T12:18:47.276 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking cephfs-shell (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:47.445 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-25T12:18:47.528 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package cephfs-top. 2024-04-25T12:18:47.545 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-25T12:18:47.587 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking cephfs-top (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:47.696 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-25T12:18:47.822 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-ceph-common (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:47.831 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-25T12:18:47.847 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:47.889 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libcephfs-dev (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:48.132 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-idna (3.3-1) ... 2024-04-25T12:18:48.200 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-25T12:18:48.227 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-25T12:18:48.258 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T12:18:48.441 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T12:18:48.571 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-25T12:18:48.598 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-25T12:18:48.645 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-25T12:18:49.008 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package nvme-cli. 2024-04-25T12:18:49.035 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-25T12:18:49.074 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T12:18:49.471 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package pkg-config. 2024-04-25T12:18:49.498 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-25T12:18:49.537 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T12:18:49.647 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T12:18:49.798 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-25T12:18:49.826 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-25T12:18:49.864 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-25T12:18:49.899 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T12:18:50.008 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-25T12:18:50.226 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-25T12:18:50.242 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-25T12:18:50.276 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T12:18:50.284 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-25T12:18:50.402 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-25T12:18:50.528 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T12:18:50.561 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-pastescript. 2024-04-25T12:18:50.589 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-25T12:18:50.628 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-25T12:18:50.829 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-25T12:18:50.931 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-pluggy. 2024-04-25T12:18:50.958 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-25T12:18:50.997 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-25T12:18:51.105 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-25T12:18:51.292 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-psutil. 2024-04-25T12:18:51.319 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-25T12:18:51.340 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T12:18:51.358 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-25T12:18:51.449 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-25T12:18:51.653 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-py. 2024-04-25T12:18:51.680 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-25T12:18:51.719 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-25T12:18:51.742 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-25T12:18:52.002 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-25T12:18:52.023 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-pygments. 2024-04-25T12:18:52.050 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-25T12:18:52.081 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T12:18:52.261 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-25T12:18:52.521 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-25T12:18:52.559 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-25T12:18:52.587 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-25T12:18:52.626 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-25T12:18:52.780 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-25T12:18:52.878 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-toml. 2024-04-25T12:18:52.906 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-25T12:18:52.936 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-25T12:18:53.056 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T12:18:53.166 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-25T12:18:53.239 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-pytest. 2024-04-25T12:18:53.267 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-25T12:18:53.306 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T12:18:53.476 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T12:18:53.601 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T12:18:53.651 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-simplejson. 2024-04-25T12:18:53.678 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-25T12:18:53.708 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-25T12:18:53.886 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-25T12:18:53.953 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-25T12:18:53.969 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-25T12:18:54.002 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-25T12:18:54.187 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-25T12:18:54.438 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T12:18:54.564 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-25T12:18:54.673 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package radosgw. 2024-04-25T12:18:54.681 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T12:18:54.701 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../122-radosgw_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:54.739 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking radosgw (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:54.761 INFO:teuthology.orchestra.run.smithi134.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-25T12:18:55.001 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T12:18:55.126 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T12:18:55.501 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package rbd-fuse. 2024-04-25T12:18:55.517 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:55.528 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-25T12:18:55.559 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking rbd-fuse (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:55.787 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-25T12:18:55.854 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-25T12:18:55.913 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-25T12:18:56.105 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T12:18:56.181 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T12:18:56.231 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T12:18:56.290 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T12:18:56.491 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-25T12:18:56.592 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T12:18:56.826 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-25T12:18:56.893 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T12:18:57.169 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-25T12:18:57.251 INFO:teuthology.orchestra.run.smithi086.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-25T12:18:57.325 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up cephadm (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:57.380 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-25T12:18:57.657 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-25T12:18:57.807 INFO:teuthology.orchestra.run.smithi086.stdout:Adding system user cephadm....done 2024-04-25T12:18:57.908 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T12:18:58.059 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T12:18:58.168 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-25T12:18:58.428 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-25T12:18:58.544 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-25T12:18:58.784 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-25T12:18:58.838 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T12:18:59.002 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-25T12:18:59.173 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T12:18:59.291 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up librados2 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:59.319 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-25T12:18:59.417 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:59.543 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-25T12:18:59.570 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T12:18:59.705 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-25T12:18:59.880 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libcephfs2 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:59.990 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T12:19:00.005 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libradosstriper1 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:00.132 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-25T12:19:00.367 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-25T12:19:00.392 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up librbd1 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:00.518 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mgr-modules-core (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:00.609 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-25T12:19:00.669 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-fuse (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:00.860 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-25T12:19:00.885 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T12:19:00.885 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T12:19:01.112 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-25T12:19:01.397 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-25T12:19:01.403 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libcephfs-dev (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:01.529 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-rados (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:01.648 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-25T12:19:01.655 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up librgw2 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:01.756 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up cephfs-top (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:01.858 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T12:19:01.899 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-25T12:19:02.158 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-ceph-argparse (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:02.426 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T12:19:02.551 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T12:19:02.677 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-25T12:19:02.937 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T12:19:03.063 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-25T12:19:03.070 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-rbd (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:03.196 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up rbd-fuse (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:03.314 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-25T12:19:03.321 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-rgw (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:03.448 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-cephfs (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:03.565 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up cephfs-shell (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:03.666 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-common (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:03.674 INFO:teuthology.orchestra.run.smithi086.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-25T12:19:03.703 INFO:teuthology.orchestra.run.smithi086.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-25T12:19:03.767 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T12:19:03.893 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-25T12:19:04.167 INFO:teuthology.orchestra.run.smithi134.stdout:Adding group ceph....done 2024-04-25T12:19:04.244 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T12:19:04.370 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-25T12:19:04.536 INFO:teuthology.orchestra.run.smithi134.stdout:Adding system user ceph....done 2024-04-25T12:19:04.637 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T12:19:04.696 INFO:teuthology.orchestra.run.smithi134.stdout:Setting system user ceph properties....done 2024-04-25T12:19:04.708 INFO:teuthology.orchestra.run.smithi134.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-25T12:19:04.842 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-25T12:19:04.905 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-25T12:19:05.161 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-25T12:19:05.190 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up zip (3.0-12build2) ... 2024-04-25T12:19:05.332 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T12:19:05.626 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up cephfs-mirror (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:05.834 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-25T12:19:05.834 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-25T12:19:05.967 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T12:19:06.218 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T12:19:06.277 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-test (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:06.319 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-25T12:19:06.403 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up radosgw (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:06.753 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T12:19:06.855 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T12:19:06.855 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T12:19:07.138 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-25T12:19:07.305 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-base (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:07.506 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-25T12:19:07.652 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-25T12:19:07.732 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T12:19:08.108 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T12:19:08.116 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mds (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:08.340 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T12:19:08.340 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T12:19:08.401 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-25T12:19:08.686 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T12:19:08.834 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mgr (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:09.028 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-25T12:19:09.055 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T12:19:09.055 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T12:19:09.279 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-25T12:19:09.397 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-ceph-common (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:09.552 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-osd (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:09.690 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-idna (3.3-1) ... 2024-04-25T12:19:09.830 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T12:19:09.830 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T12:19:10.024 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T12:19:10.401 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:10.756 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:10.898 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mon (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:11.112 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T12:19:11.112 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T12:19:11.272 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T12:19:11.523 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T12:19:11.575 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mgr-cephadm (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:11.657 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-25T12:19:11.726 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:11.878 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mgr-dashboard (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:11.916 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T12:19:12.017 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-25T12:19:12.028 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-volume (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:12.118 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T12:19:12.395 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-25T12:19:12.411 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-25T12:19:12.578 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T12:19:12.646 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-25T12:19:12.839 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T12:19:12.897 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T12:19:12.998 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-25T12:19:13.291 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-25T12:19:13.542 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-25T12:19:13.784 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-25T12:19:13.946 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T12:19:14.027 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-25T12:19:14.270 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-25T12:19:14.537 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T12:19:14.582 INFO:teuthology.orchestra.run.smithi134.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T12:19:14.586 DEBUG:teuthology.orchestra.run.smithi134:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-25T12:19:14.672 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-25T12:19:14.679 INFO:teuthology.orchestra.run.smithi134.stdout:Reading package lists... 2024-04-25T12:19:14.879 INFO:teuthology.orchestra.run.smithi134.stdout:Building dependency tree... 2024-04-25T12:19:14.880 INFO:teuthology.orchestra.run.smithi134.stdout:Reading state information... 2024-04-25T12:19:14.939 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T12:19:15.066 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T12:19:15.073 INFO:teuthology.orchestra.run.smithi134.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-25T12:19:15.073 INFO:teuthology.orchestra.run.smithi134.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-25T12:19:15.073 INFO:teuthology.orchestra.run.smithi134.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-25T12:19:15.073 INFO:teuthology.orchestra.run.smithi134.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T12:19:15.073 INFO:teuthology.orchestra.run.smithi134.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T12:19:15.073 INFO:teuthology.orchestra.run.smithi134.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T12:19:15.073 INFO:teuthology.orchestra.run.smithi134.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T12:19:15.074 INFO:teuthology.orchestra.run.smithi134.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T12:19:15.074 INFO:teuthology.orchestra.run.smithi134.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T12:19:15.074 INFO:teuthology.orchestra.run.smithi134.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T12:19:15.075 INFO:teuthology.orchestra.run.smithi134.stdout:The following additional packages will be installed: 2024-04-25T12:19:15.075 INFO:teuthology.orchestra.run.smithi134.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-25T12:19:15.075 INFO:teuthology.orchestra.run.smithi134.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-25T12:19:15.075 INFO:teuthology.orchestra.run.smithi134.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-25T12:19:15.076 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-25T12:19:15.076 INFO:teuthology.orchestra.run.smithi134.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-25T12:19:15.077 INFO:teuthology.orchestra.run.smithi134.stdout:Suggested packages: 2024-04-25T12:19:15.077 INFO:teuthology.orchestra.run.smithi134.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-25T12:19:15.077 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-25T12:19:15.077 INFO:teuthology.orchestra.run.smithi134.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-25T12:19:15.121 INFO:teuthology.orchestra.run.smithi134.stdout:The following NEW packages will be installed: 2024-04-25T12:19:15.121 INFO:teuthology.orchestra.run.smithi134.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-25T12:19:15.121 INFO:teuthology.orchestra.run.smithi134.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-25T12:19:15.122 INFO:teuthology.orchestra.run.smithi134.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-25T12:19:15.122 INFO:teuthology.orchestra.run.smithi134.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-25T12:19:15.122 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-25T12:19:15.122 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-25T12:19:15.122 INFO:teuthology.orchestra.run.smithi134.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-25T12:19:15.123 INFO:teuthology.orchestra.run.smithi134.stdout:The following packages will be upgraded: 2024-04-25T12:19:15.124 INFO:teuthology.orchestra.run.smithi134.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-25T12:19:15.207 INFO:teuthology.orchestra.run.smithi134.stdout:4 upgraded, 39 newly installed, 0 to remove and 298 not upgraded. 2024-04-25T12:19:15.207 INFO:teuthology.orchestra.run.smithi134.stdout:Need to get 55.7 MB of archives. 2024-04-25T12:19:15.208 INFO:teuthology.orchestra.run.smithi134.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-25T12:19:15.208 INFO:teuthology.orchestra.run.smithi134.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-25T12:19:15.366 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-25T12:19:15.368 INFO:teuthology.orchestra.run.smithi134.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-25T12:19:15.375 INFO:teuthology.orchestra.run.smithi134.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-25T12:19:15.415 INFO:teuthology.orchestra.run.smithi134.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-25T12:19:15.416 INFO:teuthology.orchestra.run.smithi134.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-25T12:19:15.417 INFO:teuthology.orchestra.run.smithi134.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-25T12:19:15.428 INFO:teuthology.orchestra.run.smithi134.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-25T12:19:15.429 INFO:teuthology.orchestra.run.smithi134.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-25T12:19:15.431 INFO:teuthology.orchestra.run.smithi134.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-25T12:19:15.432 INFO:teuthology.orchestra.run.smithi134.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-25T12:19:15.432 INFO:teuthology.orchestra.run.smithi134.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-25T12:19:15.434 INFO:teuthology.orchestra.run.smithi134.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-25T12:19:15.437 INFO:teuthology.orchestra.run.smithi134.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-25T12:19:15.456 INFO:teuthology.orchestra.run.smithi134.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-25T12:19:15.456 INFO:teuthology.orchestra.run.smithi134.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-25T12:19:15.458 INFO:teuthology.orchestra.run.smithi134.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-25T12:19:15.684 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-25T12:19:15.849 INFO:teuthology.orchestra.run.smithi134.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-25T12:19:15.852 INFO:teuthology.orchestra.run.smithi134.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-25T12:19:15.852 INFO:teuthology.orchestra.run.smithi134.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-25T12:19:15.855 INFO:teuthology.orchestra.run.smithi134.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-25T12:19:15.855 INFO:teuthology.orchestra.run.smithi134.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-25T12:19:15.860 INFO:teuthology.orchestra.run.smithi134.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-25T12:19:15.862 INFO:teuthology.orchestra.run.smithi134.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-25T12:19:15.870 INFO:teuthology.orchestra.run.smithi134.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-25T12:19:15.943 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T12:19:15.974 INFO:teuthology.orchestra.run.smithi134.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-25T12:19:16.002 INFO:teuthology.orchestra.run.smithi134.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-25T12:19:16.002 INFO:teuthology.orchestra.run.smithi134.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-25T12:19:16.015 INFO:teuthology.orchestra.run.smithi134.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-25T12:19:16.038 INFO:teuthology.orchestra.run.smithi134.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-25T12:19:16.042 INFO:teuthology.orchestra.run.smithi134.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-25T12:19:16.042 INFO:teuthology.orchestra.run.smithi134.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-25T12:19:16.043 INFO:teuthology.orchestra.run.smithi134.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-25T12:19:16.043 INFO:teuthology.orchestra.run.smithi134.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-25T12:19:16.044 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-25T12:19:16.054 INFO:teuthology.orchestra.run.smithi134.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-25T12:19:16.056 INFO:teuthology.orchestra.run.smithi134.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-25T12:19:16.162 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T12:19:16.249 INFO:teuthology.orchestra.run.smithi134.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-25T12:19:16.251 INFO:teuthology.orchestra.run.smithi086.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-25T12:19:16.304 INFO:teuthology.orchestra.run.smithi134.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-25T12:19:16.307 INFO:teuthology.orchestra.run.smithi134.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-25T12:19:16.309 INFO:teuthology.orchestra.run.smithi134.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-25T12:19:16.312 INFO:teuthology.orchestra.run.smithi134.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-25T12:19:16.314 INFO:teuthology.orchestra.run.smithi134.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-25T12:19:16.330 INFO:teuthology.orchestra.run.smithi134.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-25T12:19:16.337 INFO:teuthology.orchestra.run.smithi134.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-25T12:19:16.505 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T12:19:16.648 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T12:19:16.741 INFO:teuthology.orchestra.run.smithi134.stdout:Preconfiguring packages ... 2024-04-25T12:19:16.900 INFO:teuthology.orchestra.run.smithi134.stdout:Fetched 55.7 MB in 1s (46.2 MB/s) 2024-04-25T12:19:17.033 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-25T12:19:17.220 INFO:teuthology.orchestra.run.smithi134.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173995 files and directories currently installed.) 2024-04-25T12:19:17.226 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T12:19:17.284 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-25T12:19:17.371 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T12:19:17.384 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-25T12:19:17.627 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T12:19:17.728 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T12:19:18.027 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-25T12:19:18.046 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T12:19:18.347 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T12:19:18.606 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-25T12:19:18.793 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-25T12:19:18.956 INFO:teuthology.orchestra.run.smithi134.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-25T12:19:19.061 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-25T12:19:19.243 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package flex. 2024-04-25T12:19:19.312 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T12:19:19.339 INFO:teuthology.orchestra.run.smithi134.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173995 files and directories currently installed.) 2024-04-25T12:19:19.345 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-25T12:19:19.391 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-25T12:19:19.588 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-25T12:19:19.874 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T12:19:19.973 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-25T12:19:20.013 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-25T12:19:20.241 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T12:19:20.416 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T12:19:20.610 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T12:19:20.736 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up librados2 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:20.862 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:20.943 INFO:teuthology.orchestra.run.smithi134.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174068 files and directories currently installed.) 2024-04-25T12:19:20.948 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T12:19:20.988 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-25T12:19:21.079 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T12:19:21.274 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libcephfs2 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:21.383 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libradosstriper1 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:21.462 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T12:19:21.509 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-25T12:19:21.577 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T12:19:21.786 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up librbd1 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:21.912 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-mgr-modules-core (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:21.995 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T12:19:22.038 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-fuse (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:22.254 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T12:19:22.254 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T12:19:22.394 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package bison. 2024-04-25T12:19:22.496 INFO:teuthology.orchestra.run.smithi134.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174068 files and directories currently installed.) 2024-04-25T12:19:22.501 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-25T12:19:22.554 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T12:19:22.756 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libcephfs-dev (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:22.882 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-rados (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:22.913 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-25T12:19:22.941 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-25T12:19:22.980 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-25T12:19:23.300 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up librgw2 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:23.307 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package dump. 2024-04-25T12:19:23.335 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-25T12:19:23.374 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking dump (0.4b47-3) ... 2024-04-25T12:19:23.426 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up cephfs-top (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:23.552 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T12:19:23.669 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package indent. 2024-04-25T12:19:23.686 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T12:19:23.728 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-25T12:19:23.964 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-25T12:19:23.980 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-25T12:19:24.013 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T12:19:24.301 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-25T12:19:24.329 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-25T12:19:24.359 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-25T12:19:24.620 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-25T12:19:24.636 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-25T12:19:24.678 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T12:19:24.764 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-rbd (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:24.865 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up rbd-fuse (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:24.965 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-rgw (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:25.006 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-25T12:19:25.035 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-25T12:19:25.066 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-cephfs (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:25.073 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T12:19:25.192 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up cephfs-shell (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:25.318 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-common (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:25.325 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-25T12:19:25.353 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-25T12:19:25.393 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T12:19:25.653 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libjson-perl. 2024-04-25T12:19:25.681 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-25T12:19:25.745 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-25T12:19:25.861 INFO:teuthology.orchestra.run.smithi086.stdout:Adding group ceph....done 2024-04-25T12:19:26.056 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-25T12:19:26.084 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-25T12:19:26.123 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-25T12:19:26.246 INFO:teuthology.orchestra.run.smithi086.stdout:Adding system user ceph....done 2024-04-25T12:19:26.364 INFO:teuthology.orchestra.run.smithi086.stdout:Setting system user ceph properties....done 2024-04-25T12:19:26.383 INFO:teuthology.orchestra.run.smithi086.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-25T12:19:26.523 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-25T12:19:26.868 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-25T12:19:27.327 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up cephfs-mirror (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:27.740 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-25T12:19:27.740 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-25T12:19:27.775 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-25T12:19:27.803 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-25T12:19:27.842 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T12:19:28.069 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-25T12:19:28.086 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-25T12:19:28.119 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T12:19:28.188 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-test (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:28.322 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up radosgw (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:28.439 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-25T12:19:28.466 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-25T12:19:28.505 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T12:19:28.758 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T12:19:28.758 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T12:19:28.850 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-25T12:19:28.877 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-25T12:19:28.916 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-25T12:19:29.236 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-25T12:19:29.248 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-base (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:29.264 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-25T12:19:29.319 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-25T12:19:29.569 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-25T12:19:29.647 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-25T12:19:29.675 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T12:19:29.713 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T12:19:30.009 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-mds (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:30.041 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-25T12:19:30.069 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T12:19:30.108 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T12:19:30.230 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T12:19:30.230 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T12:19:30.410 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-25T12:19:30.427 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T12:19:30.469 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T12:19:30.688 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-25T12:19:30.704 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T12:19:30.710 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-mgr (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:30.738 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T12:19:30.923 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T12:19:30.923 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T12:19:31.216 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-25T12:19:31.244 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-25T12:19:31.283 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-25T12:19:31.403 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-osd (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:31.619 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package modemmanager. 2024-04-25T12:19:31.647 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-25T12:19:31.675 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T12:19:31.675 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T12:19:31.686 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T12:19:32.105 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:32.214 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:32.317 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package network-manager. 2024-04-25T12:19:32.340 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-mon (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:32.345 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-25T12:19:32.392 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-25T12:19:32.538 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T12:19:32.538 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T12:19:32.966 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ppp. 2024-04-25T12:19:32.994 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-25T12:19:33.281 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-25T12:19:33.445 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-mgr-cephadm (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:33.587 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package pptp-linux. 2024-04-25T12:19:33.606 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:33.615 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-25T12:19:33.653 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-25T12:19:33.732 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-mgr-dashboard (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:33.875 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-volume (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:33.906 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-25T12:19:33.934 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-25T12:19:33.973 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-25T12:19:34.219 INFO:teuthology.orchestra.run.smithi086.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-25T12:19:34.242 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-25T12:19:34.270 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-25T12:19:34.300 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking postgresql-client-common (238) ... 2024-04-25T12:19:34.319 INFO:teuthology.orchestra.run.smithi086.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T12:19:34.481 INFO:teuthology.orchestra.run.smithi086.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T12:19:34.604 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-25T12:19:34.632 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T12:19:34.671 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T12:19:35.267 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package postgresql-common. 2024-04-25T12:19:35.295 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-25T12:19:35.351 INFO:teuthology.orchestra.run.smithi134.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-25T12:19:35.382 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking postgresql-common (238) ... 2024-04-25T12:19:35.474 INFO:teuthology.orchestra.run.smithi086.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T12:19:35.841 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package postgresql-14. 2024-04-25T12:19:35.869 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T12:19:35.911 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T12:19:36.157 INFO:teuthology.orchestra.run.smithi086.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T12:19:36.160 DEBUG:teuthology.orchestra.run.smithi086:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-25T12:19:36.252 INFO:teuthology.orchestra.run.smithi086.stdout:Reading package lists... 2024-04-25T12:19:36.454 INFO:teuthology.orchestra.run.smithi086.stdout:Building dependency tree... 2024-04-25T12:19:36.455 INFO:teuthology.orchestra.run.smithi086.stdout:Reading state information... 2024-04-25T12:19:36.651 INFO:teuthology.orchestra.run.smithi086.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-25T12:19:36.651 INFO:teuthology.orchestra.run.smithi086.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-25T12:19:36.651 INFO:teuthology.orchestra.run.smithi086.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-25T12:19:36.651 INFO:teuthology.orchestra.run.smithi086.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T12:19:36.651 INFO:teuthology.orchestra.run.smithi086.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T12:19:36.651 INFO:teuthology.orchestra.run.smithi086.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T12:19:36.651 INFO:teuthology.orchestra.run.smithi086.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T12:19:36.651 INFO:teuthology.orchestra.run.smithi086.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T12:19:36.652 INFO:teuthology.orchestra.run.smithi086.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T12:19:36.652 INFO:teuthology.orchestra.run.smithi086.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T12:19:36.652 INFO:teuthology.orchestra.run.smithi086.stdout:The following additional packages will be installed: 2024-04-25T12:19:36.652 INFO:teuthology.orchestra.run.smithi086.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-25T12:19:36.652 INFO:teuthology.orchestra.run.smithi086.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-25T12:19:36.653 INFO:teuthology.orchestra.run.smithi086.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-25T12:19:36.653 INFO:teuthology.orchestra.run.smithi086.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-25T12:19:36.653 INFO:teuthology.orchestra.run.smithi086.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-25T12:19:36.654 INFO:teuthology.orchestra.run.smithi086.stdout:Suggested packages: 2024-04-25T12:19:36.654 INFO:teuthology.orchestra.run.smithi086.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-25T12:19:36.654 INFO:teuthology.orchestra.run.smithi086.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-25T12:19:36.655 INFO:teuthology.orchestra.run.smithi086.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-25T12:19:36.696 INFO:teuthology.orchestra.run.smithi086.stdout:The following NEW packages will be installed: 2024-04-25T12:19:36.697 INFO:teuthology.orchestra.run.smithi086.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-25T12:19:36.697 INFO:teuthology.orchestra.run.smithi086.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-25T12:19:36.697 INFO:teuthology.orchestra.run.smithi086.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-25T12:19:36.697 INFO:teuthology.orchestra.run.smithi086.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-25T12:19:36.698 INFO:teuthology.orchestra.run.smithi086.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-25T12:19:36.698 INFO:teuthology.orchestra.run.smithi086.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-25T12:19:36.698 INFO:teuthology.orchestra.run.smithi086.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-25T12:19:36.699 INFO:teuthology.orchestra.run.smithi086.stdout:The following packages will be upgraded: 2024-04-25T12:19:36.700 INFO:teuthology.orchestra.run.smithi086.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-25T12:19:36.758 INFO:teuthology.orchestra.run.smithi086.stdout:4 upgraded, 39 newly installed, 0 to remove and 298 not upgraded. 2024-04-25T12:19:36.758 INFO:teuthology.orchestra.run.smithi086.stdout:Need to get 55.7 MB of archives. 2024-04-25T12:19:36.758 INFO:teuthology.orchestra.run.smithi086.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-25T12:19:36.758 INFO:teuthology.orchestra.run.smithi086.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-25T12:19:36.919 INFO:teuthology.orchestra.run.smithi086.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-25T12:19:36.926 INFO:teuthology.orchestra.run.smithi086.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-25T12:19:36.966 INFO:teuthology.orchestra.run.smithi086.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-25T12:19:36.967 INFO:teuthology.orchestra.run.smithi086.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-25T12:19:36.968 INFO:teuthology.orchestra.run.smithi086.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-25T12:19:36.979 INFO:teuthology.orchestra.run.smithi086.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-25T12:19:36.980 INFO:teuthology.orchestra.run.smithi086.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-25T12:19:36.982 INFO:teuthology.orchestra.run.smithi086.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-25T12:19:36.983 INFO:teuthology.orchestra.run.smithi086.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-25T12:19:36.984 INFO:teuthology.orchestra.run.smithi086.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-25T12:19:36.985 INFO:teuthology.orchestra.run.smithi086.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-25T12:19:36.989 INFO:teuthology.orchestra.run.smithi086.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-25T12:19:37.007 INFO:teuthology.orchestra.run.smithi086.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-25T12:19:37.008 INFO:teuthology.orchestra.run.smithi086.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-25T12:19:37.009 INFO:teuthology.orchestra.run.smithi086.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-25T12:19:37.159 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package postgresql. 2024-04-25T12:19:37.176 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-25T12:19:37.217 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking postgresql (14+238) ... 2024-04-25T12:19:37.462 INFO:teuthology.orchestra.run.smithi086.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-25T12:19:37.465 INFO:teuthology.orchestra.run.smithi086.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-25T12:19:37.465 INFO:teuthology.orchestra.run.smithi086.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-25T12:19:37.469 INFO:teuthology.orchestra.run.smithi086.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-25T12:19:37.469 INFO:teuthology.orchestra.run.smithi086.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-25T12:19:37.477 INFO:teuthology.orchestra.run.smithi086.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-25T12:19:37.478 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package postgresql-client. 2024-04-25T12:19:37.479 INFO:teuthology.orchestra.run.smithi086.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-25T12:19:37.490 INFO:teuthology.orchestra.run.smithi086.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-25T12:19:37.491 INFO:teuthology.orchestra.run.smithi086.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-25T12:19:37.494 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-25T12:19:37.522 INFO:teuthology.orchestra.run.smithi086.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-25T12:19:37.522 INFO:teuthology.orchestra.run.smithi086.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-25T12:19:37.534 INFO:teuthology.orchestra.run.smithi086.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-25T12:19:37.536 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking postgresql-client (14+238) ... 2024-04-25T12:19:37.562 INFO:teuthology.orchestra.run.smithi086.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-25T12:19:37.567 INFO:teuthology.orchestra.run.smithi086.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-25T12:19:37.568 INFO:teuthology.orchestra.run.smithi086.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-25T12:19:37.568 INFO:teuthology.orchestra.run.smithi086.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-25T12:19:37.569 INFO:teuthology.orchestra.run.smithi086.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-25T12:19:37.583 INFO:teuthology.orchestra.run.smithi086.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-25T12:19:37.584 INFO:teuthology.orchestra.run.smithi086.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-25T12:19:37.780 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-25T12:19:37.808 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-25T12:19:37.847 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-25T12:19:37.862 INFO:teuthology.orchestra.run.smithi086.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-25T12:19:37.862 INFO:teuthology.orchestra.run.smithi086.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-25T12:19:37.862 INFO:teuthology.orchestra.run.smithi086.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-25T12:19:37.862 INFO:teuthology.orchestra.run.smithi086.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-25T12:19:37.862 INFO:teuthology.orchestra.run.smithi086.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-25T12:19:37.862 INFO:teuthology.orchestra.run.smithi086.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-25T12:19:37.872 INFO:teuthology.orchestra.run.smithi086.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-25T12:19:37.872 INFO:teuthology.orchestra.run.smithi086.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-25T12:19:38.157 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package tcl8.6. 2024-04-25T12:19:38.186 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-25T12:19:38.216 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-25T12:19:38.276 INFO:teuthology.orchestra.run.smithi086.stdout:Preconfiguring packages ... 2024-04-25T12:19:38.435 INFO:teuthology.orchestra.run.smithi086.stdout:Fetched 55.7 MB in 1s (47.8 MB/s) 2024-04-25T12:19:38.485 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package tcl. 2024-04-25T12:19:38.513 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-25T12:19:38.557 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-25T12:19:38.753 INFO:teuthology.orchestra.run.smithi086.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173995 files and directories currently installed.) 2024-04-25T12:19:38.759 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T12:19:38.896 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T12:19:38.913 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package wpasupplicant. 2024-04-25T12:19:38.941 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-25T12:19:38.979 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-25T12:19:39.325 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-25T12:19:39.353 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-25T12:19:39.391 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-25T12:19:39.509 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-25T12:19:39.711 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-25T12:19:39.739 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-25T12:19:39.786 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-25T12:19:40.099 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up postgresql-client-common (238) ... 2024-04-25T12:19:40.283 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-25T12:19:40.418 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-25T12:19:40.457 INFO:teuthology.orchestra.run.smithi086.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-25T12:19:40.545 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T12:19:40.670 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-25T12:19:40.726 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package flex. 2024-04-25T12:19:40.796 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T12:19:40.827 INFO:teuthology.orchestra.run.smithi086.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173995 files and directories currently installed.) 2024-04-25T12:19:40.833 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-25T12:19:40.883 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-25T12:19:40.922 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T12:19:41.333 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T12:19:41.466 INFO:teuthology.orchestra.run.smithi134.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-25T12:19:41.505 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-25T12:19:41.594 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-25T12:19:41.908 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T12:19:42.393 INFO:teuthology.orchestra.run.smithi086.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174068 files and directories currently installed.) 2024-04-25T12:19:42.396 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-25T12:19:42.397 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-25T12:19:42.398 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T12:19:42.521 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T12:19:42.872 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T12:19:42.938 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T12:19:42.997 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-25T12:19:43.069 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T12:19:43.123 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T12:19:43.249 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-25T12:19:43.375 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T12:19:43.387 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T12:19:43.501 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T12:19:43.652 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-25T12:19:43.728 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package bison. 2024-04-25T12:19:43.778 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-25T12:19:43.830 INFO:teuthology.orchestra.run.smithi086.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174068 files and directories currently installed.) 2024-04-25T12:19:43.835 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-25T12:19:43.879 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T12:19:44.289 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-25T12:19:44.317 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-25T12:19:44.356 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-25T12:19:44.400 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-25T12:19:44.526 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up dump (0.4b47-3) ... 2024-04-25T12:19:44.619 INFO:teuthology.orchestra.run.smithi134.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-25T12:19:44.684 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package dump. 2024-04-25T12:19:44.685 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T12:19:44.712 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-25T12:19:44.750 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking dump (0.4b47-3) ... 2024-04-25T12:19:44.812 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-25T12:19:44.929 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-25T12:19:45.012 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package indent. 2024-04-25T12:19:45.029 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T12:19:45.030 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-25T12:19:45.062 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-25T12:19:45.156 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T12:19:45.246 INFO:teuthology.orchestra.run.smithi134.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-25T12:19:45.316 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-25T12:19:45.323 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-25T12:19:45.351 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-25T12:19:45.390 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T12:19:45.442 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-25T12:19:45.618 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-25T12:19:45.736 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-25T12:19:45.744 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T12:19:45.763 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-25T12:19:45.802 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-25T12:19:45.895 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-25T12:19:46.038 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-25T12:19:46.054 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-25T12:19:46.055 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up postgresql-client (14+238) ... 2024-04-25T12:19:46.088 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T12:19:46.156 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-25T12:19:46.400 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-25T12:19:46.427 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-25T12:19:46.475 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T12:19:46.644 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-25T12:19:46.644 INFO:teuthology.orchestra.run.smithi134.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-25T12:19:46.644 INFO:teuthology.orchestra.run.smithi134.stdout:which means they are currently configured by ifupdown: 2024-04-25T12:19:46.644 INFO:teuthology.orchestra.run.smithi134.stdout:- enp3s0f1 2024-04-25T12:19:46.645 INFO:teuthology.orchestra.run.smithi134.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-25T12:19:46.645 INFO:teuthology.orchestra.run.smithi134.stdout:remove their configuration from /etc/network/interfaces. 2024-04-25T12:19:46.645 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-25T12:19:46.727 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-25T12:19:46.743 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-25T12:19:46.777 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-25T12:19:46.786 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T12:19:47.039 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libjson-perl. 2024-04-25T12:19:47.066 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-25T12:19:47.105 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-25T12:19:47.132 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-25T12:19:47.383 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-25T12:19:47.411 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-25T12:19:47.450 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-25T12:19:47.568 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-25T12:19:48.083 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T12:19:48.234 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T12:19:48.344 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-25T12:19:48.453 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up postgresql-common (238) ... 2024-04-25T12:19:49.086 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-25T12:19:49.113 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-25T12:19:49.152 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T12:19:49.353 INFO:teuthology.orchestra.run.smithi134.stdout:Adding user postgres to group ssl-cert 2024-04-25T12:19:49.413 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-25T12:19:49.439 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-25T12:19:49.480 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T12:19:49.585 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-25T12:19:49.585 INFO:teuthology.orchestra.run.smithi134.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-25T12:19:49.783 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-25T12:19:49.785 INFO:teuthology.orchestra.run.smithi134.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-25T12:19:49.785 INFO:teuthology.orchestra.run.smithi134.stdout:Removing obsolete dictionary files: 2024-04-25T12:19:49.811 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-25T12:19:49.841 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T12:19:50.186 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-25T12:19:50.214 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-25T12:19:50.252 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-25T12:19:50.318 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-25T12:19:50.572 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-25T12:19:50.600 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-25T12:19:50.638 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-25T12:19:50.696 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T12:19:50.950 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-25T12:19:50.977 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T12:19:51.016 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T12:19:51.036 INFO:teuthology.orchestra.run.smithi134.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-25T12:19:51.058 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-25T12:19:51.098 INFO:teuthology.orchestra.run.smithi134.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-25T12:19:51.098 INFO:teuthology.orchestra.run.smithi134.stdout:This user must also own the server process. 2024-04-25T12:19:51.098 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-25T12:19:51.098 INFO:teuthology.orchestra.run.smithi134.stdout:The database cluster will be initialized with locale "en_US". 2024-04-25T12:19:51.098 INFO:teuthology.orchestra.run.smithi134.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-25T12:19:51.098 INFO:teuthology.orchestra.run.smithi134.stdout:The default text search configuration will be set to "english". 2024-04-25T12:19:51.098 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-25T12:19:51.099 INFO:teuthology.orchestra.run.smithi134.stdout:Data page checksums are disabled. 2024-04-25T12:19:51.099 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-25T12:19:51.099 INFO:teuthology.orchestra.run.smithi134.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-25T12:19:51.099 INFO:teuthology.orchestra.run.smithi134.stdout:creating subdirectories ... ok 2024-04-25T12:19:51.099 INFO:teuthology.orchestra.run.smithi134.stdout:selecting dynamic shared memory implementation ... posix 2024-04-25T12:19:51.115 INFO:teuthology.orchestra.run.smithi134.stdout:selecting default max_connections ... 100 2024-04-25T12:19:51.135 INFO:teuthology.orchestra.run.smithi134.stdout:selecting default shared_buffers ... 128MB 2024-04-25T12:19:51.148 INFO:teuthology.orchestra.run.smithi134.stdout:selecting default time zone ... Etc/UTC 2024-04-25T12:19:51.149 INFO:teuthology.orchestra.run.smithi134.stdout:creating configuration files ... ok 2024-04-25T12:19:51.266 INFO:teuthology.orchestra.run.smithi134.stdout:running bootstrap script ... ok 2024-04-25T12:19:51.370 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-25T12:19:51.397 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T12:19:51.436 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T12:19:51.731 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-25T12:19:51.758 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T12:19:51.797 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T12:19:51.942 INFO:teuthology.orchestra.run.smithi134.stdout:performing post-bootstrap initialization ... ok 2024-04-25T12:19:52.049 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-25T12:19:52.073 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T12:19:52.116 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T12:19:52.620 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-25T12:19:52.648 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-25T12:19:52.686 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-25T12:19:52.891 INFO:teuthology.orchestra.run.smithi134.stdout:syncing data to disk ... ok 2024-04-25T12:19:53.015 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package modemmanager. 2024-04-25T12:19:53.043 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-25T12:19:53.081 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T12:19:53.300 INFO:teuthology.orchestra.run.smithi134.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-25T12:19:53.729 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package network-manager. 2024-04-25T12:19:53.757 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-25T12:19:53.804 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-25T12:19:54.412 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ppp. 2024-04-25T12:19:54.440 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-25T12:19:54.703 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-25T12:19:55.033 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package pptp-linux. 2024-04-25T12:19:55.049 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-25T12:19:55.083 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-25T12:19:55.336 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-25T12:19:55.364 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-25T12:19:55.402 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-25T12:19:55.705 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-25T12:19:55.733 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-25T12:19:55.772 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking postgresql-client-common (238) ... 2024-04-25T12:19:56.035 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T12:19:56.059 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-25T12:19:56.086 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T12:19:56.125 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T12:19:56.163 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-25T12:19:56.272 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up postgresql (14+238) ... 2024-04-25T12:19:56.382 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T12:19:56.507 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T12:19:56.655 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package postgresql-common. 2024-04-25T12:19:56.672 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-25T12:19:56.732 INFO:teuthology.orchestra.run.smithi086.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-25T12:19:56.760 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-25T12:19:56.760 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-25T12:19:56.761 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking postgresql-common (238) ... 2024-04-25T12:19:57.179 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package postgresql-14. 2024-04-25T12:19:57.207 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T12:19:57.249 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T12:19:57.310 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-25T12:19:57.402 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-25T12:19:57.721 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T12:19:57.881 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T12:19:58.582 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package postgresql. 2024-04-25T12:19:58.599 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-25T12:19:58.640 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking postgresql (14+238) ... 2024-04-25T12:19:58.901 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package postgresql-client. 2024-04-25T12:19:58.929 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-25T12:19:58.967 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking postgresql-client (14+238) ... 2024-04-25T12:19:59.184 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-25T12:19:59.211 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-25T12:19:59.239 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-25T12:19:59.278 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-25T12:19:59.284 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T12:19:59.539 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package tcl8.6. 2024-04-25T12:19:59.567 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-25T12:19:59.597 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-25T12:19:59.778 INFO:teuthology.orchestra.run.smithi134.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T12:19:59.784 DEBUG:teuthology.parallel:result is None 2024-04-25T12:19:59.875 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package tcl. 2024-04-25T12:19:59.903 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-25T12:19:59.945 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-25T12:20:00.303 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package wpasupplicant. 2024-04-25T12:20:00.331 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-25T12:20:00.369 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-25T12:20:00.682 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-25T12:20:00.698 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-25T12:20:00.731 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-25T12:20:01.110 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-25T12:20:01.138 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-25T12:20:01.185 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-25T12:20:01.481 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up postgresql-client-common (238) ... 2024-04-25T12:20:01.807 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-25T12:20:01.908 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-25T12:20:02.009 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T12:20:02.127 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-25T12:20:02.270 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T12:20:02.396 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T12:20:02.897 INFO:teuthology.orchestra.run.smithi086.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-25T12:20:02.977 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-25T12:20:03.383 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-25T12:20:03.383 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-25T12:20:03.905 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T12:20:04.292 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-25T12:20:04.599 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T12:20:04.700 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-25T12:20:04.817 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T12:20:04.943 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T12:20:05.069 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-25T12:20:05.195 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-25T12:20:05.917 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-25T12:20:06.043 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up dump (0.4b47-3) ... 2024-04-25T12:20:06.137 INFO:teuthology.orchestra.run.smithi086.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-25T12:20:06.203 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T12:20:06.329 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-25T12:20:06.455 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-25T12:20:06.606 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-25T12:20:06.707 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T12:20:06.780 INFO:teuthology.orchestra.run.smithi086.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-25T12:20:06.842 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-25T12:20:06.951 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-25T12:20:07.136 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-25T12:20:07.262 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T12:20:07.388 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-25T12:20:07.556 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up postgresql-client (14+238) ... 2024-04-25T12:20:07.673 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-25T12:20:08.063 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:20:08.063 INFO:teuthology.orchestra.run.smithi086.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-25T12:20:08.063 INFO:teuthology.orchestra.run.smithi086.stdout:which means they are currently configured by ifupdown: 2024-04-25T12:20:08.063 INFO:teuthology.orchestra.run.smithi086.stdout:- enp3s0f1 2024-04-25T12:20:08.063 INFO:teuthology.orchestra.run.smithi086.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-25T12:20:08.064 INFO:teuthology.orchestra.run.smithi086.stdout:remove their configuration from /etc/network/interfaces. 2024-04-25T12:20:08.064 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:20:08.175 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-25T12:20:08.511 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-25T12:20:08.833 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-25T12:20:09.301 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T12:20:09.444 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T12:20:09.545 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-25T12:20:10.047 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up postgresql-common (238) ... 2024-04-25T12:20:11.137 INFO:teuthology.orchestra.run.smithi086.stdout:Adding user postgres to group ssl-cert 2024-04-25T12:20:11.367 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:20:11.367 INFO:teuthology.orchestra.run.smithi086.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-25T12:20:11.565 INFO:teuthology.orchestra.run.smithi086.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-25T12:20:11.565 INFO:teuthology.orchestra.run.smithi086.stdout:Removing obsolete dictionary files: 2024-04-25T12:20:12.147 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-25T12:20:12.523 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T12:20:12.817 INFO:teuthology.orchestra.run.smithi086.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-25T12:20:12.836 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-25T12:20:12.878 INFO:teuthology.orchestra.run.smithi086.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-25T12:20:12.878 INFO:teuthology.orchestra.run.smithi086.stdout:This user must also own the server process. 2024-04-25T12:20:12.878 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:20:12.878 INFO:teuthology.orchestra.run.smithi086.stdout:The database cluster will be initialized with locale "en_US". 2024-04-25T12:20:12.878 INFO:teuthology.orchestra.run.smithi086.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-25T12:20:12.878 INFO:teuthology.orchestra.run.smithi086.stdout:The default text search configuration will be set to "english". 2024-04-25T12:20:12.878 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:20:12.878 INFO:teuthology.orchestra.run.smithi086.stdout:Data page checksums are disabled. 2024-04-25T12:20:12.879 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:20:12.879 INFO:teuthology.orchestra.run.smithi086.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-25T12:20:12.879 INFO:teuthology.orchestra.run.smithi086.stdout:creating subdirectories ... ok 2024-04-25T12:20:12.879 INFO:teuthology.orchestra.run.smithi086.stdout:selecting dynamic shared memory implementation ... posix 2024-04-25T12:20:12.894 INFO:teuthology.orchestra.run.smithi086.stdout:selecting default max_connections ... 100 2024-04-25T12:20:12.913 INFO:teuthology.orchestra.run.smithi086.stdout:selecting default shared_buffers ... 128MB 2024-04-25T12:20:12.923 INFO:teuthology.orchestra.run.smithi086.stdout:selecting default time zone ... Etc/UTC 2024-04-25T12:20:12.923 INFO:teuthology.orchestra.run.smithi086.stdout:creating configuration files ... ok 2024-04-25T12:20:13.041 INFO:teuthology.orchestra.run.smithi086.stdout:running bootstrap script ... ok 2024-04-25T12:20:13.715 INFO:teuthology.orchestra.run.smithi086.stdout:performing post-bootstrap initialization ... ok 2024-04-25T12:20:14.376 INFO:teuthology.orchestra.run.smithi086.stdout:syncing data to disk ... ok 2024-04-25T12:20:14.775 INFO:teuthology.orchestra.run.smithi086.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-25T12:20:17.521 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T12:20:17.639 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-25T12:20:17.765 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up postgresql (14+238) ... 2024-04-25T12:20:17.890 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T12:20:18.016 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T12:20:18.298 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-25T12:20:18.298 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-25T12:20:18.888 INFO:teuthology.orchestra.run.smithi086.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-25T12:20:18.963 INFO:teuthology.orchestra.run.smithi086.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-25T12:20:19.249 INFO:teuthology.orchestra.run.smithi086.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T12:20:19.401 INFO:teuthology.orchestra.run.smithi086.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T12:20:20.712 INFO:teuthology.orchestra.run.smithi086.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-25T12:20:20.812 INFO:teuthology.orchestra.run.smithi086.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T12:20:21.311 INFO:teuthology.orchestra.run.smithi086.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T12:20:21.316 DEBUG:teuthology.parallel:result is None 2024-04-25T12:20:21.317 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-25T12:20:21.545 DEBUG:teuthology.orchestra.run.smithi086:> dpkg-query -W -f '${Version}' ceph 2024-04-25T12:20:21.564 INFO:teuthology.orchestra.run.smithi086.stdout:19.0.0-3156-gd69f13d8-1jammy 2024-04-25T12:20:21.565 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3156-gd69f13d8-1jammy 2024-04-25T12:20:21.565 INFO:teuthology.task.install:The correct ceph version 19.0.0-3156-gd69f13d8-1jammy is installed. 2024-04-25T12:20:21.566 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-25T12:20:21.704 DEBUG:teuthology.orchestra.run.smithi134:> dpkg-query -W -f '${Version}' ceph 2024-04-25T12:20:21.724 INFO:teuthology.orchestra.run.smithi134.stdout:19.0.0-3156-gd69f13d8-1jammy 2024-04-25T12:20:21.724 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3156-gd69f13d8-1jammy 2024-04-25T12:20:21.724 INFO:teuthology.task.install:The correct ceph version 19.0.0-3156-gd69f13d8-1jammy is installed. 2024-04-25T12:20:21.726 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-25T12:20:21.726 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-04-25T12:20:21.726 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T12:20:21.740 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-25T12:20:21.740 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T12:20:21.779 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-25T12:20:21.779 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-04-25T12:20:21.779 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T12:20:21.796 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T12:20:21.849 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-25T12:20:21.849 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T12:20:21.861 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T12:20:21.913 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-25T12:20:21.913 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-04-25T12:20:21.913 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T12:20:21.926 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T12:20:21.980 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-25T12:20:21.980 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T12:20:21.992 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T12:20:22.045 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-25T12:20:22.045 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-04-25T12:20:22.045 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T12:20:22.058 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T12:20:22.112 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-25T12:20:22.112 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T12:20:22.125 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T12:20:22.177 INFO:teuthology.run_tasks:Running task ceph... 2024-04-25T12:20:22.264 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-25T12:20:22.264 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 777 /var/log/ceph 2024-04-25T12:20:22.267 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 777 /var/log/ceph 2024-04-25T12:20:22.280 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-25T12:20:22.280 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T12:20:22.322 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T12:20:22.334 INFO:tasks.ceph:Creating extra log directories... 2024-04-25T12:20:22.334 DEBUG:teuthology.orchestra.run.smithi086:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T12:20:22.378 DEBUG:teuthology.orchestra.run.smithi134:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T12:20:22.397 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-25T12:20:22.397 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-25T12:20:22.397 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-25T12:20:22.397 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-04-25T12:20:22.397 DEBUG:teuthology.orchestra.run.smithi086:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-25T12:20:22.437 DEBUG:teuthology.orchestra.run.smithi086:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-25T12:20:22.510 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-25T12:20:22.511 DEBUG:teuthology.orchestra.run.smithi134:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-25T12:20:22.516 DEBUG:teuthology.orchestra.run.smithi134:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-25T12:20:22.595 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-25T12:20:22.595 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-25T12:20:22.595 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/leonidus-2024-04-25_11:13:36-fs-wip-lusov-quiescer-distro-default-smithi/7673357', 'branch': 'wip-lusov-quiescer', 'description': 'fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/with-quiesce 2-workunit/suites/fsstress}}', 'email': None, 'first_in_suite': False, 'job_id': '7673357', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'leonidus-2024-04-25_11:13:36-fs-wip-lusov-quiescer-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-lusov-quiescer'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'check-counter': {'counters': {'mds': ['mds.exported', 'mds.imported']}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-lusov-quiescer', 'sha1': 'df40303764f976ac2e973c1ef2b40d1ebbda473b'}}, 'owner': 'scheduled_leonidus@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 2866, 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f', 'sleep_before_teardown': 0, 'subset': '200/111111', 'suite': 'fs', 'suite_branch': 'wip-lusov-quiescer', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph_df40303764f976ac2e973c1ef2b40d1ebbda473b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph', 'suite_sha1': 'df40303764f976ac2e973c1ef2b40d1ebbda473b', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi086.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHo8N7c/YWSybwHA+a7Tv1+st7ysgPgiVfCZFBdeUqjAZ2binlyWG7lz9dvyIy3nH4cop4tjWeGSX2zpk3pj0oM=', 'smithi134.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ25y5bcI/9cypDnUvYlftagGEe4lLgZ1W6VOuDVCDHlhivGEkgVG1JqQRcGpEpPD10DkKnJf5LAZ5gLdjt54UI='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'quiescer': None}, {'workunit': {'clients': {'all': ['suites/fsstress.sh']}, 'timeout': '6h'}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-25_11:13:36', 'tube': 'smithi', 'user': 'leonidus', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-25T12:20:22.596 DEBUG:teuthology.orchestra.run.smithi086:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T12:20:22.598 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T12:20:22.634 DEBUG:teuthology.orchestra.run.smithi086:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T12:20:22.646 DEBUG:teuthology.orchestra.run.smithi134:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T12:20:22.691 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-04-25T12:20:22.691 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T12:20:22.705 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T12:20:22.705 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_1 2024-04-25T12:20:22.753 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T12:20:22.753 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T12:20:22.753 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 5h/5d Inode: 867 Links: 1 2024-04-25T12:20:22.753 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T12:20:22.753 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2024-04-25 12:13:45.865000764 +0000 2024-04-25T12:20:22.753 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2024-04-25 12:13:45.593024410 +0000 2024-04-25T12:20:22.753 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2024-04-25 12:13:45.593024410 +0000 2024-04-25T12:20:22.753 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: - 2024-04-25T12:20:22.754 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T12:20:22.807 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2024-04-25T12:20:22.807 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2024-04-25T12:20:22.807 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.000441877 s, 1.2 MB/s 2024-04-25T12:20:22.808 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T12:20:22.858 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_2 2024-04-25T12:20:22.905 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T12:20:22.905 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T12:20:22.905 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 5h/5d Inode: 881 Links: 1 2024-04-25T12:20:22.905 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T12:20:22.905 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2024-04-25 12:13:46.380956664 +0000 2024-04-25T12:20:22.905 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2024-04-25 12:13:46.108979765 +0000 2024-04-25T12:20:22.905 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2024-04-25 12:13:46.108979765 +0000 2024-04-25T12:20:22.905 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: - 2024-04-25T12:20:22.905 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T12:20:22.959 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2024-04-25T12:20:22.959 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2024-04-25T12:20:22.959 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.000349244 s, 1.5 MB/s 2024-04-25T12:20:22.960 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T12:20:23.010 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_3 2024-04-25T12:20:23.057 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T12:20:23.057 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T12:20:23.057 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 5h/5d Inode: 906 Links: 1 2024-04-25T12:20:23.057 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T12:20:23.057 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2024-04-25 12:13:46.904912159 +0000 2024-04-25T12:20:23.057 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2024-04-25 12:13:46.624935940 +0000 2024-04-25T12:20:23.057 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2024-04-25 12:13:46.624935940 +0000 2024-04-25T12:20:23.057 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: - 2024-04-25T12:20:23.058 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T12:20:23.111 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2024-04-25T12:20:23.111 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2024-04-25T12:20:23.111 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.000373193 s, 1.4 MB/s 2024-04-25T12:20:23.112 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T12:20:23.162 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_4 2024-04-25T12:20:23.209 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T12:20:23.209 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T12:20:23.209 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 5h/5d Inode: 915 Links: 1 2024-04-25T12:20:23.209 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T12:20:23.209 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2024-04-25 12:13:47.412870246 +0000 2024-04-25T12:20:23.209 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2024-04-25 12:13:47.136892860 +0000 2024-04-25T12:20:23.209 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2024-04-25 12:13:47.136892860 +0000 2024-04-25T12:20:23.209 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: - 2024-04-25T12:20:23.209 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T12:20:23.263 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2024-04-25T12:20:23.263 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2024-04-25T12:20:23.263 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.00032937 s, 1.6 MB/s 2024-04-25T12:20:23.264 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T12:20:23.314 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T12:20:23.314 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-25T12:20:23.314 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T12:20:23.320 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T12:20:23.320 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_1 2024-04-25T12:20:23.367 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T12:20:23.367 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T12:20:23.367 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 871 Links: 1 2024-04-25T12:20:23.367 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T12:20:23.367 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-04-25 12:13:56.074597086 +0000 2024-04-25T12:20:23.367 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-04-25 12:13:55.814599408 +0000 2024-04-25T12:20:23.368 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-04-25 12:13:55.814599408 +0000 2024-04-25T12:20:23.368 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2024-04-25T12:20:23.368 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T12:20:23.420 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-04-25T12:20:23.421 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-04-25T12:20:23.421 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000336639 s, 1.5 MB/s 2024-04-25T12:20:23.422 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T12:20:23.472 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_2 2024-04-25T12:20:23.518 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T12:20:23.519 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T12:20:23.519 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 889 Links: 1 2024-04-25T12:20:23.519 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T12:20:23.519 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-04-25 12:13:56.594592441 +0000 2024-04-25T12:20:23.519 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-04-25 12:13:56.338594728 +0000 2024-04-25T12:20:23.519 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-04-25 12:13:56.338594728 +0000 2024-04-25T12:20:23.519 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2024-04-25T12:20:23.519 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T12:20:23.573 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-04-25T12:20:23.573 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-04-25T12:20:23.573 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000402393 s, 1.3 MB/s 2024-04-25T12:20:23.574 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T12:20:23.624 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_3 2024-04-25T12:20:23.671 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T12:20:23.671 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T12:20:23.671 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 904 Links: 1 2024-04-25T12:20:23.671 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T12:20:23.671 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-04-25 12:13:57.094587975 +0000 2024-04-25T12:20:23.671 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-04-25 12:13:56.822590404 +0000 2024-04-25T12:20:23.671 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-04-25 12:13:56.822590404 +0000 2024-04-25T12:20:23.671 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2024-04-25T12:20:23.672 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T12:20:23.725 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-04-25T12:20:23.725 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-04-25T12:20:23.725 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000447671 s, 1.1 MB/s 2024-04-25T12:20:23.726 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T12:20:23.776 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_4 2024-04-25T12:20:23.822 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T12:20:23.822 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T12:20:23.823 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 923 Links: 1 2024-04-25T12:20:23.823 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T12:20:23.823 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-04-25 12:13:57.558583831 +0000 2024-04-25T12:20:23.823 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-04-25 12:13:57.302586117 +0000 2024-04-25T12:20:23.823 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-04-25 12:13:57.302586117 +0000 2024-04-25T12:20:23.823 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2024-04-25T12:20:23.823 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T12:20:23.877 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-04-25T12:20:23.877 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-04-25T12:20:23.877 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000398137 s, 1.3 MB/s 2024-04-25T12:20:23.878 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T12:20:23.928 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T12:20:23.928 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi086.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi134.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-25T12:20:23.928 INFO:tasks.ceph:Generating config... 2024-04-25T12:20:23.929 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-25T12:20:23.930 INFO:tasks.ceph:[client] client_shutdown_timeout = 120 2024-04-25T12:20:23.930 INFO:tasks.ceph:[client] debug client = 20 2024-04-25T12:20:23.930 INFO:tasks.ceph:[client] debug ms = 1 2024-04-25T12:20:23.930 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-25T12:20:23.930 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-25T12:20:23.930 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-25T12:20:23.930 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-25T12:20:23.930 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-25T12:20:23.930 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2024-04-25T12:20:23.930 INFO:tasks.ceph:[mds] mds bal merge size = 5 2024-04-25T12:20:23.930 INFO:tasks.ceph:[mds] mds bal split bits = 3 2024-04-25T12:20:23.930 INFO:tasks.ceph:[mds] mds bal split size = 100 2024-04-25T12:20:23.930 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-25T12:20:23.930 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-25T12:20:23.930 INFO:tasks.ceph:[mds] mds oft prefetch dirfrags = True 2024-04-25T12:20:23.931 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-25T12:20:23.931 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-25T12:20:23.931 INFO:tasks.ceph:[mds] mds_dir_prefetch = True 2024-04-25T12:20:23.931 INFO:tasks.ceph:[mds] mds_sleep_rank_change = 5000000.0 2024-04-25T12:20:23.931 INFO:tasks.ceph:[mds] mon client directed command retry = 5 2024-04-25T12:20:23.931 INFO:tasks.ceph:[mds] ms inject delay max = 1 2024-04-25T12:20:23.931 INFO:tasks.ceph:[mds] ms inject delay probability = 0.005 2024-04-25T12:20:23.931 INFO:tasks.ceph:[mds] ms inject delay type = client mds osd 2024-04-25T12:20:23.931 INFO:tasks.ceph:[mds] ms inject socket failures = 2500 2024-04-25T12:20:23.931 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-25T12:20:23.931 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-25T12:20:23.931 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-25T12:20:23.931 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-25T12:20:23.931 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-25T12:20:23.931 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-25T12:20:23.932 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-25T12:20:23.932 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-25T12:20:23.932 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-25T12:20:23.932 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-25T12:20:23.932 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-25T12:20:23.932 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-25T12:20:23.932 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-25T12:20:23.932 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-04-25T12:20:23.932 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-04-25T12:20:23.932 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-25T12:20:23.932 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-25T12:20:23.932 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-04-25T12:20:23.932 INFO:tasks.ceph:[osd] mon client directed command retry = 5 2024-04-25T12:20:23.932 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-25T12:20:23.932 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-25T12:20:23.932 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-25T12:20:23.933 INFO:tasks.ceph:[osd] ms inject delay max = 1 2024-04-25T12:20:23.933 INFO:tasks.ceph:[osd] ms inject delay probability = 0.005 2024-04-25T12:20:23.933 INFO:tasks.ceph:[osd] ms inject delay type = client mds 2024-04-25T12:20:23.933 INFO:tasks.ceph:[osd] ms inject socket failures = 2500 2024-04-25T12:20:23.933 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-04-25T12:20:23.933 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-25T12:20:23.933 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-04-25T12:20:23.933 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-25T12:20:23.933 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-25T12:20:23.933 INFO:tasks.ceph:Setting up mon.a... 2024-04-25T12:20:23.933 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-25T12:20:23.966 INFO:teuthology.orchestra.run.smithi086.stdout:creating /etc/ceph/ceph.keyring 2024-04-25T12:20:23.977 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-25T12:20:24.053 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T12:20:24.108 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.86'), ('mon.b', '172.21.15.134'), ('mon.c', '[v2:172.21.15.134:3301,v1:172.21.15.134:6790]')] 2024-04-25T12:20:24.108 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.86,172.21.15.134,[v2:172.21.15.134:3301,v1:172.21.15.134:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-25T12:20:24.109 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-04-25T12:20:24.109 DEBUG:teuthology.orchestra.run.smithi086:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T12:20:24.153 DEBUG:teuthology.orchestra.run.smithi086:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.86 --add b 172.21.15.134 --addv c '[v2:172.21.15.134:3301,v1:172.21.15.134:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-25T12:20:24.238 INFO:teuthology.orchestra.run.smithi086.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-25T12:20:24.238 INFO:teuthology.orchestra.run.smithi086.stdout:monmaptool: generated fsid f2ef5c0c-9576-4650-b4f7-6cb14247f62a 2024-04-25T12:20:24.238 INFO:teuthology.orchestra.run.smithi086.stdout:setting min_mon_release = quincy 2024-04-25T12:20:24.239 INFO:teuthology.orchestra.run.smithi086.stdout:epoch 0 2024-04-25T12:20:24.239 INFO:teuthology.orchestra.run.smithi086.stdout:fsid f2ef5c0c-9576-4650-b4f7-6cb14247f62a 2024-04-25T12:20:24.239 INFO:teuthology.orchestra.run.smithi086.stdout:last_changed 2024-04-25T12:20:24.240105+0000 2024-04-25T12:20:24.239 INFO:teuthology.orchestra.run.smithi086.stdout:created 2024-04-25T12:20:24.240105+0000 2024-04-25T12:20:24.239 INFO:teuthology.orchestra.run.smithi086.stdout:min_mon_release 17 (quincy) 2024-04-25T12:20:24.239 INFO:teuthology.orchestra.run.smithi086.stdout:election_strategy: 1 2024-04-25T12:20:24.239 INFO:teuthology.orchestra.run.smithi086.stdout:0: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.a 2024-04-25T12:20:24.239 INFO:teuthology.orchestra.run.smithi086.stdout:1: [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon.b 2024-04-25T12:20:24.239 INFO:teuthology.orchestra.run.smithi086.stdout:2: [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] mon.c 2024-04-25T12:20:24.239 INFO:teuthology.orchestra.run.smithi086.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-25T12:20:24.240 DEBUG:teuthology.orchestra.run.smithi086:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T12:20:24.289 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID f2ef5c0c-9576-4650-b4f7-6cb14247f62a... 2024-04-25T12:20:24.290 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T12:20:24.334 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T12:20:24.361 INFO:teuthology.orchestra.run.smithi086.stdout:[global] 2024-04-25T12:20:24.361 INFO:teuthology.orchestra.run.smithi086.stdout: chdir = "" 2024-04-25T12:20:24.361 INFO:teuthology.orchestra.run.smithi086.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T12:20:24.362 INFO:teuthology.orchestra.run.smithi086.stdout: auth supported = cephx 2024-04-25T12:20:24.362 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:20:24.362 INFO:teuthology.orchestra.run.smithi086.stdout: filestore xattr use omap = true 2024-04-25T12:20:24.362 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:20:24.362 INFO:teuthology.orchestra.run.smithi086.stdout: mon clock drift allowed = 1.000 2024-04-25T12:20:24.362 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:20:24.362 INFO:teuthology.orchestra.run.smithi086.stdout: osd crush chooseleaf type = 0 2024-04-25T12:20:24.362 INFO:teuthology.orchestra.run.smithi086.stdout: auth debug = true 2024-04-25T12:20:24.362 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:20:24.362 INFO:teuthology.orchestra.run.smithi086.stdout: ms die on old message = true 2024-04-25T12:20:24.362 INFO:teuthology.orchestra.run.smithi086.stdout: ms die on bug = true 2024-04-25T12:20:24.363 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:20:24.363 INFO:teuthology.orchestra.run.smithi086.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T12:20:24.363 INFO:teuthology.orchestra.run.smithi086.stdout: mon pg warn max object skew = 0 2024-04-25T12:20:24.363 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:20:24.363 INFO:teuthology.orchestra.run.smithi086.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T12:20:24.363 INFO:teuthology.orchestra.run.smithi086.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T12:20:24.363 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:20:24.363 INFO:teuthology.orchestra.run.smithi086.stdout: osd pool default size = 2 2024-04-25T12:20:24.363 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:20:24.363 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd allow primary affinity = true 2024-04-25T12:20:24.363 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd allow pg remap = true 2024-04-25T12:20:24.363 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on legacy crush tunables = false 2024-04-25T12:20:24.364 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on crush straw calc version zero = false 2024-04-25T12:20:24.364 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on no sortbitwise = false 2024-04-25T12:20:24.364 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on osd down out interval zero = false 2024-04-25T12:20:24.364 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on too few osds = false 2024-04-25T12:20:24.364 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T12:20:24.364 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T12:20:24.364 INFO:teuthology.orchestra.run.smithi086.stdout: mon_allow_pool_size_one = true 2024-04-25T12:20:24.364 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:20:24.364 INFO:teuthology.orchestra.run.smithi086.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T12:20:24.364 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:20:24.364 INFO:teuthology.orchestra.run.smithi086.stdout: osd default data pool replay window = 5 2024-04-25T12:20:24.365 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:20:24.365 INFO:teuthology.orchestra.run.smithi086.stdout: mon allow pool delete = true 2024-04-25T12:20:24.365 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:20:24.365 INFO:teuthology.orchestra.run.smithi086.stdout: mon cluster log file level = debug 2024-04-25T12:20:24.365 INFO:teuthology.orchestra.run.smithi086.stdout: debug asserts on shutdown = true 2024-04-25T12:20:24.365 INFO:teuthology.orchestra.run.smithi086.stdout: mon health detail to clog = false 2024-04-25T12:20:24.365 INFO:teuthology.orchestra.run.smithi086.stdout: mon host = "172.21.15.86,172.21.15.134,[v2:172.21.15.134:3301,v1:172.21.15.134:6790]" 2024-04-25T12:20:24.365 INFO:teuthology.orchestra.run.smithi086.stdout: fsid = f2ef5c0c-9576-4650-b4f7-6cb14247f62a 2024-04-25T12:20:24.365 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:20:24.365 INFO:teuthology.orchestra.run.smithi086.stdout:[osd] 2024-04-25T12:20:24.365 INFO:teuthology.orchestra.run.smithi086.stdout: osd journal size = 100 2024-04-25T12:20:24.365 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:20:24.366 INFO:teuthology.orchestra.run.smithi086.stdout: osd scrub load threshold = 5.0 2024-04-25T12:20:24.366 INFO:teuthology.orchestra.run.smithi086.stdout: osd scrub max interval = 600 2024-04-25T12:20:24.366 INFO:teuthology.orchestra.run.smithi086.stdout: osd mclock profile = high_recovery_ops 2024-04-25T12:20:24.366 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:20:24.366 INFO:teuthology.orchestra.run.smithi086.stdout: osd recover clone overlap = true 2024-04-25T12:20:24.366 INFO:teuthology.orchestra.run.smithi086.stdout: osd recovery max chunk = 1048576 2024-04-25T12:20:24.366 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:20:24.366 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug shutdown = true 2024-04-25T12:20:24.366 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug op order = true 2024-04-25T12:20:24.366 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug verify stray on activate = true 2024-04-25T12:20:24.366 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug trim objects = true 2024-04-25T12:20:24.366 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:20:24.367 INFO:teuthology.orchestra.run.smithi086.stdout: osd open classes on start = true 2024-04-25T12:20:24.367 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug pg log writeout = true 2024-04-25T12:20:24.367 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:20:24.367 INFO:teuthology.orchestra.run.smithi086.stdout: osd deep scrub update digest min age = 30 2024-04-25T12:20:24.367 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:20:24.367 INFO:teuthology.orchestra.run.smithi086.stdout: osd map max advance = 10 2024-04-25T12:20:24.367 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:20:24.367 INFO:teuthology.orchestra.run.smithi086.stdout: journal zero on create = true 2024-04-25T12:20:24.367 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:20:24.367 INFO:teuthology.orchestra.run.smithi086.stdout: filestore ondisk finisher threads = 3 2024-04-25T12:20:24.367 INFO:teuthology.orchestra.run.smithi086.stdout: filestore apply finisher threads = 3 2024-04-25T12:20:24.367 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:20:24.367 INFO:teuthology.orchestra.run.smithi086.stdout: bdev debug aio = true 2024-04-25T12:20:24.368 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug misdirected ops = true 2024-04-25T12:20:24.368 INFO:teuthology.orchestra.run.smithi086.stdout: bluestore block size = 96636764160 2024-04-25T12:20:24.368 INFO:teuthology.orchestra.run.smithi086.stdout: bluestore fsck on mount = True 2024-04-25T12:20:24.368 INFO:teuthology.orchestra.run.smithi086.stdout: debug bluefs = 20 2024-04-25T12:20:24.368 INFO:teuthology.orchestra.run.smithi086.stdout: debug bluestore = 20 2024-04-25T12:20:24.368 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2024-04-25T12:20:24.368 INFO:teuthology.orchestra.run.smithi086.stdout: debug osd = 20 2024-04-25T12:20:24.368 INFO:teuthology.orchestra.run.smithi086.stdout: debug rocksdb = 10 2024-04-25T12:20:24.368 INFO:teuthology.orchestra.run.smithi086.stdout: mon client directed command retry = 5 2024-04-25T12:20:24.368 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T12:20:24.368 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd full ratio = 0.9 2024-04-25T12:20:24.368 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd nearfull ratio = 0.8 2024-04-25T12:20:24.368 INFO:teuthology.orchestra.run.smithi086.stdout: ms inject delay max = 1 2024-04-25T12:20:24.369 INFO:teuthology.orchestra.run.smithi086.stdout: ms inject delay probability = 0.005 2024-04-25T12:20:24.369 INFO:teuthology.orchestra.run.smithi086.stdout: ms inject delay type = client mds 2024-04-25T12:20:24.369 INFO:teuthology.orchestra.run.smithi086.stdout: ms inject socket failures = 2500 2024-04-25T12:20:24.369 INFO:teuthology.orchestra.run.smithi086.stdout: osd blocked scrub grace period = 3600 2024-04-25T12:20:24.369 INFO:teuthology.orchestra.run.smithi086.stdout: osd failsafe full ratio = 0.95 2024-04-25T12:20:24.369 INFO:teuthology.orchestra.run.smithi086.stdout: osd max markdown count = 1000 2024-04-25T12:20:24.369 INFO:teuthology.orchestra.run.smithi086.stdout: osd objectstore = bluestore 2024-04-25T12:20:24.369 INFO:teuthology.orchestra.run.smithi086.stdout: osd op complaint time = 180 2024-04-25T12:20:24.369 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:20:24.369 INFO:teuthology.orchestra.run.smithi086.stdout:[mgr] 2024-04-25T12:20:24.369 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2024-04-25T12:20:24.369 INFO:teuthology.orchestra.run.smithi086.stdout: debug mgr = 20 2024-04-25T12:20:24.369 INFO:teuthology.orchestra.run.smithi086.stdout: debug mon = 20 2024-04-25T12:20:24.369 INFO:teuthology.orchestra.run.smithi086.stdout: debug auth = 20 2024-04-25T12:20:24.370 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min pgs per osd = 4 2024-04-25T12:20:24.370 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min bytes per osd = 10 2024-04-25T12:20:24.370 INFO:teuthology.orchestra.run.smithi086.stdout: mgr/telemetry/nag = false 2024-04-25T12:20:24.370 INFO:teuthology.orchestra.run.smithi086.stdout: debug client = 20 2024-04-25T12:20:24.370 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:20:24.370 INFO:teuthology.orchestra.run.smithi086.stdout:[mon] 2024-04-25T12:20:24.370 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2024-04-25T12:20:24.370 INFO:teuthology.orchestra.run.smithi086.stdout: debug mon = 20 2024-04-25T12:20:24.370 INFO:teuthology.orchestra.run.smithi086.stdout: debug paxos = 20 2024-04-25T12:20:24.370 INFO:teuthology.orchestra.run.smithi086.stdout: debug auth = 20 2024-04-25T12:20:24.370 INFO:teuthology.orchestra.run.smithi086.stdout: mon data avail warn = 5 2024-04-25T12:20:24.371 INFO:teuthology.orchestra.run.smithi086.stdout: mon mgr mkfs grace = 240 2024-04-25T12:20:24.371 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min pgs per osd = 4 2024-04-25T12:20:24.371 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd reporter subtree level = osd 2024-04-25T12:20:24.371 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd prime pg temp = true 2024-04-25T12:20:24.371 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min bytes per osd = 10 2024-04-25T12:20:24.371 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:20:24.371 INFO:teuthology.orchestra.run.smithi086.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T12:20:24.371 INFO:teuthology.orchestra.run.smithi086.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T12:20:24.371 INFO:teuthology.orchestra.run.smithi086.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T12:20:24.371 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:20:24.371 INFO:teuthology.orchestra.run.smithi086.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T12:20:24.371 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T12:20:24.371 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T12:20:24.372 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:20:24.372 INFO:teuthology.orchestra.run.smithi086.stdout: # 1m isn't quite enough 2024-04-25T12:20:24.372 INFO:teuthology.orchestra.run.smithi086.stdout: mon_down_mkfs_grace = 2m 2024-04-25T12:20:24.372 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:20:24.372 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_filestore_osds = false 2024-04-25T12:20:24.372 INFO:teuthology.orchestra.run.smithi086.stdout: mon down mkfs grace = 300 2024-04-25T12:20:24.372 INFO:teuthology.orchestra.run.smithi086.stdout: mon op complaint time = 120 2024-04-25T12:20:24.372 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:20:24.372 INFO:teuthology.orchestra.run.smithi086.stdout:[client] 2024-04-25T12:20:24.372 INFO:teuthology.orchestra.run.smithi086.stdout: rgw cache enabled = true 2024-04-25T12:20:24.372 INFO:teuthology.orchestra.run.smithi086.stdout: rgw enable ops log = true 2024-04-25T12:20:24.372 INFO:teuthology.orchestra.run.smithi086.stdout: rgw enable usage log = true 2024-04-25T12:20:24.372 INFO:teuthology.orchestra.run.smithi086.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T12:20:24.372 INFO:teuthology.orchestra.run.smithi086.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T12:20:24.373 INFO:teuthology.orchestra.run.smithi086.stdout: client mount timeout = 600 2024-04-25T12:20:24.373 INFO:teuthology.orchestra.run.smithi086.stdout: client_shutdown_timeout = 120 2024-04-25T12:20:24.373 INFO:teuthology.orchestra.run.smithi086.stdout: debug client = 20 2024-04-25T12:20:24.373 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2024-04-25T12:20:24.373 INFO:teuthology.orchestra.run.smithi086.stdout: rados mon op timeout = 900 2024-04-25T12:20:24.373 INFO:teuthology.orchestra.run.smithi086.stdout: rados osd op timeout = 900 2024-04-25T12:20:24.373 INFO:teuthology.orchestra.run.smithi086.stdout:[mon.a] 2024-04-25T12:20:24.373 INFO:teuthology.orchestra.run.smithi086.stdout:[mon.b] 2024-04-25T12:20:24.373 INFO:teuthology.orchestra.run.smithi086.stdout:[mon.c] 2024-04-25T12:20:24.373 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.a] 2024-04-25T12:20:24.373 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.c] 2024-04-25T12:20:24.373 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.e] 2024-04-25T12:20:24.373 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.b] 2024-04-25T12:20:24.374 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.d] 2024-04-25T12:20:24.374 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.f] 2024-04-25T12:20:24.374 INFO:teuthology.orchestra.run.smithi086.stdout:[mds] 2024-04-25T12:20:24.374 INFO:teuthology.orchestra.run.smithi086.stdout: debug mds = 20 2024-04-25T12:20:24.374 INFO:teuthology.orchestra.run.smithi086.stdout: debug mds balancer = 20 2024-04-25T12:20:24.374 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2024-04-25T12:20:24.374 INFO:teuthology.orchestra.run.smithi086.stdout: mds bal fragment size max = 10000 2024-04-25T12:20:24.374 INFO:teuthology.orchestra.run.smithi086.stdout: mds bal merge size = 5 2024-04-25T12:20:24.374 INFO:teuthology.orchestra.run.smithi086.stdout: mds bal split bits = 3 2024-04-25T12:20:24.374 INFO:teuthology.orchestra.run.smithi086.stdout: mds bal split size = 100 2024-04-25T12:20:24.374 INFO:teuthology.orchestra.run.smithi086.stdout: mds debug frag = True 2024-04-25T12:20:24.374 INFO:teuthology.orchestra.run.smithi086.stdout: mds debug scatterstat = True 2024-04-25T12:20:24.375 INFO:teuthology.orchestra.run.smithi086.stdout: mds oft prefetch dirfrags = True 2024-04-25T12:20:24.375 INFO:teuthology.orchestra.run.smithi086.stdout: mds op complaint time = 180 2024-04-25T12:20:24.375 INFO:teuthology.orchestra.run.smithi086.stdout: mds verify scatter = True 2024-04-25T12:20:24.375 INFO:teuthology.orchestra.run.smithi086.stdout: mds_dir_prefetch = True 2024-04-25T12:20:24.375 INFO:teuthology.orchestra.run.smithi086.stdout: mds_sleep_rank_change = 5000000.0 2024-04-25T12:20:24.375 INFO:teuthology.orchestra.run.smithi086.stdout: mon client directed command retry = 5 2024-04-25T12:20:24.375 INFO:teuthology.orchestra.run.smithi086.stdout: ms inject delay max = 1 2024-04-25T12:20:24.375 INFO:teuthology.orchestra.run.smithi086.stdout: ms inject delay probability = 0.005 2024-04-25T12:20:24.375 INFO:teuthology.orchestra.run.smithi086.stdout: ms inject delay type = client mds osd 2024-04-25T12:20:24.375 INFO:teuthology.orchestra.run.smithi086.stdout: ms inject socket failures = 2500 2024-04-25T12:20:24.375 INFO:teuthology.orchestra.run.smithi086.stdout: osd op complaint time = 180 2024-04-25T12:20:24.375 INFO:teuthology.orchestra.run.smithi086.stdout: rados mon op timeout = 900 2024-04-25T12:20:24.375 INFO:teuthology.orchestra.run.smithi086.stdout: rados osd op timeout = 900 2024-04-25T12:20:24.377 INFO:teuthology.orchestra.run.smithi134.stdout:[global] 2024-04-25T12:20:24.377 INFO:teuthology.orchestra.run.smithi134.stdout: chdir = "" 2024-04-25T12:20:24.377 INFO:teuthology.orchestra.run.smithi134.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T12:20:24.377 INFO:teuthology.orchestra.run.smithi134.stdout: auth supported = cephx 2024-04-25T12:20:24.377 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-25T12:20:24.377 INFO:teuthology.orchestra.run.smithi134.stdout: filestore xattr use omap = true 2024-04-25T12:20:24.378 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-25T12:20:24.378 INFO:teuthology.orchestra.run.smithi134.stdout: mon clock drift allowed = 1.000 2024-04-25T12:20:24.378 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-25T12:20:24.378 INFO:teuthology.orchestra.run.smithi134.stdout: osd crush chooseleaf type = 0 2024-04-25T12:20:24.378 INFO:teuthology.orchestra.run.smithi134.stdout: auth debug = true 2024-04-25T12:20:24.378 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-25T12:20:24.378 INFO:teuthology.orchestra.run.smithi134.stdout: ms die on old message = true 2024-04-25T12:20:24.378 INFO:teuthology.orchestra.run.smithi134.stdout: ms die on bug = true 2024-04-25T12:20:24.378 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-25T12:20:24.378 INFO:teuthology.orchestra.run.smithi134.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T12:20:24.378 INFO:teuthology.orchestra.run.smithi134.stdout: mon pg warn max object skew = 0 2024-04-25T12:20:24.378 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-25T12:20:24.379 INFO:teuthology.orchestra.run.smithi134.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T12:20:24.379 INFO:teuthology.orchestra.run.smithi134.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T12:20:24.379 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-25T12:20:24.379 INFO:teuthology.orchestra.run.smithi134.stdout: osd pool default size = 2 2024-04-25T12:20:24.379 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-25T12:20:24.379 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd allow primary affinity = true 2024-04-25T12:20:24.379 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd allow pg remap = true 2024-04-25T12:20:24.379 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on legacy crush tunables = false 2024-04-25T12:20:24.379 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on crush straw calc version zero = false 2024-04-25T12:20:24.379 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on no sortbitwise = false 2024-04-25T12:20:24.379 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on osd down out interval zero = false 2024-04-25T12:20:24.379 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on too few osds = false 2024-04-25T12:20:24.379 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T12:20:24.380 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T12:20:24.380 INFO:teuthology.orchestra.run.smithi134.stdout: mon_allow_pool_size_one = true 2024-04-25T12:20:24.380 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-25T12:20:24.380 INFO:teuthology.orchestra.run.smithi134.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T12:20:24.380 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-25T12:20:24.380 INFO:teuthology.orchestra.run.smithi134.stdout: osd default data pool replay window = 5 2024-04-25T12:20:24.380 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-25T12:20:24.380 INFO:teuthology.orchestra.run.smithi134.stdout: mon allow pool delete = true 2024-04-25T12:20:24.380 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-25T12:20:24.380 INFO:teuthology.orchestra.run.smithi134.stdout: mon cluster log file level = debug 2024-04-25T12:20:24.380 INFO:teuthology.orchestra.run.smithi134.stdout: debug asserts on shutdown = true 2024-04-25T12:20:24.380 INFO:teuthology.orchestra.run.smithi134.stdout: mon health detail to clog = false 2024-04-25T12:20:24.380 INFO:teuthology.orchestra.run.smithi134.stdout: mon host = "172.21.15.86,172.21.15.134,[v2:172.21.15.134:3301,v1:172.21.15.134:6790]" 2024-04-25T12:20:24.381 INFO:teuthology.orchestra.run.smithi134.stdout: fsid = f2ef5c0c-9576-4650-b4f7-6cb14247f62a 2024-04-25T12:20:24.381 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-25T12:20:24.381 INFO:teuthology.orchestra.run.smithi134.stdout:[osd] 2024-04-25T12:20:24.381 INFO:teuthology.orchestra.run.smithi134.stdout: osd journal size = 100 2024-04-25T12:20:24.381 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-25T12:20:24.381 INFO:teuthology.orchestra.run.smithi134.stdout: osd scrub load threshold = 5.0 2024-04-25T12:20:24.381 INFO:teuthology.orchestra.run.smithi134.stdout: osd scrub max interval = 600 2024-04-25T12:20:24.381 INFO:teuthology.orchestra.run.smithi134.stdout: osd mclock profile = high_recovery_ops 2024-04-25T12:20:24.381 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-25T12:20:24.381 INFO:teuthology.orchestra.run.smithi134.stdout: osd recover clone overlap = true 2024-04-25T12:20:24.381 INFO:teuthology.orchestra.run.smithi134.stdout: osd recovery max chunk = 1048576 2024-04-25T12:20:24.381 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-25T12:20:24.381 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug shutdown = true 2024-04-25T12:20:24.382 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug op order = true 2024-04-25T12:20:24.382 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug verify stray on activate = true 2024-04-25T12:20:24.382 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug trim objects = true 2024-04-25T12:20:24.382 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-25T12:20:24.382 INFO:teuthology.orchestra.run.smithi134.stdout: osd open classes on start = true 2024-04-25T12:20:24.382 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug pg log writeout = true 2024-04-25T12:20:24.382 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-25T12:20:24.382 INFO:teuthology.orchestra.run.smithi134.stdout: osd deep scrub update digest min age = 30 2024-04-25T12:20:24.382 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-25T12:20:24.382 INFO:teuthology.orchestra.run.smithi134.stdout: osd map max advance = 10 2024-04-25T12:20:24.382 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-25T12:20:24.382 INFO:teuthology.orchestra.run.smithi134.stdout: journal zero on create = true 2024-04-25T12:20:24.383 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-25T12:20:24.383 INFO:teuthology.orchestra.run.smithi134.stdout: filestore ondisk finisher threads = 3 2024-04-25T12:20:24.383 INFO:teuthology.orchestra.run.smithi134.stdout: filestore apply finisher threads = 3 2024-04-25T12:20:24.383 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-25T12:20:24.383 INFO:teuthology.orchestra.run.smithi134.stdout: bdev debug aio = true 2024-04-25T12:20:24.383 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug misdirected ops = true 2024-04-25T12:20:24.383 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore block size = 96636764160 2024-04-25T12:20:24.383 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore fsck on mount = True 2024-04-25T12:20:24.383 INFO:teuthology.orchestra.run.smithi134.stdout: debug bluefs = 20 2024-04-25T12:20:24.383 INFO:teuthology.orchestra.run.smithi134.stdout: debug bluestore = 20 2024-04-25T12:20:24.383 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-04-25T12:20:24.383 INFO:teuthology.orchestra.run.smithi134.stdout: debug osd = 20 2024-04-25T12:20:24.384 INFO:teuthology.orchestra.run.smithi134.stdout: debug rocksdb = 10 2024-04-25T12:20:24.384 INFO:teuthology.orchestra.run.smithi134.stdout: mon client directed command retry = 5 2024-04-25T12:20:24.384 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T12:20:24.384 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd full ratio = 0.9 2024-04-25T12:20:24.384 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd nearfull ratio = 0.8 2024-04-25T12:20:24.384 INFO:teuthology.orchestra.run.smithi134.stdout: ms inject delay max = 1 2024-04-25T12:20:24.384 INFO:teuthology.orchestra.run.smithi134.stdout: ms inject delay probability = 0.005 2024-04-25T12:20:24.384 INFO:teuthology.orchestra.run.smithi134.stdout: ms inject delay type = client mds 2024-04-25T12:20:24.384 INFO:teuthology.orchestra.run.smithi134.stdout: ms inject socket failures = 2500 2024-04-25T12:20:24.384 INFO:teuthology.orchestra.run.smithi134.stdout: osd blocked scrub grace period = 3600 2024-04-25T12:20:24.384 INFO:teuthology.orchestra.run.smithi134.stdout: osd failsafe full ratio = 0.95 2024-04-25T12:20:24.384 INFO:teuthology.orchestra.run.smithi134.stdout: osd max markdown count = 1000 2024-04-25T12:20:24.385 INFO:teuthology.orchestra.run.smithi134.stdout: osd objectstore = bluestore 2024-04-25T12:20:24.385 INFO:teuthology.orchestra.run.smithi134.stdout: osd op complaint time = 180 2024-04-25T12:20:24.385 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-25T12:20:24.385 INFO:teuthology.orchestra.run.smithi134.stdout:[mgr] 2024-04-25T12:20:24.385 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-04-25T12:20:24.385 INFO:teuthology.orchestra.run.smithi134.stdout: debug mgr = 20 2024-04-25T12:20:24.385 INFO:teuthology.orchestra.run.smithi134.stdout: debug mon = 20 2024-04-25T12:20:24.385 INFO:teuthology.orchestra.run.smithi134.stdout: debug auth = 20 2024-04-25T12:20:24.385 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min pgs per osd = 4 2024-04-25T12:20:24.385 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min bytes per osd = 10 2024-04-25T12:20:24.385 INFO:teuthology.orchestra.run.smithi134.stdout: mgr/telemetry/nag = false 2024-04-25T12:20:24.385 INFO:teuthology.orchestra.run.smithi134.stdout: debug client = 20 2024-04-25T12:20:24.386 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-25T12:20:24.386 INFO:teuthology.orchestra.run.smithi134.stdout:[mon] 2024-04-25T12:20:24.386 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-04-25T12:20:24.386 INFO:teuthology.orchestra.run.smithi134.stdout: debug mon = 20 2024-04-25T12:20:24.386 INFO:teuthology.orchestra.run.smithi134.stdout: debug paxos = 20 2024-04-25T12:20:24.386 INFO:teuthology.orchestra.run.smithi134.stdout: debug auth = 20 2024-04-25T12:20:24.386 INFO:teuthology.orchestra.run.smithi134.stdout: mon data avail warn = 5 2024-04-25T12:20:24.386 INFO:teuthology.orchestra.run.smithi134.stdout: mon mgr mkfs grace = 240 2024-04-25T12:20:24.386 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min pgs per osd = 4 2024-04-25T12:20:24.386 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd reporter subtree level = osd 2024-04-25T12:20:24.386 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd prime pg temp = true 2024-04-25T12:20:24.386 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min bytes per osd = 10 2024-04-25T12:20:24.386 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-25T12:20:24.387 INFO:teuthology.orchestra.run.smithi134.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T12:20:24.387 INFO:teuthology.orchestra.run.smithi134.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T12:20:24.387 INFO:teuthology.orchestra.run.smithi134.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T12:20:24.387 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-25T12:20:24.387 INFO:teuthology.orchestra.run.smithi134.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T12:20:24.387 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T12:20:24.387 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T12:20:24.387 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-25T12:20:24.387 INFO:teuthology.orchestra.run.smithi134.stdout: # 1m isn't quite enough 2024-04-25T12:20:24.387 INFO:teuthology.orchestra.run.smithi134.stdout: mon_down_mkfs_grace = 2m 2024-04-25T12:20:24.387 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-25T12:20:24.387 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_filestore_osds = false 2024-04-25T12:20:24.388 INFO:teuthology.orchestra.run.smithi134.stdout: mon down mkfs grace = 300 2024-04-25T12:20:24.388 INFO:teuthology.orchestra.run.smithi134.stdout: mon op complaint time = 120 2024-04-25T12:20:24.388 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-25T12:20:24.388 INFO:teuthology.orchestra.run.smithi134.stdout:[client] 2024-04-25T12:20:24.388 INFO:teuthology.orchestra.run.smithi134.stdout: rgw cache enabled = true 2024-04-25T12:20:24.388 INFO:teuthology.orchestra.run.smithi134.stdout: rgw enable ops log = true 2024-04-25T12:20:24.388 INFO:teuthology.orchestra.run.smithi134.stdout: rgw enable usage log = true 2024-04-25T12:20:24.388 INFO:teuthology.orchestra.run.smithi134.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T12:20:24.388 INFO:teuthology.orchestra.run.smithi134.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T12:20:24.388 INFO:teuthology.orchestra.run.smithi134.stdout: client mount timeout = 600 2024-04-25T12:20:24.388 INFO:teuthology.orchestra.run.smithi134.stdout: client_shutdown_timeout = 120 2024-04-25T12:20:24.388 INFO:teuthology.orchestra.run.smithi134.stdout: debug client = 20 2024-04-25T12:20:24.389 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-04-25T12:20:24.389 INFO:teuthology.orchestra.run.smithi134.stdout: rados mon op timeout = 900 2024-04-25T12:20:24.389 INFO:teuthology.orchestra.run.smithi134.stdout: rados osd op timeout = 900 2024-04-25T12:20:24.389 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.a] 2024-04-25T12:20:24.389 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.b] 2024-04-25T12:20:24.389 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.c] 2024-04-25T12:20:24.389 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.a] 2024-04-25T12:20:24.389 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.c] 2024-04-25T12:20:24.389 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.e] 2024-04-25T12:20:24.389 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.b] 2024-04-25T12:20:24.389 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.d] 2024-04-25T12:20:24.389 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.f] 2024-04-25T12:20:24.389 INFO:teuthology.orchestra.run.smithi134.stdout:[mds] 2024-04-25T12:20:24.390 INFO:teuthology.orchestra.run.smithi134.stdout: debug mds = 20 2024-04-25T12:20:24.390 INFO:teuthology.orchestra.run.smithi134.stdout: debug mds balancer = 20 2024-04-25T12:20:24.390 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-04-25T12:20:24.390 INFO:teuthology.orchestra.run.smithi134.stdout: mds bal fragment size max = 10000 2024-04-25T12:20:24.390 INFO:teuthology.orchestra.run.smithi134.stdout: mds bal merge size = 5 2024-04-25T12:20:24.390 INFO:teuthology.orchestra.run.smithi134.stdout: mds bal split bits = 3 2024-04-25T12:20:24.390 INFO:teuthology.orchestra.run.smithi134.stdout: mds bal split size = 100 2024-04-25T12:20:24.390 INFO:teuthology.orchestra.run.smithi134.stdout: mds debug frag = True 2024-04-25T12:20:24.390 INFO:teuthology.orchestra.run.smithi134.stdout: mds debug scatterstat = True 2024-04-25T12:20:24.390 INFO:teuthology.orchestra.run.smithi134.stdout: mds oft prefetch dirfrags = True 2024-04-25T12:20:24.390 INFO:teuthology.orchestra.run.smithi134.stdout: mds op complaint time = 180 2024-04-25T12:20:24.390 INFO:teuthology.orchestra.run.smithi134.stdout: mds verify scatter = True 2024-04-25T12:20:24.391 INFO:teuthology.orchestra.run.smithi134.stdout: mds_dir_prefetch = True 2024-04-25T12:20:24.391 INFO:teuthology.orchestra.run.smithi134.stdout: mds_sleep_rank_change = 5000000.0 2024-04-25T12:20:24.391 INFO:teuthology.orchestra.run.smithi134.stdout: mon client directed command retry = 5 2024-04-25T12:20:24.391 INFO:teuthology.orchestra.run.smithi134.stdout: ms inject delay max = 1 2024-04-25T12:20:24.391 INFO:teuthology.orchestra.run.smithi134.stdout: ms inject delay probability = 0.005 2024-04-25T12:20:24.391 INFO:teuthology.orchestra.run.smithi134.stdout: ms inject delay type = client mds osd 2024-04-25T12:20:24.391 INFO:teuthology.orchestra.run.smithi134.stdout: ms inject socket failures = 2500 2024-04-25T12:20:24.391 INFO:teuthology.orchestra.run.smithi134.stdout: osd op complaint time = 180 2024-04-25T12:20:24.391 INFO:teuthology.orchestra.run.smithi134.stdout: rados mon op timeout = 900 2024-04-25T12:20:24.391 INFO:teuthology.orchestra.run.smithi134.stdout: rados osd op timeout = 900 2024-04-25T12:20:24.391 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-25T12:20:24.392 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-25T12:20:24.468 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-25T12:20:24.468 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-04-25T12:20:24.468 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-25T12:20:24.473 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-04-25T12:20:24.473 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-25T12:20:24.521 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi086.front.sepia.ceph.com 2024-04-25T12:20:24.521 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-04-25T12:20:24.521 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T12:20:24.521 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T12:20:24.584 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-04-25T12:20:24.584 DEBUG:teuthology.orchestra.run.smithi086:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T12:20:24.633 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi134.front.sepia.ceph.com 2024-04-25T12:20:24.634 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-25T12:20:24.634 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T12:20:24.634 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T12:20:24.658 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-25T12:20:24.658 DEBUG:teuthology.orchestra.run.smithi134:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T12:20:24.707 INFO:tasks.ceph:Setting up mon nodes... 2024-04-25T12:20:24.707 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-25T12:20:24.707 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-25T12:20:24.750 INFO:teuthology.orchestra.run.smithi086.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-25T12:20:24.752 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T12:20:24.796 INFO:teuthology.orchestra.run.smithi134.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T12:20:24.813 INFO:tasks.ceph:Setting up mds nodes... 2024-04-25T12:20:24.814 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T12:20:24.852 INFO:teuthology.orchestra.run.smithi086.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T12:20:24.854 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-25T12:20:24.908 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-25T12:20:24.986 INFO:teuthology.orchestra.run.smithi086.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-25T12:20:24.988 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-25T12:20:25.044 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-04-25T12:20:25.129 INFO:teuthology.orchestra.run.smithi086.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-04-25T12:20:25.132 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-04-25T12:20:25.183 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-25T12:20:25.227 INFO:teuthology.orchestra.run.smithi134.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-25T12:20:25.230 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-25T12:20:25.286 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-25T12:20:25.370 INFO:teuthology.orchestra.run.smithi134.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-25T12:20:25.372 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-25T12:20:25.425 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-04-25T12:20:25.507 INFO:teuthology.orchestra.run.smithi134.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-04-25T12:20:25.509 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-04-25T12:20:25.562 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-25T12:20:25.562 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-25T12:20:25.598 INFO:teuthology.orchestra.run.smithi086.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-25T12:20:25.611 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-25T12:20:25.611 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi086.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi134.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-25T12:20:25.611 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-25T12:20:25.664 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T12:20:25.664 INFO:tasks.ceph:role: osd.0 2024-04-25T12:20:25.664 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi086.front.sepia.ceph.com 2024-04-25T12:20:25.664 DEBUG:teuthology.orchestra.run.smithi086:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T12:20:25.728 INFO:teuthology.orchestra.run.smithi086.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T12:20:25.728 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T12:20:25.728 INFO:teuthology.orchestra.run.smithi086.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T12:20:25.728 INFO:teuthology.orchestra.run.smithi086.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T12:20:25.728 INFO:teuthology.orchestra.run.smithi086.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T12:20:25.728 INFO:teuthology.orchestra.run.smithi086.stdout: = sunit=0 swidth=0 blks 2024-04-25T12:20:25.729 INFO:teuthology.orchestra.run.smithi086.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T12:20:25.729 INFO:teuthology.orchestra.run.smithi086.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T12:20:25.729 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T12:20:25.729 INFO:teuthology.orchestra.run.smithi086.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T12:20:26.220 INFO:teuthology.orchestra.run.smithi086.stdout:Discarding blocks...Done. 2024-04-25T12:20:26.222 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi086.front.sepia.ceph.com -o noatime 2024-04-25T12:20:26.222 DEBUG:teuthology.orchestra.run.smithi086:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-25T12:20:26.354 DEBUG:teuthology.orchestra.run.smithi086:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-25T12:20:26.365 INFO:teuthology.orchestra.run.smithi086.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T12:20:26.366 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T12:20:26.366 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-25T12:20:26.421 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T12:20:26.421 INFO:tasks.ceph:role: osd.1 2024-04-25T12:20:26.421 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi086.front.sepia.ceph.com 2024-04-25T12:20:26.421 DEBUG:teuthology.orchestra.run.smithi086:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-25T12:20:26.485 INFO:teuthology.orchestra.run.smithi086.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T12:20:26.485 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T12:20:26.485 INFO:teuthology.orchestra.run.smithi086.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T12:20:26.485 INFO:teuthology.orchestra.run.smithi086.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T12:20:26.485 INFO:teuthology.orchestra.run.smithi086.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T12:20:26.485 INFO:teuthology.orchestra.run.smithi086.stdout: = sunit=0 swidth=0 blks 2024-04-25T12:20:26.485 INFO:teuthology.orchestra.run.smithi086.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T12:20:26.485 INFO:teuthology.orchestra.run.smithi086.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T12:20:26.486 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T12:20:26.486 INFO:teuthology.orchestra.run.smithi086.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T12:20:26.937 INFO:teuthology.orchestra.run.smithi086.stdout:Discarding blocks...Done. 2024-04-25T12:20:26.940 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi086.front.sepia.ceph.com -o noatime 2024-04-25T12:20:26.940 DEBUG:teuthology.orchestra.run.smithi086:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-25T12:20:27.033 DEBUG:teuthology.orchestra.run.smithi086:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-25T12:20:27.044 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T12:20:27.044 INFO:teuthology.orchestra.run.smithi086.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T12:20:27.045 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-25T12:20:27.100 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T12:20:27.100 INFO:tasks.ceph:role: osd.2 2024-04-25T12:20:27.100 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi086.front.sepia.ceph.com 2024-04-25T12:20:27.100 DEBUG:teuthology.orchestra.run.smithi086:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-25T12:20:27.165 INFO:teuthology.orchestra.run.smithi086.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T12:20:27.165 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T12:20:27.165 INFO:teuthology.orchestra.run.smithi086.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T12:20:27.165 INFO:teuthology.orchestra.run.smithi086.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T12:20:27.165 INFO:teuthology.orchestra.run.smithi086.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T12:20:27.165 INFO:teuthology.orchestra.run.smithi086.stdout: = sunit=0 swidth=0 blks 2024-04-25T12:20:27.165 INFO:teuthology.orchestra.run.smithi086.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T12:20:27.166 INFO:teuthology.orchestra.run.smithi086.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T12:20:27.166 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T12:20:27.166 INFO:teuthology.orchestra.run.smithi086.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T12:20:27.629 INFO:teuthology.orchestra.run.smithi086.stdout:Discarding blocks...Done. 2024-04-25T12:20:27.631 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi086.front.sepia.ceph.com -o noatime 2024-04-25T12:20:27.631 DEBUG:teuthology.orchestra.run.smithi086:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-25T12:20:27.708 DEBUG:teuthology.orchestra.run.smithi086:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-25T12:20:27.761 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T12:20:27.762 INFO:teuthology.orchestra.run.smithi086.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T12:20:27.762 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-25T12:20:27.814 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T12:20:27.814 INFO:tasks.ceph:role: osd.3 2024-04-25T12:20:27.815 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi086.front.sepia.ceph.com 2024-04-25T12:20:27.815 DEBUG:teuthology.orchestra.run.smithi086:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-25T12:20:27.876 INFO:teuthology.orchestra.run.smithi086.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T12:20:27.876 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T12:20:27.876 INFO:teuthology.orchestra.run.smithi086.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T12:20:27.877 INFO:teuthology.orchestra.run.smithi086.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T12:20:27.877 INFO:teuthology.orchestra.run.smithi086.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T12:20:27.877 INFO:teuthology.orchestra.run.smithi086.stdout: = sunit=0 swidth=0 blks 2024-04-25T12:20:27.877 INFO:teuthology.orchestra.run.smithi086.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T12:20:27.877 INFO:teuthology.orchestra.run.smithi086.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T12:20:27.877 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T12:20:27.877 INFO:teuthology.orchestra.run.smithi086.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T12:20:28.379 INFO:teuthology.orchestra.run.smithi086.stdout:Discarding blocks...Done. 2024-04-25T12:20:28.381 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi086.front.sepia.ceph.com -o noatime 2024-04-25T12:20:28.382 DEBUG:teuthology.orchestra.run.smithi086:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-25T12:20:28.535 DEBUG:teuthology.orchestra.run.smithi086:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-25T12:20:28.547 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T12:20:28.548 INFO:teuthology.orchestra.run.smithi086.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T12:20:28.548 DEBUG:teuthology.orchestra.run.smithi086:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T12:20:28.658 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:28.655+0000 7fe8d3f777c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-25T12:20:28.664 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:28.659+0000 7fe8d3f777c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-25T12:20:28.664 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:28.659+0000 7fe8d3f777c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T12:20:28.664 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:28.659+0000 7fe8d3f777c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T12:20:28.664 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:28.659+0000 7fe8d3f777c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T12:20:28.669 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:28.667+0000 7fe8d3f777c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-25T12:20:31.645 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-25T12:20:31.658 DEBUG:teuthology.orchestra.run.smithi086:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T12:20:31.739 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:31.735+0000 7f47707a47c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-25T12:20:31.740 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:31.735+0000 7f47707a47c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-25T12:20:31.740 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:31.735+0000 7f47707a47c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T12:20:31.740 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:31.735+0000 7f47707a47c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T12:20:31.740 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:31.735+0000 7f47707a47c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T12:20:31.741 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:31.739+0000 7f47707a47c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-25T12:20:34.715 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-25T12:20:34.774 DEBUG:teuthology.orchestra.run.smithi086:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T12:20:34.854 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:34.851+0000 7f84222917c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-25T12:20:34.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:34.851+0000 7f84222917c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-25T12:20:34.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:34.851+0000 7f84222917c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T12:20:34.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:34.851+0000 7f84222917c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T12:20:34.856 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:34.851+0000 7f84222917c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T12:20:34.856 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:34.851+0000 7f84222917c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-25T12:20:37.837 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-25T12:20:37.893 DEBUG:teuthology.orchestra.run.smithi086:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T12:20:37.976 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:37.970+0000 7fa7cc2c37c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-25T12:20:37.977 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:37.974+0000 7fa7cc2c37c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-25T12:20:37.977 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:37.974+0000 7fa7cc2c37c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T12:20:37.977 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:37.974+0000 7fa7cc2c37c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T12:20:37.977 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:37.974+0000 7fa7cc2c37c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T12:20:37.977 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:37.974+0000 7fa7cc2c37c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-25T12:20:40.959 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-25T12:20:41.014 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-25T12:20:41.029 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T12:20:41.029 INFO:tasks.ceph:role: osd.4 2024-04-25T12:20:41.029 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi134.front.sepia.ceph.com 2024-04-25T12:20:41.030 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T12:20:41.091 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T12:20:41.091 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T12:20:41.091 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T12:20:41.091 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T12:20:41.091 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T12:20:41.091 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2024-04-25T12:20:41.091 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T12:20:41.091 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T12:20:41.091 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T12:20:41.091 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T12:20:41.547 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2024-04-25T12:20:41.547 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2024-04-25T12:20:41.547 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-25T12:20:41.645 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-25T12:20:41.654 INFO:teuthology.orchestra.run.smithi134.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T12:20:41.655 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T12:20:41.655 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-25T12:20:41.709 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T12:20:41.710 INFO:tasks.ceph:role: osd.5 2024-04-25T12:20:41.710 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi134.front.sepia.ceph.com 2024-04-25T12:20:41.710 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-25T12:20:41.776 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T12:20:41.776 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T12:20:41.776 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T12:20:41.776 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T12:20:41.776 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T12:20:41.776 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2024-04-25T12:20:41.776 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T12:20:41.776 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T12:20:41.777 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T12:20:41.777 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T12:20:42.242 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2024-04-25T12:20:42.244 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2024-04-25T12:20:42.244 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-25T12:20:42.394 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-25T12:20:42.405 INFO:teuthology.orchestra.run.smithi134.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T12:20:42.406 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T12:20:42.406 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-25T12:20:42.462 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T12:20:42.462 INFO:tasks.ceph:role: osd.6 2024-04-25T12:20:42.462 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi134.front.sepia.ceph.com 2024-04-25T12:20:42.462 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-25T12:20:42.526 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T12:20:42.526 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T12:20:42.527 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T12:20:42.527 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T12:20:42.527 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T12:20:42.527 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2024-04-25T12:20:42.527 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T12:20:42.527 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T12:20:42.527 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T12:20:42.527 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T12:20:42.985 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2024-04-25T12:20:42.987 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2024-04-25T12:20:42.987 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-25T12:20:43.129 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-25T12:20:43.139 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T12:20:43.140 INFO:teuthology.orchestra.run.smithi134.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T12:20:43.140 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-25T12:20:43.194 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T12:20:43.194 INFO:tasks.ceph:role: osd.7 2024-04-25T12:20:43.194 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi134.front.sepia.ceph.com 2024-04-25T12:20:43.195 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-25T12:20:43.257 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T12:20:43.257 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T12:20:43.258 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T12:20:43.258 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T12:20:43.258 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T12:20:43.258 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2024-04-25T12:20:43.258 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T12:20:43.258 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T12:20:43.258 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T12:20:43.258 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T12:20:43.678 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2024-04-25T12:20:43.680 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2024-04-25T12:20:43.680 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-25T12:20:43.779 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-25T12:20:43.789 INFO:teuthology.orchestra.run.smithi134.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T12:20:43.789 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T12:20:43.790 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T12:20:43.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:43.894+0000 7fa3b910d7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-25T12:20:43.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:43.902+0000 7fa3b910d7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-25T12:20:43.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:43.902+0000 7fa3b910d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T12:20:43.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:43.902+0000 7fa3b910d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T12:20:43.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:43.902+0000 7fa3b910d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T12:20:43.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:43.902+0000 7fa3b910d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-25T12:20:46.888 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-25T12:20:46.902 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T12:20:46.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:46.981+0000 7f5a1f16e7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-25T12:20:46.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:46.981+0000 7f5a1f16e7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-25T12:20:46.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:46.981+0000 7f5a1f16e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T12:20:46.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:46.981+0000 7f5a1f16e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T12:20:46.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:46.981+0000 7f5a1f16e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T12:20:46.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:46.985+0000 7f5a1f16e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-25T12:20:49.958 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-25T12:20:50.012 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T12:20:50.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:50.089+0000 7fe74fcf67c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-25T12:20:50.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:50.089+0000 7fe74fcf67c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-25T12:20:50.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:50.089+0000 7fe74fcf67c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T12:20:50.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:50.089+0000 7fe74fcf67c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T12:20:50.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:50.089+0000 7fe74fcf67c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T12:20:50.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:50.089+0000 7fe74fcf67c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-25T12:20:52.597 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T12:20:52.600 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T12:20:53.055 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-25T12:20:53.068 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T12:20:53.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:53.149+0000 7fe75dc217c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-25T12:20:53.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:53.149+0000 7fe75dc217c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-25T12:20:53.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:53.153+0000 7fe75dc217c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T12:20:53.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:53.153+0000 7fe75dc217c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T12:20:53.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:53.153+0000 7fe75dc217c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T12:20:53.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:53.153+0000 7fe75dc217c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-25T12:20:56.126 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-25T12:20:56.180 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-25T12:20:56.180 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-04-25T12:20:56.180 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-25T12:20:56.194 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-04-25T12:20:56.194 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-25T12:20:56.249 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-04-25T12:20:56.249 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-25T12:20:56.305 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-04-25T12:20:56.305 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-04-25T12:20:56.360 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-04-25T12:20:56.361 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-25T12:20:56.413 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-04-25T12:20:56.413 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-25T12:20:56.468 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-04-25T12:20:56.469 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-25T12:20:56.521 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-04-25T12:20:56.521 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-25T12:20:56.577 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-25T12:20:56.577 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-25T12:20:56.590 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-25T12:20:56.590 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-25T12:20:56.642 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-25T12:20:56.642 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-25T12:20:56.694 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-25T12:20:56.694 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-04-25T12:20:56.747 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-25T12:20:56.747 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-25T12:20:56.803 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-25T12:20:56.803 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-25T12:20:56.858 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-25T12:20:56.858 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-25T12:20:56.911 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-25T12:20:56.911 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-25T12:20:56.966 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-04-25T12:20:56.966 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-25T12:20:56.972 INFO:tasks.ceph:Adding keys to all mons... 2024-04-25T12:20:56.972 DEBUG:teuthology.orchestra.run.smithi086:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T12:20:57.015 DEBUG:teuthology.orchestra.run.smithi134:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T12:20:57.024 INFO:teuthology.orchestra.run.smithi086.stdout:[mgr.y] 2024-04-25T12:20:57.025 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQCISipmurfOLBAAjZt3yqDwySyac9/gPq9Png== 2024-04-25T12:20:57.025 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.a] 2024-04-25T12:20:57.025 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQCISipmS77jMhAA5BWBfOCqEXFTnf9jmnC+ow== 2024-04-25T12:20:57.025 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.c] 2024-04-25T12:20:57.025 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQCISipmZgXjOhAAtbV0SGQrvJ5RpheLLXm9vA== 2024-04-25T12:20:57.025 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.e] 2024-04-25T12:20:57.025 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQCJSipm1lrOBxAAolKpyMOZbG1eULz8WxkF2w== 2024-04-25T12:20:57.025 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.0] 2024-04-25T12:20:57.025 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQCMSipmHr9cJxAA/wpluDPIAQCOiUZNsBIVYQ== 2024-04-25T12:20:57.025 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.1] 2024-04-25T12:20:57.025 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQCPSipmGywxLBAAaA+NB2WXgi9TyPdDdbWJLA== 2024-04-25T12:20:57.025 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.2] 2024-04-25T12:20:57.026 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQCSSipmv5IRMxAAQPhOepgnnGTJQVB701DPuw== 2024-04-25T12:20:57.026 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.3] 2024-04-25T12:20:57.026 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQCVSipmzURMOhAAFua8fFP8JZP1aj89kA8mKA== 2024-04-25T12:20:57.026 INFO:teuthology.orchestra.run.smithi086.stdout:[mgr.x] 2024-04-25T12:20:57.026 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQCISipmlkaYLxAAwjd7KQvvTGKAHnNGPodOEw== 2024-04-25T12:20:57.026 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.b] 2024-04-25T12:20:57.026 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQCJSipm6fyuDRAAd7BmHhIGH4kxytfArOOW3w== 2024-04-25T12:20:57.026 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.d] 2024-04-25T12:20:57.026 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQCJSipm414zFhAA4Fjs2WHFSz75VqYlWJ5Ujw== 2024-04-25T12:20:57.026 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.f] 2024-04-25T12:20:57.026 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQCJSipmKsZZHhAAvqVGxL6q2e2a+eU25YdI+g== 2024-04-25T12:20:57.026 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.4] 2024-04-25T12:20:57.026 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQCbSipmyV6aNRAASXrq/fL5Po1v8J5RBDM3tA== 2024-04-25T12:20:57.026 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.5] 2024-04-25T12:20:57.027 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQCeSipmNqbZOhAASo9RP8UKNTgLQYFmxgmwnw== 2024-04-25T12:20:57.027 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.6] 2024-04-25T12:20:57.027 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQCiSipmyKuaBRAAbzfjHFleGnnk1+ndoWa00Q== 2024-04-25T12:20:57.027 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.7] 2024-04-25T12:20:57.027 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQClSipm4GBFCRAAqq4hfeGM+obRWKmVI2Y+Hg== 2024-04-25T12:20:57.027 INFO:teuthology.orchestra.run.smithi086.stdout:[client.0] 2024-04-25T12:20:57.027 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQCJSipmZDbFIxAAUUAI5QmxTfoHrP9CJT8gNw== 2024-04-25T12:20:57.028 INFO:teuthology.orchestra.run.smithi134.stdout:[mgr.y] 2024-04-25T12:20:57.028 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCISipmurfOLBAAjZt3yqDwySyac9/gPq9Png== 2024-04-25T12:20:57.029 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.a] 2024-04-25T12:20:57.029 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCISipmS77jMhAA5BWBfOCqEXFTnf9jmnC+ow== 2024-04-25T12:20:57.029 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.c] 2024-04-25T12:20:57.029 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCISipmZgXjOhAAtbV0SGQrvJ5RpheLLXm9vA== 2024-04-25T12:20:57.029 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.e] 2024-04-25T12:20:57.029 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCJSipm1lrOBxAAolKpyMOZbG1eULz8WxkF2w== 2024-04-25T12:20:57.029 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.0] 2024-04-25T12:20:57.029 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCMSipmHr9cJxAA/wpluDPIAQCOiUZNsBIVYQ== 2024-04-25T12:20:57.029 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.1] 2024-04-25T12:20:57.029 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCPSipmGywxLBAAaA+NB2WXgi9TyPdDdbWJLA== 2024-04-25T12:20:57.029 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.2] 2024-04-25T12:20:57.029 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCSSipmv5IRMxAAQPhOepgnnGTJQVB701DPuw== 2024-04-25T12:20:57.029 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.3] 2024-04-25T12:20:57.029 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCVSipmzURMOhAAFua8fFP8JZP1aj89kA8mKA== 2024-04-25T12:20:57.029 INFO:teuthology.orchestra.run.smithi134.stdout:[mgr.x] 2024-04-25T12:20:57.030 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCISipmlkaYLxAAwjd7KQvvTGKAHnNGPodOEw== 2024-04-25T12:20:57.030 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.b] 2024-04-25T12:20:57.030 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCJSipm6fyuDRAAd7BmHhIGH4kxytfArOOW3w== 2024-04-25T12:20:57.030 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.d] 2024-04-25T12:20:57.030 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCJSipm414zFhAA4Fjs2WHFSz75VqYlWJ5Ujw== 2024-04-25T12:20:57.030 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.f] 2024-04-25T12:20:57.030 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCJSipmKsZZHhAAvqVGxL6q2e2a+eU25YdI+g== 2024-04-25T12:20:57.030 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.4] 2024-04-25T12:20:57.030 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCbSipmyV6aNRAASXrq/fL5Po1v8J5RBDM3tA== 2024-04-25T12:20:57.030 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.5] 2024-04-25T12:20:57.030 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCeSipmNqbZOhAASo9RP8UKNTgLQYFmxgmwnw== 2024-04-25T12:20:57.030 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.6] 2024-04-25T12:20:57.030 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCiSipmyKuaBRAAbzfjHFleGnnk1+ndoWa00Q== 2024-04-25T12:20:57.030 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.7] 2024-04-25T12:20:57.030 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQClSipm4GBFCRAAqq4hfeGM+obRWKmVI2Y+Hg== 2024-04-25T12:20:57.031 INFO:teuthology.orchestra.run.smithi134.stdout:[client.0] 2024-04-25T12:20:57.031 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCJSipmZDbFIxAAUUAI5QmxTfoHrP9CJT8gNw== 2024-04-25T12:20:57.031 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T12:20:57.071 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T12:20:57.117 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T12:20:57.159 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T12:20:57.207 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T12:20:57.209 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T12:20:57.255 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T12:20:57.291 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T12:20:57.342 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T12:20:57.376 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T12:20:57.427 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T12:20:57.459 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T12:20:57.505 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T12:20:57.543 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T12:20:57.589 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T12:20:57.623 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T12:20:57.673 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T12:20:57.707 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T12:20:57.757 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T12:20:57.759 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T12:20:57.842 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T12:20:57.844 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T12:20:57.930 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T12:20:57.932 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T12:20:58.013 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T12:20:58.019 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T12:20:58.096 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T12:20:58.099 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T12:20:58.178 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T12:20:58.180 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T12:20:58.259 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T12:20:58.263 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T12:20:58.341 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T12:20:58.351 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T12:20:58.429 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-25T12:20:58.430 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-25T12:20:58.442 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T12:20:58.534 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-25T12:20:58.545 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-25T12:20:58.557 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T12:20:58.655 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-25T12:20:58.666 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-25T12:20:58.717 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T12:20:58.808 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-25T12:20:58.818 DEBUG:teuthology.orchestra.run.smithi086:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T12:20:58.821 DEBUG:teuthology.orchestra.run.smithi134:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T12:20:58.867 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-25T12:20:58.867 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-25T12:20:58.867 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-25T12:20:58.870 INFO:tasks.ceph.mon.a:Started 2024-04-25T12:20:58.870 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-25T12:20:58.870 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-25T12:20:58.916 INFO:tasks.ceph.mon.b:Started 2024-04-25T12:20:58.917 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-25T12:20:58.917 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-25T12:20:58.919 INFO:tasks.ceph.mon.c:Started 2024-04-25T12:20:58.919 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-25T12:20:58.919 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-25T12:20:58.919 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-25T12:20:58.921 INFO:tasks.ceph.mgr.y:Started 2024-04-25T12:20:58.922 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-25T12:20:58.922 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-25T12:20:58.924 INFO:tasks.ceph.mgr.x:Started 2024-04-25T12:20:58.924 INFO:tasks.ceph:Setting crush tunables to default 2024-04-25T12:20:58.924 DEBUG:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph osd crush tunables default 2024-04-25T12:20:59.036 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.033+0000 7f76f7529640 1 Processor -- start 2024-04-25T12:20:59.037 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.033+0000 7f76f7529640 1 -- start start 2024-04-25T12:20:59.037 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.033+0000 7f76f7529640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f76f0152240 0x7f76f00c25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:20:59.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.033+0000 7f76f7529640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76f0073d80 con 0x7f76f0067a90 2024-04-25T12:20:59.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.033+0000 7f76f7529640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76f00c22f0 con 0x7f76f0158870 2024-04-25T12:20:59.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.033+0000 7f76f7529640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f76f00734e0 con 0x7f76f0152240 2024-04-25T12:20:59.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.033+0000 7f76f4ac4640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f76f0067a90 0x7f76f0158160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:41412/0 (socket says 172.21.15.86:41412) 2024-04-25T12:20:59.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.033+0000 7f76f4ac4640 1 -- 172.21.15.86:0/3634416868 learned_addr learned my addr 172.21.15.86:0/3634416868 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-04-25T12:20:59.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.033+0000 7f76f52c5640 1 --2- 172.21.15.86:0/3634416868 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f76f0152240 0x7f76f00c25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:20:59.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.037+0000 7f76f52c5640 1 -- 172.21.15.86:0/3634416868 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f76f0152240 msgr2=0x7f76f00c25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T12:20:59.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.037+0000 7f76f52c5640 1 -- 172.21.15.86:0/3634416868 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f76f0152240 msgr2=0x7f76f00c25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T12:20:59.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.037+0000 7f76f52c5640 1 --2- 172.21.15.86:0/3634416868 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f76f0152240 0x7f76f00c25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T12:20:59.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.037+0000 7f76f52c5640 1 --2- 172.21.15.86:0/3634416868 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f76f0152240 0x7f76f00c25d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T12:20:59.242 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.241+0000 7f76f52c5640 1 --2- 172.21.15.86:0/3634416868 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f76f0152240 0x7f76f00c25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:20:59.243 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.241+0000 7f76f52c5640 1 -- 172.21.15.86:0/3634416868 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f76f0152240 msgr2=0x7f76f00c25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T12:20:59.243 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.241+0000 7f76f52c5640 1 -- 172.21.15.86:0/3634416868 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f76f0152240 msgr2=0x7f76f00c25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T12:20:59.243 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.241+0000 7f76f52c5640 1 --2- 172.21.15.86:0/3634416868 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f76f0152240 0x7f76f00c25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T12:20:59.243 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.241+0000 7f76f52c5640 1 --2- 172.21.15.86:0/3634416868 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f76f0152240 0x7f76f00c25d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T12:20:59.272 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.269+0000 7f76e7fff640 1 -- 172.21.15.86:0/3634416868 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2474785678 0 0) 0x7f76f0073d80 con 0x7f76f0067a90 2024-04-25T12:20:59.272 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.269+0000 7f76e7fff640 1 -- 172.21.15.86:0/3634416868 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76dc003530 con 0x7f76f0067a90 2024-04-25T12:20:59.273 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.269+0000 7f76e7fff640 1 -- 172.21.15.86:0/3634416868 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1758701153 0 0) 0x7f76f00c22f0 con 0x7f76f0158870 2024-04-25T12:20:59.273 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.269+0000 7f76e7fff640 1 -- 172.21.15.86:0/3634416868 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76f0073d80 con 0x7f76f0158870 2024-04-25T12:20:59.274 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.269+0000 7f76e7fff640 1 -- 172.21.15.86:0/3634416868 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1182744749 0 0) 0x7f76dc003530 con 0x7f76f0067a90 2024-04-25T12:20:59.275 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.269+0000 7f76e7fff640 1 -- 172.21.15.86:0/3634416868 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f76f0152240 msgr2=0x7f76f00c25d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T12:20:59.275 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.269+0000 7f76e7fff640 1 --2- 172.21.15.86:0/3634416868 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f76f0152240 0x7f76f00c25d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:20:59.275 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.269+0000 7f76e7fff640 1 -- 172.21.15.86:0/3634416868 >> v1:172.21.15.134:6789/0 conn(0x7f76f0158870 legacy=0x7f76f01626b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:20:59.275 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.269+0000 7f76e7fff640 1 -- 172.21.15.86:0/3634416868 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76f00737c0 con 0x7f76f0067a90 2024-04-25T12:20:59.275 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.269+0000 7f76e7fff640 1 -- 172.21.15.86:0/3634416868 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1387950573 0 0) 0x7f76ec001680 con 0x7f76f0067a90 2024-04-25T12:20:59.275 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.269+0000 7f76e7fff640 1 -- 172.21.15.86:0/3634416868 >> v1:172.21.15.86:6789/0 conn(0x7f76f0067a90 legacy=0x7f76f0158160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:20:59.275 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.273+0000 7f76e7fff640 1 --2- 172.21.15.86:0/3634416868 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76dc003b80 0x7f76dc003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:20:59.275 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.273+0000 7f76e7fff640 1 --2- 172.21.15.86:0/3634416868 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76dc004810 0x7f76dc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:20:59.275 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.273+0000 7f76e7fff640 1 --2- 172.21.15.86:0/3634416868 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f76f0152240 0x7f76dc0051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:20:59.275 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.273+0000 7f76e7fff640 1 -- 172.21.15.86:0/3634416868 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f76f00734e0 con 0x7f76dc004810 2024-04-25T12:20:59.275 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.273+0000 7f76e7fff640 1 -- 172.21.15.86:0/3634416868 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f76dc00bae0 con 0x7f76dc003b80 2024-04-25T12:20:59.275 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.273+0000 7f76e7fff640 1 -- 172.21.15.86:0/3634416868 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f76dc00bce0 con 0x7f76f0152240 2024-04-25T12:20:59.275 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.273+0000 7f76f4ac4640 1 --2- 172.21.15.86:0/3634416868 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76dc004810 0x7f76dc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:20:59.276 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.273+0000 7f76f52c5640 1 --2- 172.21.15.86:0/3634416868 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76dc003b80 0x7f76dc003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:20:59.276 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.273+0000 7f76f5ac6640 1 --2- 172.21.15.86:0/3634416868 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f76f0152240 0x7f76dc0051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:20:59.276 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.273+0000 7f76f4ac4640 1 -- 172.21.15.86:0/3634416868 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f76f0152240 msgr2=0x7f76dc0051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:20:59.276 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.273+0000 7f76f4ac4640 1 --2- 172.21.15.86:0/3634416868 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f76f0152240 0x7f76dc0051f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:20:59.276 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.273+0000 7f76f4ac4640 1 -- 172.21.15.86:0/3634416868 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76dc003b80 msgr2=0x7f76dc003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:20:59.276 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.273+0000 7f76f4ac4640 1 --2- 172.21.15.86:0/3634416868 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76dc003b80 0x7f76dc003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:20:59.276 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.273+0000 7f76f4ac4640 1 -- 172.21.15.86:0/3634416868 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76dc003530 con 0x7f76dc004810 2024-04-25T12:20:59.277 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.273+0000 7f76f5ac6640 1 --2- 172.21.15.86:0/3634416868 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f76f0152240 0x7f76dc0051f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:20:59.283 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.281+0000 7f76f4ac4640 1 --2- 172.21.15.86:0/3634416868 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76dc004810 0x7f76dc004c90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f76ec00c190 tx=0x7f76ec01f350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d5ec64abcdf7b86 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:20:59.284 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.281+0000 7f76e7fff640 1 -- 172.21.15.86:0/3634416868 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76ec007cd0 con 0x7f76dc004810 2024-04-25T12:20:59.284 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.281+0000 7f76e7fff640 1 -- 172.21.15.86:0/3634416868 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76ec005b00 con 0x7f76dc004810 2024-04-25T12:20:59.284 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.281+0000 7f76e7fff640 1 -- 172.21.15.86:0/3634416868 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76ec007070 con 0x7f76dc004810 2024-04-25T12:20:59.286 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.281+0000 7f76f7529640 1 -- 172.21.15.86:0/3634416868 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76dc004810 msgr2=0x7f76dc004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:20:59.286 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.281+0000 7f76f7529640 1 --2- 172.21.15.86:0/3634416868 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76dc004810 0x7f76dc004c90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f76ec00c190 tx=0x7f76ec01f350 comp rx=0 tx=0).stop 2024-04-25T12:20:59.286 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.285+0000 7f76f5ac6640 1 -- 172.21.15.86:0/3634416868 reap_dead start 2024-04-25T12:20:59.286 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.285+0000 7f76f7529640 1 -- 172.21.15.86:0/3634416868 shutdown_connections 2024-04-25T12:20:59.286 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.285+0000 7f76f7529640 1 -- 172.21.15.86:0/3634416868 >> 172.21.15.86:0/3634416868 conn(0x7f76f00c9a70 msgr2=0x7f76f00c9e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:20:59.286 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.285+0000 7f76f7529640 1 -- 172.21.15.86:0/3634416868 shutdown_connections 2024-04-25T12:20:59.286 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.285+0000 7f76f7529640 1 -- 172.21.15.86:0/3634416868 wait complete. 2024-04-25T12:20:59.289 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.285+0000 7f76f7529640 1 Processor -- start 2024-04-25T12:20:59.289 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.285+0000 7f76f7529640 1 -- start start 2024-04-25T12:20:59.291 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.289+0000 7f76f7529640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76f00cc250 0x7f76f01f1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:20:59.291 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.289+0000 7f76f7529640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76f00cc630 0x7f76f00c7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:20:59.291 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.289+0000 7f76f7529640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f76f00c7ba0 0x7f76f00c8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:20:59.291 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.289+0000 7f76f7529640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f76f00c1f90 con 0x7f76f00cc630 2024-04-25T12:20:59.291 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.289+0000 7f76f7529640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f76f00731e0 con 0x7f76f00cc250 2024-04-25T12:20:59.291 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.289+0000 7f76f7529640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f76f00ca790 con 0x7f76f00c7ba0 2024-04-25T12:20:59.291 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.289+0000 7f76f4ac4640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76f00cc630 0x7f76f00c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:20:59.291 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.289+0000 7f76f52c5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76f00cc250 0x7f76f01f1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:20:59.291 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.289+0000 7f76f52c5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76f00cc250 0x7f76f01f1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.86:33838/0 (socket says 172.21.15.86:33838) 2024-04-25T12:20:59.291 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.289+0000 7f76f4ac4640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76f00cc630 0x7f76f00c7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:47220/0 (socket says 172.21.15.86:47220) 2024-04-25T12:20:59.292 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.289+0000 7f76f52c5640 1 -- 172.21.15.86:0/482206731 learned_addr learned my addr 172.21.15.86:0/482206731 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:20:59.292 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.289+0000 7f76f5ac6640 1 --2- 172.21.15.86:0/482206731 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f76f00c7ba0 0x7f76f00c8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:20:59.292 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.289+0000 7f76f52c5640 1 -- 172.21.15.86:0/482206731 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f76f00c7ba0 msgr2=0x7f76f00c8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:20:59.292 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.289+0000 7f76f52c5640 1 --2- 172.21.15.86:0/482206731 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f76f00c7ba0 0x7f76f00c8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:20:59.292 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.289+0000 7f76f52c5640 1 -- 172.21.15.86:0/482206731 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76f00cc630 msgr2=0x7f76f00c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:20:59.292 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.289+0000 7f76f52c5640 1 --2- 172.21.15.86:0/482206731 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76f00cc630 0x7f76f00c7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:20:59.292 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.289+0000 7f76f52c5640 1 -- 172.21.15.86:0/482206731 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76f00c8b90 con 0x7f76f00cc250 2024-04-25T12:20:59.293 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.289+0000 7f76f52c5640 1 --2- 172.21.15.86:0/482206731 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76f00cc250 0x7f76f01f1f40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f76e0013950 tx=0x7f76e0013d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:20:59.293 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.289+0000 7f76e5ffb640 1 -- 172.21.15.86:0/482206731 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e001a030 con 0x7f76f00cc250 2024-04-25T12:20:59.293 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.289+0000 7f76e5ffb640 1 -- 172.21.15.86:0/482206731 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76e0011a50 con 0x7f76f00cc250 2024-04-25T12:20:59.294 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.289+0000 7f76f7529640 1 -- 172.21.15.86:0/482206731 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76f014c4f0 con 0x7f76f00cc250 2024-04-25T12:20:59.294 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.289+0000 7f76e5ffb640 1 -- 172.21.15.86:0/482206731 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e000f040 con 0x7f76f00cc250 2024-04-25T12:20:59.294 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.289+0000 7f76f7529640 1 -- 172.21.15.86:0/482206731 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76f00c9360 con 0x7f76f00cc250 2024-04-25T12:20:59.294 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.289+0000 7f76e5ffb640 1 -- 172.21.15.86:0/482206731 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f76e001d030 con 0x7f76f00cc250 2024-04-25T12:20:59.294 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.289+0000 7f76e5ffb640 1 -- 172.21.15.86:0/482206731 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f76e0016460 con 0x7f76f00cc250 2024-04-25T12:20:59.294 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.293+0000 7f76f7529640 1 -- 172.21.15.86:0/482206731 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76f0075df0 con 0x7f76f00cc250 2024-04-25T12:20:59.300 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.297+0000 7f76e5ffb640 1 -- 172.21.15.86:0/482206731 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f76e0024030 con 0x7f76f00cc250 2024-04-25T12:20:59.365 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.361+0000 7f76f7529640 1 -- 172.21.15.86:0/482206731 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f76f0071ea0 con 0x7f76f00cc250 2024-04-25T12:20:59.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.369+0000 7f76e5ffb640 1 -- 172.21.15.86:0/482206731 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f76e0011e40 con 0x7f76f00cc250 2024-04-25T12:20:59.373 INFO:teuthology.orchestra.run.smithi086.stderr:adjusted tunables profile to default 2024-04-25T12:20:59.374 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.373+0000 7f76f7529640 1 -- 172.21.15.86:0/482206731 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76f00cc250 msgr2=0x7f76f01f1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:20:59.375 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.373+0000 7f76f7529640 1 --2- 172.21.15.86:0/482206731 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76f00cc250 0x7f76f01f1f40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f76e0013950 tx=0x7f76e0013d50 comp rx=0 tx=0).stop 2024-04-25T12:20:59.375 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.373+0000 7f76f7529640 1 -- 172.21.15.86:0/482206731 shutdown_connections 2024-04-25T12:20:59.375 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.373+0000 7f76f7529640 1 --2- 172.21.15.86:0/482206731 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f76f00c7ba0 0x7f76f00c8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:20:59.375 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.373+0000 7f76f7529640 1 --2- 172.21.15.86:0/482206731 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76f00cc630 0x7f76f00c7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:20:59.375 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.373+0000 7f76f7529640 1 --2- 172.21.15.86:0/482206731 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76f00cc250 0x7f76f01f1f40 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:20:59.375 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.373+0000 7f76f7529640 1 -- 172.21.15.86:0/482206731 >> 172.21.15.86:0/482206731 conn(0x7f76f00c9a70 msgr2=0x7f76f0151210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:20:59.375 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.373+0000 7f76f7529640 1 -- 172.21.15.86:0/482206731 shutdown_connections 2024-04-25T12:20:59.375 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:20:59.373+0000 7f76f7529640 1 -- 172.21.15.86:0/482206731 wait complete. 2024-04-25T12:20:59.393 INFO:tasks.ceph:check_enable_crimson: False 2024-04-25T12:20:59.394 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-25T12:20:59.394 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-04-25T12:20:59.394 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-25T12:20:59.405 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-04-25T12:20:59.405 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-25T12:20:59.456 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-04-25T12:20:59.456 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-25T12:20:59.471 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-04-25T12:20:59.469+0000 7f606f77e180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T12:20:59.481 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-04-25T12:20:59.481 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-25T12:20:59.484 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-25T12:20:59.480+0000 7faf748c5180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T12:20:59.532 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-25T12:20:59.532 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-25T12:20:59.545 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-25T12:20:59.545 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-25T12:20:59.599 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-25T12:20:59.599 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-25T12:20:59.655 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-25T12:20:59.655 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-25T12:20:59.711 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new 1f713f00-ef9f-4a6f-a620-38a8a1f8a822 0 2024-04-25T12:20:59.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:59.872+0000 7fa0eaa2e640 1 Processor -- start 2024-04-25T12:20:59.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:59.872+0000 7fa0eaa2e640 1 -- start start 2024-04-25T12:20:59.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:59.876+0000 7fa0eaa2e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa0e4153320 0x7fa0e4073c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:20:59.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:59.876+0000 7fa0eaa2e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa0e40c86a0 0x7fa0e40c6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:20:59.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:59.876+0000 7fa0eaa2e640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0e4153700 con 0x7fa0e406c780 2024-04-25T12:20:59.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:59.876+0000 7fa0eaa2e640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fa0e406ce90 con 0x7fa0e4153320 2024-04-25T12:20:59.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:59.876+0000 7fa0eaa2e640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fa0e406d170 con 0x7fa0e40c86a0 2024-04-25T12:20:59.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:59.876+0000 7fa0e3fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa0e4153320 0x7fa0e4073c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:20:59.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:59.876+0000 7fa0e37fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa0e40c86a0 0x7fa0e40c6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:20:59.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:59.876+0000 7fa0e3fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa0e4153320 0x7fa0e4073c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50818/0 (socket says 172.21.15.134:50818) 2024-04-25T12:20:59.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:59.876+0000 7fa0e3fff640 1 -- 172.21.15.134:0/2924686798 learned_addr learned my addr 172.21.15.134:0/2924686798 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-25T12:20:59.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:59.876+0000 7fa0e37fe640 1 -- 172.21.15.134:0/2924686798 >> v2:172.21.15.134:3300/0 conn(0x7fa0e4153320 msgr2=0x7fa0e4073c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:20:59.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:59.876+0000 7fa0e37fe640 1 --2- 172.21.15.134:0/2924686798 >> v2:172.21.15.134:3300/0 conn(0x7fa0e4153320 0x7fa0e4073c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:20:59.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:59.876+0000 7fa0e37fe640 1 -- 172.21.15.134:0/2924686798 >> v1:172.21.15.86:6789/0 conn(0x7fa0e406c780 legacy=0x7fa0e41593b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:20:59.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:59.876+0000 7fa0e37fe640 1 -- 172.21.15.134:0/2924686798 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0e406bb50 con 0x7fa0e40c86a0 2024-04-25T12:20:59.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:59.876+0000 7fa0e37fe640 1 --2- 172.21.15.134:0/2924686798 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa0e40c86a0 0x7fa0e40c6ce0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa0d80097c0 tx=0x7fa0d801ec50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba5ce410e7916c44 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:20:59.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:59.876+0000 7fa0e2ffd640 1 -- 172.21.15.134:0/2924686798 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d80b5070 con 0x7fa0e40c86a0 2024-04-25T12:20:59.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:59.876+0000 7fa0e2ffd640 1 -- 172.21.15.134:0/2924686798 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0d80a8910 con 0x7fa0e40c86a0 2024-04-25T12:20:59.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:59.876+0000 7fa0e2ffd640 1 -- 172.21.15.134:0/2924686798 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d80a8ce0 con 0x7fa0e40c86a0 2024-04-25T12:20:59.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:59.876+0000 7fa0eaa2e640 1 -- 172.21.15.134:0/2924686798 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa0e40c86a0 msgr2=0x7fa0e40c6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:20:59.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:59.876+0000 7fa0eaa2e640 1 --2- 172.21.15.134:0/2924686798 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa0e40c86a0 0x7fa0e40c6ce0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa0d80097c0 tx=0x7fa0d801ec50 comp rx=0 tx=0).stop 2024-04-25T12:20:59.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:59.876+0000 7fa0eaa2e640 1 -- 172.21.15.134:0/2924686798 shutdown_connections 2024-04-25T12:20:59.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:59.876+0000 7fa0eaa2e640 1 --2- 172.21.15.134:0/2924686798 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa0e40c86a0 0x7fa0e40c6ce0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:20:59.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:59.876+0000 7fa0eaa2e640 1 --2- 172.21.15.134:0/2924686798 >> v2:172.21.15.134:3300/0 conn(0x7fa0e4153320 0x7fa0e4073c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:20:59.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:59.876+0000 7fa0eaa2e640 1 -- 172.21.15.134:0/2924686798 >> 172.21.15.134:0/2924686798 conn(0x7fa0e40ca0d0 msgr2=0x7fa0e40ca4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:20:59.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:59.876+0000 7fa0eaa2e640 1 -- 172.21.15.134:0/2924686798 shutdown_connections 2024-04-25T12:20:59.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:59.876+0000 7fa0eaa2e640 1 -- 172.21.15.134:0/2924686798 wait complete. 2024-04-25T12:20:59.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:59.880+0000 7fa0eaa2e640 1 Processor -- start 2024-04-25T12:20:59.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:59.880+0000 7fa0eaa2e640 1 -- start start 2024-04-25T12:20:59.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:59.880+0000 7fa0eaa2e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa0e406c780 0x7fa0e415bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:20:59.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:59.880+0000 7fa0eaa2e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa0e40c86a0 0x7fa0e414d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:20:59.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:59.880+0000 7fa0eaa2e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0e4153320 0x7fa0e41f1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:20:59.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:59.880+0000 7fa0eaa2e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e4159c40 con 0x7fa0e406c780 2024-04-25T12:20:59.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:59.880+0000 7fa0eaa2e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e4159ac0 con 0x7fa0e4153320 2024-04-25T12:20:59.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:59.880+0000 7fa0eaa2e640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fa0e40cde80 con 0x7fa0e40c86a0 2024-04-25T12:20:59.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:59.880+0000 7fa0e37fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa0e40c86a0 0x7fa0e414d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:20:59.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:59.880+0000 7fa0e8fcb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0e4153320 0x7fa0e41f1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:20:59.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:59.880+0000 7fa0e37fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa0e40c86a0 0x7fa0e414d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.134:52410/0 (socket says 172.21.15.134:52410) 2024-04-25T12:20:59.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:59.880+0000 7fa0e37fe640 1 -- 172.21.15.134:0/3156155820 learned_addr learned my addr 172.21.15.134:0/3156155820 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-25T12:20:59.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:59.880+0000 7fa0e3fff640 1 --2- 172.21.15.134:0/3156155820 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa0e406c780 0x7fa0e415bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:20:59.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:59.880+0000 7fa0e37fe640 1 -- 172.21.15.134:0/3156155820 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0e4153320 msgr2=0x7fa0e41f1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:20:59.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:59.880+0000 7fa0e37fe640 1 --2- 172.21.15.134:0/3156155820 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0e4153320 0x7fa0e41f1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:20:59.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:59.880+0000 7fa0e37fe640 1 -- 172.21.15.134:0/3156155820 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa0e406c780 msgr2=0x7fa0e415bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:20:59.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:59.880+0000 7fa0e37fe640 1 --2- 172.21.15.134:0/3156155820 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa0e406c780 0x7fa0e415bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:20:59.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:59.880+0000 7fa0e37fe640 1 -- 172.21.15.134:0/3156155820 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0e40ce160 con 0x7fa0e40c86a0 2024-04-25T12:20:59.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:59.880+0000 7fa0e3fff640 1 --2- 172.21.15.134:0/3156155820 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa0e406c780 0x7fa0e415bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:20:59.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:59.880+0000 7fa0e37fe640 1 --2- 172.21.15.134:0/3156155820 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa0e40c86a0 0x7fa0e414d600 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa0d80097c0 tx=0x7fa0d801b9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:20:59.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:59.880+0000 7fa0e0ff9640 1 -- 172.21.15.134:0/3156155820 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d80bf070 con 0x7fa0e40c86a0 2024-04-25T12:20:59.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:59.880+0000 7fa0e0ff9640 1 -- 172.21.15.134:0/3156155820 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0d80b0720 con 0x7fa0e40c86a0 2024-04-25T12:20:59.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:59.880+0000 7fa0eaa2e640 1 -- 172.21.15.134:0/3156155820 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0e41e49c0 con 0x7fa0e40c86a0 2024-04-25T12:20:59.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:59.880+0000 7fa0e0ff9640 1 -- 172.21.15.134:0/3156155820 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d80b5040 con 0x7fa0e40c86a0 2024-04-25T12:20:59.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:59.880+0000 7fa0eaa2e640 1 -- 172.21.15.134:0/3156155820 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0e41e4f80 con 0x7fa0e40c86a0 2024-04-25T12:20:59.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:59.880+0000 7fa0e0ff9640 1 -- 172.21.15.134:0/3156155820 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa0d80c2070 con 0x7fa0e40c86a0 2024-04-25T12:20:59.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:59.880+0000 7fa0e0ff9640 1 -- 172.21.15.134:0/3156155820 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fa0d80c4bd0 con 0x7fa0e40c86a0 2024-04-25T12:20:59.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:59.880+0000 7fa0eaa2e640 1 -- 172.21.15.134:0/3156155820 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0e41e47b0 con 0x7fa0e40c86a0 2024-04-25T12:20:59.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:59.904+0000 7fa0e0ff9640 1 -- 172.21.15.134:0/3156155820 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fa0d80dbe50 con 0x7fa0e40c86a0 2024-04-25T12:20:59.922 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-04-25T12:20:59.921+0000 7f606f77e180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T12:20:59.958 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-25T12:20:59.952+0000 7faf748c5180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T12:20:59.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:59.972+0000 7fa0eaa2e640 1 -- 172.21.15.134:0/3156155820 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "osd new", "uuid": "1f713f00-ef9f-4a6f-a620-38a8a1f8a822", "id": 0} v 0) -- 0x7fa0e40687b0 con 0x7fa0e40c86a0 2024-04-25T12:20:59.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:59.984+0000 7fa0e0ff9640 1 -- 172.21.15.134:0/3156155820 <== mon.2 v2:172.21.15.134:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1f713f00-ef9f-4a6f-a620-38a8a1f8a822", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fa0d80ca030 con 0x7fa0e40c86a0 2024-04-25T12:20:59.987 INFO:teuthology.orchestra.run.smithi134.stdout:0 2024-04-25T12:20:59.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:59.984+0000 7fa0eaa2e640 1 -- 172.21.15.134:0/3156155820 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa0e40c86a0 msgr2=0x7fa0e414d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:20:59.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:59.984+0000 7fa0eaa2e640 1 --2- 172.21.15.134:0/3156155820 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa0e40c86a0 0x7fa0e414d600 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa0d80097c0 tx=0x7fa0d801b9f0 comp rx=0 tx=0).stop 2024-04-25T12:20:59.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:59.984+0000 7fa0eaa2e640 1 -- 172.21.15.134:0/3156155820 shutdown_connections 2024-04-25T12:20:59.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:59.984+0000 7fa0eaa2e640 1 --2- 172.21.15.134:0/3156155820 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0e4153320 0x7fa0e41f1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:20:59.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:59.984+0000 7fa0eaa2e640 1 --2- 172.21.15.134:0/3156155820 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa0e40c86a0 0x7fa0e414d600 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:20:59.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:59.984+0000 7fa0eaa2e640 1 --2- 172.21.15.134:0/3156155820 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa0e406c780 0x7fa0e415bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:20:59.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:59.984+0000 7fa0eaa2e640 1 -- 172.21.15.134:0/3156155820 >> 172.21.15.134:0/3156155820 conn(0x7fa0e40ca0d0 msgr2=0x7fa0e4151280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:20:59.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:59.984+0000 7fa0eaa2e640 1 -- 172.21.15.134:0/3156155820 shutdown_connections 2024-04-25T12:20:59.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:20:59.984+0000 7fa0eaa2e640 1 -- 172.21.15.134:0/3156155820 wait complete. 2024-04-25T12:21:00.006 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new baf6606d-a556-4fbe-a930-855e04ff1534 1 2024-04-25T12:21:00.113 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-04-25T12:21:00.109+0000 7f606f77e180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T12:21:00.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.116+0000 7f9623d76640 1 Processor -- start 2024-04-25T12:21:00.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.116+0000 7f9623d76640 1 -- start start 2024-04-25T12:21:00.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.116+0000 7f9623d76640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f961c158880 0x7f961c0676a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:00.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.116+0000 7f9623d76640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f961c073d50 0x7f961c15b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:00.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.116+0000 7f9623d76640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f961c06ec60 con 0x7f961c06e720 2024-04-25T12:21:00.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.116+0000 7f9623d76640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f961c0b0540 con 0x7f961c073d50 2024-04-25T12:21:00.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.116+0000 7f9623d76640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f961c0afa00 con 0x7f961c158880 2024-04-25T12:21:00.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.116+0000 7f9621b12640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f961c158880 0x7f961c0676a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:00.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.116+0000 7f9621b12640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f961c158880 0x7f961c0676a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.134:52416/0 (socket says 172.21.15.134:52416) 2024-04-25T12:21:00.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.116+0000 7f9621b12640 1 -- 172.21.15.134:0/3742337087 learned_addr learned my addr 172.21.15.134:0/3742337087 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-25T12:21:00.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.116+0000 7f9622313640 1 --2- 172.21.15.134:0/3742337087 >> v2:172.21.15.86:3300/0 conn(0x7f961c073d50 0x7f961c15b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:00.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.116+0000 7f9621b12640 1 -- 172.21.15.134:0/3742337087 >> v2:172.21.15.86:3300/0 conn(0x7f961c073d50 msgr2=0x7f961c15b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:00.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.116+0000 7f9621b12640 1 --2- 172.21.15.134:0/3742337087 >> v2:172.21.15.86:3300/0 conn(0x7f961c073d50 0x7f961c15b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:00.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.116+0000 7f9620b10640 1 -- 172.21.15.134:0/3742337087 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 582277170 0 0) 0x7f961c06ec60 con 0x7f961c06e720 2024-04-25T12:21:00.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.116+0000 7f9621b12640 1 -- 172.21.15.134:0/3742337087 >> v1:172.21.15.86:6789/0 conn(0x7f961c06e720 legacy=0x7f961c0b1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:00.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.116+0000 7f9621b12640 1 -- 172.21.15.134:0/3742337087 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f961c15b130 con 0x7f961c158880 2024-04-25T12:21:00.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.120+0000 7f9621b12640 1 --2- 172.21.15.134:0/3742337087 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f961c158880 0x7f961c0676a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f960c009870 tx=0x7f960c01c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d01b150a839bda7d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:00.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.120+0000 7f9620b10640 1 -- 172.21.15.134:0/3742337087 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f960c0ab650 con 0x7f961c158880 2024-04-25T12:21:00.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.120+0000 7f9620b10640 1 -- 172.21.15.134:0/3742337087 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f960c0b0070 con 0x7f961c158880 2024-04-25T12:21:00.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.120+0000 7f9620b10640 1 -- 172.21.15.134:0/3742337087 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f960c0aba10 con 0x7f961c158880 2024-04-25T12:21:00.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.120+0000 7f9623d76640 1 -- 172.21.15.134:0/3742337087 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f961c158880 msgr2=0x7f961c0676a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:00.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.120+0000 7f9623d76640 1 --2- 172.21.15.134:0/3742337087 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f961c158880 0x7f961c0676a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f960c009870 tx=0x7f960c01c560 comp rx=0 tx=0).stop 2024-04-25T12:21:00.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.120+0000 7f9623d76640 1 -- 172.21.15.134:0/3742337087 shutdown_connections 2024-04-25T12:21:00.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.120+0000 7f9623d76640 1 --2- 172.21.15.134:0/3742337087 >> v2:172.21.15.86:3300/0 conn(0x7f961c073d50 0x7f961c15b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:00.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.120+0000 7f9623d76640 1 --2- 172.21.15.134:0/3742337087 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f961c158880 0x7f961c0676a0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:00.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.120+0000 7f9623d76640 1 -- 172.21.15.134:0/3742337087 >> 172.21.15.134:0/3742337087 conn(0x7f961c06f280 msgr2=0x7f961c06f690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:00.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.120+0000 7f9623d76640 1 -- 172.21.15.134:0/3742337087 shutdown_connections 2024-04-25T12:21:00.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.120+0000 7f9623d76640 1 -- 172.21.15.134:0/3742337087 wait complete. 2024-04-25T12:21:00.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.120+0000 7f9623d76640 1 Processor -- start 2024-04-25T12:21:00.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.120+0000 7f9623d76640 1 -- start start 2024-04-25T12:21:00.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.120+0000 7f9623d76640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f961c06e720 0x7f961c1571f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:00.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.120+0000 7f9623d76640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f961c073d50 0x7f961c0c5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:00.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.120+0000 7f9623d76640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f961c158880 0x7f961c0c6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:00.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.120+0000 7f9623d76640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f961c0b2120 con 0x7f961c073d50 2024-04-25T12:21:00.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.120+0000 7f9623d76640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f961c15bf80 con 0x7f961c06e720 2024-04-25T12:21:00.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.120+0000 7f9623d76640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f961c0b22a0 con 0x7f961c158880 2024-04-25T12:21:00.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.124+0000 7f9621b12640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f961c06e720 0x7f961c1571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:00.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.124+0000 7f9622313640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f961c158880 0x7f961c0c6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:00.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.124+0000 7f9621b12640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f961c06e720 0x7f961c1571f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50842/0 (socket says 172.21.15.134:50842) 2024-04-25T12:21:00.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.124+0000 7f9621b12640 1 -- 172.21.15.134:0/4024054621 learned_addr learned my addr 172.21.15.134:0/4024054621 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-25T12:21:00.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.124+0000 7f9621311640 1 --2- 172.21.15.134:0/4024054621 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f961c073d50 0x7f961c0c5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:00.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.124+0000 7f9622313640 1 -- 172.21.15.134:0/4024054621 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f961c06e720 msgr2=0x7f961c1571f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:00.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.124+0000 7f9622313640 1 --2- 172.21.15.134:0/4024054621 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f961c06e720 0x7f961c1571f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:00.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.124+0000 7f9622313640 1 -- 172.21.15.134:0/4024054621 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f961c073d50 msgr2=0x7f961c0c5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:00.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.124+0000 7f9622313640 1 --2- 172.21.15.134:0/4024054621 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f961c073d50 0x7f961c0c5af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:00.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.124+0000 7f9622313640 1 -- 172.21.15.134:0/4024054621 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f961c0c47d0 con 0x7f961c158880 2024-04-25T12:21:00.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.124+0000 7f9621b12640 1 --2- 172.21.15.134:0/4024054621 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f961c06e720 0x7f961c1571f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T12:21:00.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.124+0000 7f9622313640 1 --2- 172.21.15.134:0/4024054621 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f961c158880 0x7f961c0c6030 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f961400eba0 tx=0x7f961400c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:00.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.124+0000 7f96127fc640 1 -- 172.21.15.134:0/4024054621 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9614018020 con 0x7f961c158880 2024-04-25T12:21:00.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.124+0000 7f96127fc640 1 -- 172.21.15.134:0/4024054621 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f961400cd20 con 0x7f961c158880 2024-04-25T12:21:00.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.124+0000 7f9623d76640 1 -- 172.21.15.134:0/4024054621 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f961c0c4a70 con 0x7f961c158880 2024-04-25T12:21:00.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.124+0000 7f96127fc640 1 -- 172.21.15.134:0/4024054621 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96140146c0 con 0x7f961c158880 2024-04-25T12:21:00.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.124+0000 7f9623d76640 1 -- 172.21.15.134:0/4024054621 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f961c0c5010 con 0x7f961c158880 2024-04-25T12:21:00.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.124+0000 7f96127fc640 1 -- 172.21.15.134:0/4024054621 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f961401b020 con 0x7f961c158880 2024-04-25T12:21:00.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.124+0000 7f96127fc640 1 -- 172.21.15.134:0/4024054621 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f9614013790 con 0x7f961c158880 2024-04-25T12:21:00.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.124+0000 7f9623d76640 1 -- 172.21.15.134:0/4024054621 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f961c075df0 con 0x7f961c158880 2024-04-25T12:21:00.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.124+0000 7f96127fc640 1 -- 172.21.15.134:0/4024054621 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f9614022030 con 0x7f961c158880 2024-04-25T12:21:00.158 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-25T12:21:00.152+0000 7faf748c5180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T12:21:00.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.192+0000 7f9623d76640 1 -- 172.21.15.134:0/4024054621 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "osd new", "uuid": "baf6606d-a556-4fbe-a930-855e04ff1534", "id": 1} v 0) -- 0x7f961c15ad50 con 0x7f961c158880 2024-04-25T12:21:00.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.204+0000 7f96127fc640 1 -- 172.21.15.134:0/4024054621 <== mon.2 v2:172.21.15.134:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "baf6606d-a556-4fbe-a930-855e04ff1534", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f9614010040 con 0x7f961c158880 2024-04-25T12:21:00.208 INFO:teuthology.orchestra.run.smithi134.stdout:1 2024-04-25T12:21:00.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.204+0000 7f9623d76640 1 -- 172.21.15.134:0/4024054621 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f961c158880 msgr2=0x7f961c0c6030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:00.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.204+0000 7f9623d76640 1 --2- 172.21.15.134:0/4024054621 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f961c158880 0x7f961c0c6030 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f961400eba0 tx=0x7f961400c490 comp rx=0 tx=0).stop 2024-04-25T12:21:00.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.204+0000 7f9623d76640 1 -- 172.21.15.134:0/4024054621 shutdown_connections 2024-04-25T12:21:00.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.204+0000 7f9623d76640 1 --2- 172.21.15.134:0/4024054621 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f961c158880 0x7f961c0c6030 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:00.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.204+0000 7f9623d76640 1 --2- 172.21.15.134:0/4024054621 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f961c073d50 0x7f961c0c5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:00.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.204+0000 7f9623d76640 1 --2- 172.21.15.134:0/4024054621 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f961c06e720 0x7f961c1571f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:00.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.204+0000 7f9623d76640 1 -- 172.21.15.134:0/4024054621 >> 172.21.15.134:0/4024054621 conn(0x7f961c06f280 msgr2=0x7f961c159ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:00.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.204+0000 7f9623d76640 1 -- 172.21.15.134:0/4024054621 shutdown_connections 2024-04-25T12:21:00.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.204+0000 7f9623d76640 1 -- 172.21.15.134:0/4024054621 wait complete. 2024-04-25T12:21:00.225 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new c983d68e-6d60-434f-aed6-108420c5dd09 2 2024-04-25T12:21:00.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.332+0000 7f57ba387640 1 Processor -- start 2024-04-25T12:21:00.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.332+0000 7f57ba387640 1 -- start start 2024-04-25T12:21:00.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.336+0000 7f57ba387640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f57b4072ae0 0x7f57b415b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:00.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.336+0000 7f57ba387640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57b4157da0 con 0x7f57b4151f40 2024-04-25T12:21:00.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.336+0000 7f57ba387640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57b40c89e0 con 0x7f57b406cfd0 2024-04-25T12:21:00.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.336+0000 7f57ba387640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f57b40c8c80 con 0x7f57b4072ae0 2024-04-25T12:21:00.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.336+0000 7f57b37fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f57b4072ae0 0x7f57b415b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:00.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.336+0000 7f57b37fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f57b4072ae0 0x7f57b415b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.134:52442/0 (socket says 172.21.15.134:52442) 2024-04-25T12:21:00.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.336+0000 7f57b8924640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f57b406cfd0 0x7f57b4162720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:54060/0 (socket says 172.21.15.134:54060) 2024-04-25T12:21:00.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.336+0000 7f57b37fe640 1 -- 172.21.15.134:0/2820081968 learned_addr learned my addr 172.21.15.134:0/2820081968 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-25T12:21:00.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.336+0000 7f57b37fe640 1 -- 172.21.15.134:0/2820081968 >> v1:172.21.15.134:6789/0 conn(0x7f57b406cfd0 legacy=0x7f57b4162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:00.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.336+0000 7f57b37fe640 1 -- 172.21.15.134:0/2820081968 >> v1:172.21.15.86:6789/0 conn(0x7f57b4151f40 legacy=0x7f57b40c9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:00.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.336+0000 7f57b37fe640 1 -- 172.21.15.134:0/2820081968 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57b4158020 con 0x7f57b4072ae0 2024-04-25T12:21:00.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.336+0000 7f57b37fe640 1 --2- 172.21.15.134:0/2820081968 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f57b4072ae0 0x7f57b415b390 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f57b40c8bb0 tx=0x7f57a801eb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a512b31b49114d51 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:00.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.336+0000 7f57b2ffd640 1 -- 172.21.15.134:0/2820081968 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a80b5070 con 0x7f57b4072ae0 2024-04-25T12:21:00.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.336+0000 7f57b2ffd640 1 -- 172.21.15.134:0/2820081968 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57a80a8850 con 0x7f57b4072ae0 2024-04-25T12:21:00.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.336+0000 7f57b2ffd640 1 -- 172.21.15.134:0/2820081968 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a80a8c20 con 0x7f57b4072ae0 2024-04-25T12:21:00.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.336+0000 7f57ba387640 1 -- 172.21.15.134:0/2820081968 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f57b4072ae0 msgr2=0x7f57b415b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:00.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.336+0000 7f57ba387640 1 --2- 172.21.15.134:0/2820081968 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f57b4072ae0 0x7f57b415b390 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f57b40c8bb0 tx=0x7f57a801eb50 comp rx=0 tx=0).stop 2024-04-25T12:21:00.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.340+0000 7f57ba387640 1 -- 172.21.15.134:0/2820081968 shutdown_connections 2024-04-25T12:21:00.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.340+0000 7f57ba387640 1 --2- 172.21.15.134:0/2820081968 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f57b4072ae0 0x7f57b415b390 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:00.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.340+0000 7f57ba387640 1 -- 172.21.15.134:0/2820081968 >> 172.21.15.134:0/2820081968 conn(0x7f57b40ca540 msgr2=0x7f57b40ca950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:00.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.340+0000 7f57ba387640 1 -- 172.21.15.134:0/2820081968 shutdown_connections 2024-04-25T12:21:00.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.340+0000 7f57ba387640 1 -- 172.21.15.134:0/2820081968 wait complete. 2024-04-25T12:21:00.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.340+0000 7f57ba387640 1 Processor -- start 2024-04-25T12:21:00.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.340+0000 7f57ba387640 1 -- start start 2024-04-25T12:21:00.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.340+0000 7f57ba387640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57b406cfd0 0x7f57b41575f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:00.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.340+0000 7f57ba387640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f57b4072ae0 0x7f57b4147460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:00.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.340+0000 7f57ba387640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57b4151f40 0x7f57b40c6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:00.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.340+0000 7f57ba387640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f57b40c9170 con 0x7f57b406cfd0 2024-04-25T12:21:00.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.340+0000 7f57ba387640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f57b41585e0 con 0x7f57b4151f40 2024-04-25T12:21:00.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.340+0000 7f57ba387640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f57b415b8d0 con 0x7f57b4072ae0 2024-04-25T12:21:00.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.340+0000 7f57b37fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f57b4072ae0 0x7f57b4147460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:00.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.340+0000 7f57b37fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f57b4072ae0 0x7f57b4147460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.134:52456/0 (socket says 172.21.15.134:52456) 2024-04-25T12:21:00.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.340+0000 7f57b37fe640 1 -- 172.21.15.134:0/3201876992 learned_addr learned my addr 172.21.15.134:0/3201876992 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-25T12:21:00.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.340+0000 7f57b8924640 1 --2- 172.21.15.134:0/3201876992 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57b4151f40 0x7f57b40c6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:00.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.340+0000 7f57b3fff640 1 --2- 172.21.15.134:0/3201876992 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57b406cfd0 0x7f57b41575f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:00.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.340+0000 7f57b37fe640 1 -- 172.21.15.134:0/3201876992 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57b4151f40 msgr2=0x7f57b40c6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:00.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.340+0000 7f57b37fe640 1 --2- 172.21.15.134:0/3201876992 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57b4151f40 0x7f57b40c6ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:00.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.340+0000 7f57b37fe640 1 -- 172.21.15.134:0/3201876992 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57b406cfd0 msgr2=0x7f57b41575f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:00.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.340+0000 7f57b37fe640 1 --2- 172.21.15.134:0/3201876992 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57b406cfd0 0x7f57b41575f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:00.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.340+0000 7f57b37fe640 1 -- 172.21.15.134:0/3201876992 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57b41eec70 con 0x7f57b4072ae0 2024-04-25T12:21:00.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.340+0000 7f57b37fe640 1 --2- 172.21.15.134:0/3201876992 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f57b4072ae0 0x7f57b4147460 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f57a80b3040 tx=0x7f57a801b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:00.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.340+0000 7f57b0ff9640 1 -- 172.21.15.134:0/3201876992 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a80c0070 con 0x7f57b4072ae0 2024-04-25T12:21:00.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.340+0000 7f57b0ff9640 1 -- 172.21.15.134:0/3201876992 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57a80b0a50 con 0x7f57b4072ae0 2024-04-25T12:21:00.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.340+0000 7f57ba387640 1 -- 172.21.15.134:0/3201876992 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57b41eef30 con 0x7f57b4072ae0 2024-04-25T12:21:00.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.340+0000 7f57b0ff9640 1 -- 172.21.15.134:0/3201876992 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a80b5070 con 0x7f57b4072ae0 2024-04-25T12:21:00.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.340+0000 7f57ba387640 1 -- 172.21.15.134:0/3201876992 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f57b41ef4f0 con 0x7f57b4072ae0 2024-04-25T12:21:00.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.340+0000 7f57b0ff9640 1 -- 172.21.15.134:0/3201876992 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f57a80c3070 con 0x7f57b4072ae0 2024-04-25T12:21:00.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.340+0000 7f57b0ff9640 1 -- 172.21.15.134:0/3201876992 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f57a80bb860 con 0x7f57b4072ae0 2024-04-25T12:21:00.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.340+0000 7f57ba387640 1 -- 172.21.15.134:0/3201876992 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57b4075df0 con 0x7f57b4072ae0 2024-04-25T12:21:00.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.344+0000 7f57b0ff9640 1 -- 172.21.15.134:0/3201876992 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f57a80dce50 con 0x7f57b4072ae0 2024-04-25T12:21:00.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.412+0000 7f57ba387640 1 -- 172.21.15.134:0/3201876992 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c983d68e-6d60-434f-aed6-108420c5dd09", "id": 2} v 0) -- 0x7f57b40c4380 con 0x7f57b4072ae0 2024-04-25T12:21:00.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.420+0000 7f57b0ff9640 1 -- 172.21.15.134:0/3201876992 <== mon.2 v2:172.21.15.134:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c983d68e-6d60-434f-aed6-108420c5dd09", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f57a80cb070 con 0x7f57b4072ae0 2024-04-25T12:21:00.424 INFO:teuthology.orchestra.run.smithi134.stdout:2 2024-04-25T12:21:00.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.420+0000 7f57ba387640 1 -- 172.21.15.134:0/3201876992 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f57b4072ae0 msgr2=0x7f57b4147460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:00.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.420+0000 7f57ba387640 1 --2- 172.21.15.134:0/3201876992 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f57b4072ae0 0x7f57b4147460 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f57a80b3040 tx=0x7f57a801b8f0 comp rx=0 tx=0).stop 2024-04-25T12:21:00.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.420+0000 7f57ba387640 1 -- 172.21.15.134:0/3201876992 shutdown_connections 2024-04-25T12:21:00.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.420+0000 7f57ba387640 1 --2- 172.21.15.134:0/3201876992 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57b4151f40 0x7f57b40c6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:00.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.420+0000 7f57ba387640 1 --2- 172.21.15.134:0/3201876992 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f57b4072ae0 0x7f57b4147460 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:00.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.420+0000 7f57ba387640 1 --2- 172.21.15.134:0/3201876992 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57b406cfd0 0x7f57b41575f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:00.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.420+0000 7f57ba387640 1 -- 172.21.15.134:0/3201876992 >> 172.21.15.134:0/3201876992 conn(0x7f57b40ca540 msgr2=0x7f57b41420c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:00.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.420+0000 7f57ba387640 1 -- 172.21.15.134:0/3201876992 shutdown_connections 2024-04-25T12:21:00.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.420+0000 7f57ba387640 1 -- 172.21.15.134:0/3201876992 wait complete. 2024-04-25T12:21:00.441 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new e77657bb-45aa-43bf-ab41-c7377eb495ea 3 2024-04-25T12:21:00.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.548+0000 7f1c2bc4d640 1 Processor -- start 2024-04-25T12:21:00.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.548+0000 7f1c2bc4d640 1 -- start start 2024-04-25T12:21:00.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.552+0000 7f1c2bc4d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f1c2406d1a0 0x7f1c240c8040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:00.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.552+0000 7f1c2bc4d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1c2406d580 0x7f1c2415ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:00.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.552+0000 7f1c2bc4d640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1c2415b170 0x7f1c2415b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:00.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.552+0000 7f1c2bc4d640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f1c240c86d0 con 0x7f1c2415b170 2024-04-25T12:21:00.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.552+0000 7f1c2bc4d640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f1c240c9800 con 0x7f1c2406d1a0 2024-04-25T12:21:00.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.552+0000 7f1c2bc4d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f1c2415bb60 con 0x7f1c2406d580 2024-04-25T12:21:00.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.552+0000 7f1c299e9640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f1c2406d1a0 0x7f1c240c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:00.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.552+0000 7f1c291e8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1c2406d580 0x7f1c2415ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:00.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.552+0000 7f1c299e9640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f1c2406d1a0 0x7f1c240c8040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50860/0 (socket says 172.21.15.134:50860) 2024-04-25T12:21:00.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.552+0000 7f1c299e9640 1 -- 172.21.15.134:0/2467877216 learned_addr learned my addr 172.21.15.134:0/2467877216 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-25T12:21:00.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.552+0000 7f1c2a1ea640 1 --2- 172.21.15.134:0/2467877216 >> v2:172.21.15.86:3300/0 conn(0x7f1c2415b170 0x7f1c2415b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:00.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.552+0000 7f1c299e9640 1 -- 172.21.15.134:0/2467877216 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1c2406d580 msgr2=0x7f1c2415ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:00.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.552+0000 7f1c299e9640 1 --2- 172.21.15.134:0/2467877216 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1c2406d580 0x7f1c2415ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:00.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.552+0000 7f1c299e9640 1 -- 172.21.15.134:0/2467877216 >> v2:172.21.15.86:3300/0 conn(0x7f1c2415b170 msgr2=0x7f1c2415b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:00.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.552+0000 7f1c299e9640 1 --2- 172.21.15.134:0/2467877216 >> v2:172.21.15.86:3300/0 conn(0x7f1c2415b170 0x7f1c2415b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:00.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.552+0000 7f1c299e9640 1 -- 172.21.15.134:0/2467877216 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c240705d0 con 0x7f1c2406d1a0 2024-04-25T12:21:00.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.552+0000 7f1c291e8640 1 --2- 172.21.15.134:0/2467877216 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1c2406d580 0x7f1c2415ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T12:21:00.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.552+0000 7f1c299e9640 1 --2- 172.21.15.134:0/2467877216 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c2406d1a0 0x7f1c240c8040 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1c2406ca00 tx=0x7f1c1401ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60f4fc48e3ebb227 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:00.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.552+0000 7f1c289e7640 1 -- 172.21.15.134:0/2467877216 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c140b5070 con 0x7f1c2406d1a0 2024-04-25T12:21:00.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.552+0000 7f1c289e7640 1 -- 172.21.15.134:0/2467877216 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c140a89d0 con 0x7f1c2406d1a0 2024-04-25T12:21:00.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.552+0000 7f1c289e7640 1 -- 172.21.15.134:0/2467877216 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c140a8da0 con 0x7f1c2406d1a0 2024-04-25T12:21:00.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.556+0000 7f1c2bc4d640 1 -- 172.21.15.134:0/2467877216 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c2406d1a0 msgr2=0x7f1c240c8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:00.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.556+0000 7f1c2bc4d640 1 --2- 172.21.15.134:0/2467877216 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c2406d1a0 0x7f1c240c8040 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1c2406ca00 tx=0x7f1c1401ed10 comp rx=0 tx=0).stop 2024-04-25T12:21:00.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.556+0000 7f1c2bc4d640 1 -- 172.21.15.134:0/2467877216 shutdown_connections 2024-04-25T12:21:00.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.556+0000 7f1c2bc4d640 1 --2- 172.21.15.134:0/2467877216 >> v2:172.21.15.86:3300/0 conn(0x7f1c2415b170 0x7f1c2415b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:00.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.556+0000 7f1c2bc4d640 1 --2- 172.21.15.134:0/2467877216 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1c2406d580 0x7f1c2415ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:00.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.556+0000 7f1c2bc4d640 1 --2- 172.21.15.134:0/2467877216 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c2406d1a0 0x7f1c240c8040 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:00.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.556+0000 7f1c2bc4d640 1 -- 172.21.15.134:0/2467877216 >> 172.21.15.134:0/2467877216 conn(0x7f1c240ca540 msgr2=0x7f1c240ca950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:00.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.556+0000 7f1c2bc4d640 1 -- 172.21.15.134:0/2467877216 shutdown_connections 2024-04-25T12:21:00.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.556+0000 7f1c2bc4d640 1 -- 172.21.15.134:0/2467877216 wait complete. 2024-04-25T12:21:00.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.556+0000 7f1c2bc4d640 1 Processor -- start 2024-04-25T12:21:00.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.556+0000 7f1c2bc4d640 1 -- start start 2024-04-25T12:21:00.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.556+0000 7f1c2bc4d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c2406d1a0 0x7f1c241f12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:00.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.556+0000 7f1c2bc4d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c2406d580 0x7f1c241559f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:00.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.556+0000 7f1c2bc4d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1c2415b170 0x7f1c240cb940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:00.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.556+0000 7f1c2bc4d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1c240c9d30 con 0x7f1c2406d580 2024-04-25T12:21:00.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.556+0000 7f1c2bc4d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1c240c9a50 con 0x7f1c2406d1a0 2024-04-25T12:21:00.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.556+0000 7f1c2bc4d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f1c2415f4b0 con 0x7f1c2415b170 2024-04-25T12:21:00.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.556+0000 7f1c299e9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c2406d1a0 0x7f1c241f12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:00.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.556+0000 7f1c2a1ea640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1c2415b170 0x7f1c240cb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:00.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.556+0000 7f1c299e9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c2406d1a0 0x7f1c241f12e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50872/0 (socket says 172.21.15.134:50872) 2024-04-25T12:21:00.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.556+0000 7f1c2a1ea640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1c2415b170 0x7f1c240cb940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.134:52468/0 (socket says 172.21.15.134:52468) 2024-04-25T12:21:00.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.556+0000 7f1c2a1ea640 1 -- 172.21.15.134:0/810478342 learned_addr learned my addr 172.21.15.134:0/810478342 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-25T12:21:00.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.556+0000 7f1c291e8640 1 --2- 172.21.15.134:0/810478342 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c2406d580 0x7f1c241559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:00.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.556+0000 7f1c2a1ea640 1 -- 172.21.15.134:0/810478342 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c2406d1a0 msgr2=0x7f1c241f12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:00.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.556+0000 7f1c2a1ea640 1 --2- 172.21.15.134:0/810478342 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c2406d1a0 0x7f1c241f12e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:00.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.556+0000 7f1c2a1ea640 1 -- 172.21.15.134:0/810478342 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c2406d580 msgr2=0x7f1c241559f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:00.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.556+0000 7f1c2a1ea640 1 --2- 172.21.15.134:0/810478342 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c2406d580 0x7f1c241559f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:00.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.556+0000 7f1c2a1ea640 1 -- 172.21.15.134:0/810478342 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c2415bf80 con 0x7f1c2415b170 2024-04-25T12:21:00.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.556+0000 7f1c299e9640 1 --2- 172.21.15.134:0/810478342 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c2406d1a0 0x7f1c241f12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T12:21:00.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.556+0000 7f1c2a1ea640 1 --2- 172.21.15.134:0/810478342 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1c2415b170 0x7f1c240cb940 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c00cc60 tx=0x7f1c1c00a5c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:00.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.556+0000 7f1c1a7fc640 1 -- 172.21.15.134:0/810478342 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c0039a0 con 0x7f1c2415b170 2024-04-25T12:21:00.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.556+0000 7f1c1a7fc640 1 -- 172.21.15.134:0/810478342 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c1c003b40 con 0x7f1c2415b170 2024-04-25T12:21:00.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.556+0000 7f1c2bc4d640 1 -- 172.21.15.134:0/810478342 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c241578a0 con 0x7f1c2415b170 2024-04-25T12:21:00.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.556+0000 7f1c1a7fc640 1 -- 172.21.15.134:0/810478342 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c004020 con 0x7f1c2415b170 2024-04-25T12:21:00.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.556+0000 7f1c2bc4d640 1 -- 172.21.15.134:0/810478342 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c24157e40 con 0x7f1c2415b170 2024-04-25T12:21:00.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.556+0000 7f1c1a7fc640 1 -- 172.21.15.134:0/810478342 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1c1c004550 con 0x7f1c2415b170 2024-04-25T12:21:00.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.556+0000 7f1c1a7fc640 1 -- 172.21.15.134:0/810478342 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f1c1c018cc0 con 0x7f1c2415b170 2024-04-25T12:21:00.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.560+0000 7f1c2bc4d640 1 -- 172.21.15.134:0/810478342 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c24075df0 con 0x7f1c2415b170 2024-04-25T12:21:00.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.560+0000 7f1c1a7fc640 1 -- 172.21.15.134:0/810478342 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f1c1c014030 con 0x7f1c2415b170 2024-04-25T12:21:00.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.628+0000 7f1c2bc4d640 1 -- 172.21.15.134:0/810478342 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e77657bb-45aa-43bf-ab41-c7377eb495ea", "id": 3} v 0) -- 0x7f1c241589e0 con 0x7f1c2415b170 2024-04-25T12:21:00.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.632+0000 7f1c1a7fc640 1 -- 172.21.15.134:0/810478342 <== mon.2 v2:172.21.15.134:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e77657bb-45aa-43bf-ab41-c7377eb495ea", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f1c1c018400 con 0x7f1c2415b170 2024-04-25T12:21:00.639 INFO:teuthology.orchestra.run.smithi134.stdout:3 2024-04-25T12:21:00.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.636+0000 7f1c2bc4d640 1 -- 172.21.15.134:0/810478342 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1c2415b170 msgr2=0x7f1c240cb940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:00.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.636+0000 7f1c2bc4d640 1 --2- 172.21.15.134:0/810478342 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1c2415b170 0x7f1c240cb940 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c00cc60 tx=0x7f1c1c00a5c0 comp rx=0 tx=0).stop 2024-04-25T12:21:00.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.636+0000 7f1c2bc4d640 1 -- 172.21.15.134:0/810478342 shutdown_connections 2024-04-25T12:21:00.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.636+0000 7f1c2bc4d640 1 --2- 172.21.15.134:0/810478342 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1c2415b170 0x7f1c240cb940 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:00.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.636+0000 7f1c2bc4d640 1 --2- 172.21.15.134:0/810478342 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c2406d580 0x7f1c241559f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:00.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.636+0000 7f1c2bc4d640 1 --2- 172.21.15.134:0/810478342 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c2406d1a0 0x7f1c241f12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:00.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.636+0000 7f1c2bc4d640 1 -- 172.21.15.134:0/810478342 >> 172.21.15.134:0/810478342 conn(0x7f1c240ca540 msgr2=0x7f1c24071fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:00.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.636+0000 7f1c2bc4d640 1 -- 172.21.15.134:0/810478342 shutdown_connections 2024-04-25T12:21:00.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.636+0000 7f1c2bc4d640 1 -- 172.21.15.134:0/810478342 wait complete. 2024-04-25T12:21:00.657 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new 252bd300-d75a-4b00-be4b-27e6b51de4ab 4 2024-04-25T12:21:00.666 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-04-25T12:21:00.665+0000 7f606f77e180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T12:21:00.719 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-04-25T12:21:00.717+0000 7f606f77e180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T12:21:00.722 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-25T12:21:00.716+0000 7faf748c5180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T12:21:00.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.760+0000 7f2063ae3640 1 Processor -- start 2024-04-25T12:21:00.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.760+0000 7f2063ae3640 1 -- start start 2024-04-25T12:21:00.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.764+0000 7f2063ae3640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f205c152ff0 0x7f205c0c5730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:00.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.764+0000 7f2063ae3640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f205c0ca550 0x7f205c0cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:00.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.764+0000 7f2063ae3640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f205c0cada0 con 0x7f205c0c7eb0 2024-04-25T12:21:00.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.764+0000 7f2063ae3640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f205c0cb080 con 0x7f205c0ca550 2024-04-25T12:21:00.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.764+0000 7f2063ae3640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f205c0c9360 con 0x7f205c152ff0 2024-04-25T12:21:00.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.764+0000 7f206187f640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f205c152ff0 0x7f205c0c5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:00.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.764+0000 7f2062080640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f205c0ca550 0x7f205c0cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:00.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.764+0000 7f206187f640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f205c152ff0 0x7f205c0c5730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.134:52474/0 (socket says 172.21.15.134:52474) 2024-04-25T12:21:00.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.764+0000 7f206187f640 1 -- 172.21.15.134:0/3256827321 learned_addr learned my addr 172.21.15.134:0/3256827321 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-25T12:21:00.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.764+0000 7f2062080640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f205c0ca550 0x7f205c0cb350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50880/0 (socket says 172.21.15.134:50880) 2024-04-25T12:21:00.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.764+0000 7f206107e640 1 --1- 172.21.15.134:0/3256827321 >> v1:172.21.15.134:6789/0 conn(0x7f205c0c7eb0 0x7f205c0c6380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:54076/0 (socket says 172.21.15.134:54076) 2024-04-25T12:21:00.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.764+0000 7f206187f640 1 -- 172.21.15.134:0/3256827321 >> v2:172.21.15.134:3300/0 conn(0x7f205c0ca550 msgr2=0x7f205c0cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:00.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.764+0000 7f206187f640 1 --2- 172.21.15.134:0/3256827321 >> v2:172.21.15.134:3300/0 conn(0x7f205c0ca550 0x7f205c0cb350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:00.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.764+0000 7f206187f640 1 -- 172.21.15.134:0/3256827321 >> v1:172.21.15.134:6789/0 conn(0x7f205c0c7eb0 legacy=0x7f205c0c6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:00.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.764+0000 7f206087d640 1 -- 172.21.15.134:0/3256827321 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 17250727 0 0) 0x7f205c0cada0 con 0x7f205c0c7eb0 2024-04-25T12:21:00.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.764+0000 7f206187f640 1 -- 172.21.15.134:0/3256827321 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f205c0c9640 con 0x7f205c152ff0 2024-04-25T12:21:00.772 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-04-25T12:21:00.769+0000 7f606f77e180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T12:21:00.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.764+0000 7f206187f640 1 --2- 172.21.15.134:0/3256827321 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f205c152ff0 0x7f205c0c5730 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2058009870 tx=0x7f205801ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce6fd2e2e54082dc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:00.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.764+0000 7f206087d640 1 -- 172.21.15.134:0/3256827321 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20580b5070 con 0x7f205c152ff0 2024-04-25T12:21:00.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.764+0000 7f206087d640 1 -- 172.21.15.134:0/3256827321 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20580a8a50 con 0x7f205c152ff0 2024-04-25T12:21:00.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.764+0000 7f206087d640 1 -- 172.21.15.134:0/3256827321 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20580a8e20 con 0x7f205c152ff0 2024-04-25T12:21:00.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.764+0000 7f2063ae3640 1 -- 172.21.15.134:0/3256827321 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f205c152ff0 msgr2=0x7f205c0c5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:00.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.764+0000 7f2063ae3640 1 --2- 172.21.15.134:0/3256827321 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f205c152ff0 0x7f205c0c5730 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2058009870 tx=0x7f205801ed50 comp rx=0 tx=0).stop 2024-04-25T12:21:00.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.764+0000 7f2063ae3640 1 -- 172.21.15.134:0/3256827321 shutdown_connections 2024-04-25T12:21:00.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.764+0000 7f2063ae3640 1 --2- 172.21.15.134:0/3256827321 >> v2:172.21.15.134:3300/0 conn(0x7f205c0ca550 0x7f205c0cb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:00.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.764+0000 7f2063ae3640 1 --2- 172.21.15.134:0/3256827321 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f205c152ff0 0x7f205c0c5730 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:00.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.764+0000 7f2063ae3640 1 -- 172.21.15.134:0/3256827321 >> 172.21.15.134:0/3256827321 conn(0x7f205c0676a0 msgr2=0x7f205c067ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:00.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.764+0000 7f2063ae3640 1 -- 172.21.15.134:0/3256827321 shutdown_connections 2024-04-25T12:21:00.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.764+0000 7f2063ae3640 1 -- 172.21.15.134:0/3256827321 wait complete. 2024-04-25T12:21:00.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.768+0000 7f2063ae3640 1 Processor -- start 2024-04-25T12:21:00.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.768+0000 7f2063ae3640 1 -- start start 2024-04-25T12:21:00.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.768+0000 7f2063ae3640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f205c0c7eb0 0x7f205c1f1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:00.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.768+0000 7f2063ae3640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f205c0ca550 0x7f205c1f1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:00.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.768+0000 7f2063ae3640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f205c152ff0 0x7f205c1e6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:00.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.768+0000 7f2063ae3640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f205c0caaa0 con 0x7f205c152ff0 2024-04-25T12:21:00.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.768+0000 7f2063ae3640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f205c0c5e60 con 0x7f205c0c7eb0 2024-04-25T12:21:00.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.768+0000 7f2063ae3640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f205c1533d0 con 0x7f205c0ca550 2024-04-25T12:21:00.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.768+0000 7f206187f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f205c0c7eb0 0x7f205c1f1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:00.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.768+0000 7f206187f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f205c0c7eb0 0x7f205c1f1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50890/0 (socket says 172.21.15.134:50890) 2024-04-25T12:21:00.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.768+0000 7f206187f640 1 -- 172.21.15.134:0/4093390224 learned_addr learned my addr 172.21.15.134:0/4093390224 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-25T12:21:00.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.768+0000 7f206107e640 1 --2- 172.21.15.134:0/4093390224 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f205c0ca550 0x7f205c1f1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:00.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.768+0000 7f206187f640 1 -- 172.21.15.134:0/4093390224 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f205c0ca550 msgr2=0x7f205c1f1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:00.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.768+0000 7f206187f640 1 --2- 172.21.15.134:0/4093390224 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f205c0ca550 0x7f205c1f1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:00.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.768+0000 7f2062080640 1 --2- 172.21.15.134:0/4093390224 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f205c152ff0 0x7f205c1e6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:00.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.768+0000 7f206187f640 1 -- 172.21.15.134:0/4093390224 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f205c152ff0 msgr2=0x7f205c1e6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:00.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.768+0000 7f206187f640 1 --2- 172.21.15.134:0/4093390224 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f205c152ff0 0x7f205c1e6600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:00.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.768+0000 7f206187f640 1 -- 172.21.15.134:0/4093390224 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f205c0ce2f0 con 0x7f205c0c7eb0 2024-04-25T12:21:00.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.768+0000 7f206187f640 1 --2- 172.21.15.134:0/4093390224 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f205c0c7eb0 0x7f205c1f1050 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f20580b3040 tx=0x7f205801baf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:00.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.768+0000 7f20527fc640 1 -- 172.21.15.134:0/4093390224 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20580c2070 con 0x7f205c0c7eb0 2024-04-25T12:21:00.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.768+0000 7f20527fc640 1 -- 172.21.15.134:0/4093390224 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20580b1c00 con 0x7f205c0c7eb0 2024-04-25T12:21:00.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.768+0000 7f2063ae3640 1 -- 172.21.15.134:0/4093390224 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f205c1f4760 con 0x7f205c0c7eb0 2024-04-25T12:21:00.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.768+0000 7f20527fc640 1 -- 172.21.15.134:0/4093390224 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20580b5040 con 0x7f205c0c7eb0 2024-04-25T12:21:00.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.768+0000 7f2063ae3640 1 -- 172.21.15.134:0/4093390224 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f205c1f4d20 con 0x7f205c0c7eb0 2024-04-25T12:21:00.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.768+0000 7f20527fc640 1 -- 172.21.15.134:0/4093390224 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f20580c5070 con 0x7f205c0c7eb0 2024-04-25T12:21:00.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.768+0000 7f20527fc640 1 -- 172.21.15.134:0/4093390224 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f2058003cc0 con 0x7f205c0c7eb0 2024-04-25T12:21:00.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.768+0000 7f2063ae3640 1 -- 172.21.15.134:0/4093390224 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f205c075df0 con 0x7f205c0c7eb0 2024-04-25T12:21:00.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.772+0000 7f20527fc640 1 -- 172.21.15.134:0/4093390224 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f20580cc070 con 0x7f205c0c7eb0 2024-04-25T12:21:00.786 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-25T12:21:00.776+0000 7faf748c5180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T12:21:00.833 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-25T12:21:00.828+0000 7faf748c5180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T12:21:00.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.836+0000 7f2063ae3640 1 -- 172.21.15.134:0/4093390224 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd new", "uuid": "252bd300-d75a-4b00-be4b-27e6b51de4ab", "id": 4} v 0) -- 0x7f205c1513d0 con 0x7f205c0c7eb0 2024-04-25T12:21:00.848 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-04-25T12:21:00.845+0000 7f606f77e180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T12:21:00.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.844+0000 7f20527fc640 1 -- 172.21.15.134:0/4093390224 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "252bd300-d75a-4b00-be4b-27e6b51de4ab", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f20580188b0 con 0x7f205c0c7eb0 2024-04-25T12:21:00.849 INFO:teuthology.orchestra.run.smithi134.stdout:4 2024-04-25T12:21:00.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.844+0000 7f2063ae3640 1 -- 172.21.15.134:0/4093390224 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f205c0c7eb0 msgr2=0x7f205c1f1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:00.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.844+0000 7f2063ae3640 1 --2- 172.21.15.134:0/4093390224 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f205c0c7eb0 0x7f205c1f1050 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f20580b3040 tx=0x7f205801baf0 comp rx=0 tx=0).stop 2024-04-25T12:21:00.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.844+0000 7f2063ae3640 1 -- 172.21.15.134:0/4093390224 shutdown_connections 2024-04-25T12:21:00.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.844+0000 7f2063ae3640 1 --2- 172.21.15.134:0/4093390224 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f205c152ff0 0x7f205c1e6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:00.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.844+0000 7f2063ae3640 1 --2- 172.21.15.134:0/4093390224 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f205c0ca550 0x7f205c1f1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:00.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.844+0000 7f2063ae3640 1 --2- 172.21.15.134:0/4093390224 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f205c0c7eb0 0x7f205c1f1050 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:00.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.844+0000 7f2063ae3640 1 -- 172.21.15.134:0/4093390224 >> 172.21.15.134:0/4093390224 conn(0x7f205c0676a0 msgr2=0x7f205c151eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:00.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.844+0000 7f2063ae3640 1 -- 172.21.15.134:0/4093390224 shutdown_connections 2024-04-25T12:21:00.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.844+0000 7f2063ae3640 1 -- 172.21.15.134:0/4093390224 wait complete. 2024-04-25T12:21:00.865 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new 4135da3f-7427-4409-a48e-78bd8a7b46ba 5 2024-04-25T12:21:00.899 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-04-25T12:21:00.897+0000 7f606f77e180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T12:21:00.916 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-25T12:21:00.912+0000 7faf748c5180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T12:21:00.969 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-25T12:21:00.964+0000 7faf748c5180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T12:21:00.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.968+0000 7f37df403640 1 Processor -- start 2024-04-25T12:21:00.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.968+0000 7f37df403640 1 -- start start 2024-04-25T12:21:00.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.968+0000 7f37df403640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f37d8071530 0x7f37d80c9370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:00.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.968+0000 7f37df403640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f37d80c98b0 0x7f37d80cb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:00.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.968+0000 7f37df403640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37d80c8080 con 0x7f37d8159cf0 2024-04-25T12:21:00.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.968+0000 7f37df403640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f37d80c5d80 con 0x7f37d8071530 2024-04-25T12:21:00.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.968+0000 7f37df403640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f37d80c8360 con 0x7f37d80c98b0 2024-04-25T12:21:00.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.968+0000 7f37dc99e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f37d8071530 0x7f37d80c9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:00.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.968+0000 7f37dd9a0640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f37d80c98b0 0x7f37d80cb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:00.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.968+0000 7f37dd19f640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f37d8159cf0 0x7f37d80c6210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:54090/0 (socket says 172.21.15.134:54090) 2024-04-25T12:21:00.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.968+0000 7f37dd19f640 1 -- 172.21.15.134:0/494201986 learned_addr learned my addr 172.21.15.134:0/494201986 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-25T12:21:00.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.968+0000 7f37dc99e640 1 -- 172.21.15.134:0/494201986 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f37d80c98b0 msgr2=0x7f37d80cb1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:00.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.968+0000 7f37dc99e640 1 --2- 172.21.15.134:0/494201986 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f37d80c98b0 0x7f37d80cb1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:00.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.968+0000 7f37dc99e640 1 -- 172.21.15.134:0/494201986 >> v1:172.21.15.134:6789/0 conn(0x7f37d8159cf0 legacy=0x7f37d80c6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:00.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.968+0000 7f37dc99e640 1 -- 172.21.15.134:0/494201986 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37d80c8640 con 0x7f37d8071530 2024-04-25T12:21:00.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.968+0000 7f37dd9a0640 1 --2- 172.21.15.134:0/494201986 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f37d80c98b0 0x7f37d80cb1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T12:21:00.976 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-04-25T12:21:00.973+0000 7f606f77e180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T12:21:00.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.972+0000 7f37dc99e640 1 --2- 172.21.15.134:0/494201986 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37d8071530 0x7f37d80c9370 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f37d80c5f00 tx=0x7f37c801ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e9840dcc136451b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:00.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.972+0000 7f37cffff640 1 -- 172.21.15.134:0/494201986 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c80b5070 con 0x7f37d8071530 2024-04-25T12:21:00.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.972+0000 7f37cffff640 1 -- 172.21.15.134:0/494201986 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37c80a8990 con 0x7f37d8071530 2024-04-25T12:21:00.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.972+0000 7f37cffff640 1 -- 172.21.15.134:0/494201986 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c80a8d60 con 0x7f37d8071530 2024-04-25T12:21:00.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.972+0000 7f37df403640 1 -- 172.21.15.134:0/494201986 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37d8071530 msgr2=0x7f37d80c9370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:00.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.972+0000 7f37df403640 1 --2- 172.21.15.134:0/494201986 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37d8071530 0x7f37d80c9370 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f37d80c5f00 tx=0x7f37c801ec90 comp rx=0 tx=0).stop 2024-04-25T12:21:00.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.972+0000 7f37df403640 1 -- 172.21.15.134:0/494201986 shutdown_connections 2024-04-25T12:21:00.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.972+0000 7f37df403640 1 --2- 172.21.15.134:0/494201986 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f37d80c98b0 0x7f37d80cb1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:00.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.972+0000 7f37df403640 1 --2- 172.21.15.134:0/494201986 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37d8071530 0x7f37d80c9370 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:00.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.972+0000 7f37df403640 1 -- 172.21.15.134:0/494201986 >> 172.21.15.134:0/494201986 conn(0x7f37d80676a0 msgr2=0x7f37d8067ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:00.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.972+0000 7f37df403640 1 -- 172.21.15.134:0/494201986 shutdown_connections 2024-04-25T12:21:00.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.972+0000 7f37df403640 1 -- 172.21.15.134:0/494201986 wait complete. 2024-04-25T12:21:00.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.972+0000 7f37df403640 1 Processor -- start 2024-04-25T12:21:00.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.972+0000 7f37df403640 1 -- start start 2024-04-25T12:21:00.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.976+0000 7f37df403640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f37d8071530 0x7f37d8140760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:00.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.976+0000 7f37df403640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37d80c98b0 0x7f37d813a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:00.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.976+0000 7f37df403640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37d8159cf0 0x7f37d813ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:00.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.976+0000 7f37df403640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f37d80c6920 con 0x7f37d8159cf0 2024-04-25T12:21:00.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.976+0000 7f37df403640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f37d80c8c00 con 0x7f37d80c98b0 2024-04-25T12:21:00.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.976+0000 7f37df403640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f37d8071950 con 0x7f37d8071530 2024-04-25T12:21:00.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.976+0000 7f37dc99e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37d80c98b0 0x7f37d813a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:00.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.976+0000 7f37dd19f640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f37d8071530 0x7f37d8140760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:00.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.976+0000 7f37dc99e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37d80c98b0 0x7f37d813a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50914/0 (socket says 172.21.15.134:50914) 2024-04-25T12:21:00.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.976+0000 7f37dc99e640 1 -- 172.21.15.134:0/2277422306 learned_addr learned my addr 172.21.15.134:0/2277422306 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-25T12:21:00.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.976+0000 7f37dc99e640 1 -- 172.21.15.134:0/2277422306 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f37d8071530 msgr2=0x7f37d8140760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:00.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.976+0000 7f37dc99e640 1 --2- 172.21.15.134:0/2277422306 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f37d8071530 0x7f37d8140760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:00.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.976+0000 7f37dc99e640 1 -- 172.21.15.134:0/2277422306 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37d8159cf0 msgr2=0x7f37d813ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:00.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.976+0000 7f37dc99e640 1 --2- 172.21.15.134:0/2277422306 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37d8159cf0 0x7f37d813ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:00.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.976+0000 7f37dc99e640 1 -- 172.21.15.134:0/2277422306 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37d813f700 con 0x7f37d80c98b0 2024-04-25T12:21:00.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.976+0000 7f37dd19f640 1 --2- 172.21.15.134:0/2277422306 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f37d8071530 0x7f37d8140760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T12:21:00.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.976+0000 7f37dc99e640 1 --2- 172.21.15.134:0/2277422306 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37d80c98b0 0x7f37d813a8e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f37c801d340 tx=0x7f37c801ba30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:00.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.976+0000 7f37cdffb640 1 -- 172.21.15.134:0/2277422306 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c80bf070 con 0x7f37d80c98b0 2024-04-25T12:21:00.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.976+0000 7f37cdffb640 1 -- 172.21.15.134:0/2277422306 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37c80b0720 con 0x7f37d80c98b0 2024-04-25T12:21:00.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.976+0000 7f37df403640 1 -- 172.21.15.134:0/2277422306 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37d813de40 con 0x7f37d80c98b0 2024-04-25T12:21:00.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.976+0000 7f37cdffb640 1 -- 172.21.15.134:0/2277422306 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c80b5040 con 0x7f37d80c98b0 2024-04-25T12:21:00.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.976+0000 7f37df403640 1 -- 172.21.15.134:0/2277422306 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37d813e400 con 0x7f37d80c98b0 2024-04-25T12:21:00.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.976+0000 7f37cdffb640 1 -- 172.21.15.134:0/2277422306 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f37c80b0b10 con 0x7f37d80c98b0 2024-04-25T12:21:00.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.976+0000 7f37cdffb640 1 -- 172.21.15.134:0/2277422306 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f37c80b9970 con 0x7f37d80c98b0 2024-04-25T12:21:00.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.976+0000 7f37df403640 1 -- 172.21.15.134:0/2277422306 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37d8075df0 con 0x7f37d80c98b0 2024-04-25T12:21:00.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:00.980+0000 7f37cdffb640 1 -- 172.21.15.134:0/2277422306 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f37c80c8020 con 0x7f37d80c98b0 2024-04-25T12:21:01.027 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-04-25T12:21:01.025+0000 7f606f77e180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T12:21:01.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.040+0000 7f37df403640 1 -- 172.21.15.134:0/2277422306 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4135da3f-7427-4409-a48e-78bd8a7b46ba", "id": 5} v 0) -- 0x7f37d80c9150 con 0x7f37d80c98b0 2024-04-25T12:21:01.048 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-25T12:21:01.044+0000 7faf748c5180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T12:21:01.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.052+0000 7f37cdffb640 1 -- 172.21.15.134:0/2277422306 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4135da3f-7427-4409-a48e-78bd8a7b46ba", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f37c80187f0 con 0x7f37d80c98b0 2024-04-25T12:21:01.056 INFO:teuthology.orchestra.run.smithi134.stdout:5 2024-04-25T12:21:01.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.052+0000 7f37df403640 1 -- 172.21.15.134:0/2277422306 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37d80c98b0 msgr2=0x7f37d813a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:01.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.052+0000 7f37df403640 1 --2- 172.21.15.134:0/2277422306 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37d80c98b0 0x7f37d813a8e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f37c801d340 tx=0x7f37c801ba30 comp rx=0 tx=0).stop 2024-04-25T12:21:01.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.052+0000 7f37df403640 1 -- 172.21.15.134:0/2277422306 shutdown_connections 2024-04-25T12:21:01.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.052+0000 7f37df403640 1 --2- 172.21.15.134:0/2277422306 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37d8159cf0 0x7f37d813ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:01.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.052+0000 7f37df403640 1 --2- 172.21.15.134:0/2277422306 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37d80c98b0 0x7f37d813a8e0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:01.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.052+0000 7f37df403640 1 --2- 172.21.15.134:0/2277422306 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f37d8071530 0x7f37d8140760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:01.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.052+0000 7f37df403640 1 -- 172.21.15.134:0/2277422306 >> 172.21.15.134:0/2277422306 conn(0x7f37d80676a0 msgr2=0x7f37d80ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:01.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.052+0000 7f37df403640 1 -- 172.21.15.134:0/2277422306 shutdown_connections 2024-04-25T12:21:01.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.052+0000 7f37df403640 1 -- 172.21.15.134:0/2277422306 wait complete. 2024-04-25T12:21:01.073 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new b6e7a5f1-fa7e-497d-abac-a19994d26820 6 2024-04-25T12:21:01.105 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-25T12:21:01.100+0000 7faf748c5180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T12:21:01.177 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-04-25T12:21:01.173+0000 7f606f77e180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T12:21:01.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.176+0000 7fa1abeff640 1 Processor -- start 2024-04-25T12:21:01.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.176+0000 7fa1abeff640 1 -- start start 2024-04-25T12:21:01.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.176+0000 7fa1abeff640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa1a4151f40 0x7fa1a4157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:01.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.176+0000 7fa1abeff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa1a415bf40 0x7fa1a4162650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:01.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.176+0000 7fa1abeff640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1a4158210 con 0x7fa1a406cff0 2024-04-25T12:21:01.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.176+0000 7fa1abeff640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7fa1a415bab0 con 0x7fa1a4151f40 2024-04-25T12:21:01.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.176+0000 7fa1abeff640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fa1a406d550 con 0x7fa1a415bf40 2024-04-25T12:21:01.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.176+0000 7fa1aa49c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa1a415bf40 0x7fa1a4162650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:01.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.176+0000 7fa1a949a640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fa1a406cff0 0x7fa1a40c8870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:54096/0 (socket says 172.21.15.134:54096) 2024-04-25T12:21:01.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.176+0000 7fa1a949a640 1 -- 172.21.15.134:0/649088507 learned_addr learned my addr 172.21.15.134:0/649088507 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-25T12:21:01.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.176+0000 7fa1a9c9b640 1 --2- 172.21.15.134:0/649088507 >> v2:172.21.15.86:3300/0 conn(0x7fa1a4151f40 0x7fa1a4157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:01.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.180+0000 7fa1aa49c640 1 -- 172.21.15.134:0/649088507 >> v2:172.21.15.86:3300/0 conn(0x7fa1a4151f40 msgr2=0x7fa1a4157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:01.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.180+0000 7fa1aa49c640 1 --2- 172.21.15.134:0/649088507 >> v2:172.21.15.86:3300/0 conn(0x7fa1a4151f40 0x7fa1a4157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:01.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.180+0000 7fa1aa49c640 1 -- 172.21.15.134:0/649088507 >> v1:172.21.15.134:6789/0 conn(0x7fa1a406cff0 legacy=0x7fa1a40c8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:01.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.180+0000 7fa1aa49c640 1 -- 172.21.15.134:0/649088507 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1a406d830 con 0x7fa1a415bf40 2024-04-25T12:21:01.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.180+0000 7fa1a8c99640 1 -- 172.21.15.134:0/649088507 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 122325147 0 0) 0x7fa1a4158210 con 0x7fa1a406cff0 2024-04-25T12:21:01.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.180+0000 7fa1a9c9b640 1 --2- 172.21.15.134:0/649088507 >> v2:172.21.15.86:3300/0 conn(0x7fa1a4151f40 0x7fa1a4157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:21:01.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.180+0000 7fa1aa49c640 1 --2- 172.21.15.134:0/649088507 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1a415bf40 0x7fa1a4162650 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa1a415ba20 tx=0x7fa19c01f110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66d87152fc8fecbb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:01.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.180+0000 7fa1a8c99640 1 -- 172.21.15.134:0/649088507 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa19c0b4070 con 0x7fa1a415bf40 2024-04-25T12:21:01.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.180+0000 7fa1a8c99640 1 -- 172.21.15.134:0/649088507 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa19c0af600 con 0x7fa1a415bf40 2024-04-25T12:21:01.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.180+0000 7fa1a8c99640 1 -- 172.21.15.134:0/649088507 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa19c0af9d0 con 0x7fa1a415bf40 2024-04-25T12:21:01.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.180+0000 7fa1abeff640 1 -- 172.21.15.134:0/649088507 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1a415bf40 msgr2=0x7fa1a4162650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:01.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.180+0000 7fa1abeff640 1 --2- 172.21.15.134:0/649088507 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1a415bf40 0x7fa1a4162650 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa1a415ba20 tx=0x7fa19c01f110 comp rx=0 tx=0).stop 2024-04-25T12:21:01.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.180+0000 7fa1abeff640 1 -- 172.21.15.134:0/649088507 shutdown_connections 2024-04-25T12:21:01.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.180+0000 7fa1abeff640 1 --2- 172.21.15.134:0/649088507 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1a415bf40 0x7fa1a4162650 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:01.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.180+0000 7fa1abeff640 1 --2- 172.21.15.134:0/649088507 >> v2:172.21.15.86:3300/0 conn(0x7fa1a4151f40 0x7fa1a4157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:01.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.180+0000 7fa1abeff640 1 -- 172.21.15.134:0/649088507 >> 172.21.15.134:0/649088507 conn(0x7fa1a40ca540 msgr2=0x7fa1a40ca950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:01.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.180+0000 7fa1abeff640 1 -- 172.21.15.134:0/649088507 shutdown_connections 2024-04-25T12:21:01.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.180+0000 7fa1abeff640 1 -- 172.21.15.134:0/649088507 wait complete. 2024-04-25T12:21:01.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.184+0000 7fa1abeff640 1 Processor -- start 2024-04-25T12:21:01.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.184+0000 7fa1abeff640 1 -- start start 2024-04-25T12:21:01.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.184+0000 7fa1abeff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa1a406cff0 0x7fa1a41494e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:01.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.184+0000 7fa1abeff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1a4151f40 0x7fa1a4156df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:01.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.184+0000 7fa1abeff640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa1a415bf40 0x7fa1a41f2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:01.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.184+0000 7fa1abeff640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa1a4152320 con 0x7fa1a406cff0 2024-04-25T12:21:01.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.184+0000 7fa1abeff640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa1a415b740 con 0x7fa1a4151f40 2024-04-25T12:21:01.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.184+0000 7fa1abeff640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fa1a40c4670 con 0x7fa1a415bf40 2024-04-25T12:21:01.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.184+0000 7fa1a949a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1a4151f40 0x7fa1a4156df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:01.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.184+0000 7fa1aa49c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa1a415bf40 0x7fa1a41f2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:01.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.184+0000 7fa1a949a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1a4151f40 0x7fa1a4156df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50936/0 (socket says 172.21.15.134:50936) 2024-04-25T12:21:01.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.184+0000 7fa1a949a640 1 -- 172.21.15.134:0/1903429799 learned_addr learned my addr 172.21.15.134:0/1903429799 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-25T12:21:01.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.184+0000 7fa1a9c9b640 1 --2- 172.21.15.134:0/1903429799 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa1a406cff0 0x7fa1a41494e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:01.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.184+0000 7fa1a949a640 1 -- 172.21.15.134:0/1903429799 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa1a415bf40 msgr2=0x7fa1a41f2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:01.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.184+0000 7fa1a949a640 1 --2- 172.21.15.134:0/1903429799 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa1a415bf40 0x7fa1a41f2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:01.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.184+0000 7fa1a949a640 1 -- 172.21.15.134:0/1903429799 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa1a406cff0 msgr2=0x7fa1a41494e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:01.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.184+0000 7fa1a949a640 1 --2- 172.21.15.134:0/1903429799 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa1a406cff0 0x7fa1a41494e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:01.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.184+0000 7fa1a949a640 1 -- 172.21.15.134:0/1903429799 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1a40cb440 con 0x7fa1a4151f40 2024-04-25T12:21:01.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.184+0000 7fa1a949a640 1 --2- 172.21.15.134:0/1903429799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1a4151f40 0x7fa1a4156df0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa19400c550 tx=0x7fa19400ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:01.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.184+0000 7fa19a7fc640 1 -- 172.21.15.134:0/1903429799 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa194017070 con 0x7fa1a4151f40 2024-04-25T12:21:01.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.184+0000 7fa19a7fc640 1 -- 172.21.15.134:0/1903429799 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa194005d10 con 0x7fa1a4151f40 2024-04-25T12:21:01.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.184+0000 7fa1abeff640 1 -- 172.21.15.134:0/1903429799 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1a40cb9e0 con 0x7fa1a4151f40 2024-04-25T12:21:01.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.184+0000 7fa19a7fc640 1 -- 172.21.15.134:0/1903429799 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa194007330 con 0x7fa1a4151f40 2024-04-25T12:21:01.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.184+0000 7fa1abeff640 1 -- 172.21.15.134:0/1903429799 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1a41580e0 con 0x7fa1a4151f40 2024-04-25T12:21:01.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.184+0000 7fa19a7fc640 1 -- 172.21.15.134:0/1903429799 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa19401a070 con 0x7fa1a4151f40 2024-04-25T12:21:01.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.184+0000 7fa19a7fc640 1 -- 172.21.15.134:0/1903429799 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fa1940129f0 con 0x7fa1a4151f40 2024-04-25T12:21:01.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.184+0000 7fa1abeff640 1 -- 172.21.15.134:0/1903429799 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1a4075df0 con 0x7fa1a4151f40 2024-04-25T12:21:01.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.188+0000 7fa19a7fc640 1 -- 172.21.15.134:0/1903429799 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fa194021020 con 0x7fa1a4151f40 2024-04-25T12:21:01.237 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-04-25T12:21:01.232+0000 7f606f77e180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T12:21:01.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.264+0000 7fa1abeff640 1 -- 172.21.15.134:0/1903429799 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b6e7a5f1-fa7e-497d-abac-a19994d26820", "id": 6} v 0) -- 0x7fa1a40c9440 con 0x7fa1a4151f40 2024-04-25T12:21:01.274 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-25T12:21:01.268+0000 7faf748c5180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T12:21:01.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.276+0000 7fa19a7fc640 1 -- 172.21.15.134:0/1903429799 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b6e7a5f1-fa7e-497d-abac-a19994d26820", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fa194007660 con 0x7fa1a4151f40 2024-04-25T12:21:01.281 INFO:teuthology.orchestra.run.smithi134.stdout:6 2024-04-25T12:21:01.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.276+0000 7fa1abeff640 1 -- 172.21.15.134:0/1903429799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1a4151f40 msgr2=0x7fa1a4156df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:01.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.276+0000 7fa1abeff640 1 --2- 172.21.15.134:0/1903429799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1a4151f40 0x7fa1a4156df0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa19400c550 tx=0x7fa19400ca10 comp rx=0 tx=0).stop 2024-04-25T12:21:01.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.276+0000 7fa1abeff640 1 -- 172.21.15.134:0/1903429799 shutdown_connections 2024-04-25T12:21:01.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.276+0000 7fa1abeff640 1 --2- 172.21.15.134:0/1903429799 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa1a415bf40 0x7fa1a41f2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:01.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.276+0000 7fa1abeff640 1 --2- 172.21.15.134:0/1903429799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1a4151f40 0x7fa1a4156df0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:01.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.276+0000 7fa1abeff640 1 --2- 172.21.15.134:0/1903429799 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa1a406cff0 0x7fa1a41494e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:01.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.276+0000 7fa1abeff640 1 -- 172.21.15.134:0/1903429799 >> 172.21.15.134:0/1903429799 conn(0x7fa1a40ca540 msgr2=0x7fa1a40ca920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:01.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.276+0000 7fa1abeff640 1 -- 172.21.15.134:0/1903429799 shutdown_connections 2024-04-25T12:21:01.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.276+0000 7fa1abeff640 1 -- 172.21.15.134:0/1903429799 wait complete. 2024-04-25T12:21:01.298 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new c5597e50-1962-4103-9124-dd7bceb8ac97 7 2024-04-25T12:21:01.339 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-25T12:21:01.332+0000 7faf748c5180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T12:21:01.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.448+0000 7f15a0fa8640 1 Processor -- start 2024-04-25T12:21:01.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.448+0000 7f15a0fa8640 1 -- start start 2024-04-25T12:21:01.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.448+0000 7f15a0fa8640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f159c15bd40 0x7f159c0676a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:01.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.448+0000 7f15a0fa8640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f159c06ec60 con 0x7f159c158880 2024-04-25T12:21:01.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.448+0000 7f15a0fa8640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f159c0afa00 con 0x7f159c06e720 2024-04-25T12:21:01.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.448+0000 7f15a0fa8640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f159c0b0540 con 0x7f159c15bd40 2024-04-25T12:21:01.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.452+0000 7f159ad9d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f159c15bd40 0x7f159c0676a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:01.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.452+0000 7f1599d9b640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f159c06e720 0x7f159c15b630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:54098/0 (socket says 172.21.15.134:54098) 2024-04-25T12:21:01.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.452+0000 7f1599d9b640 1 -- 172.21.15.134:0/1507502017 learned_addr learned my addr 172.21.15.134:0/1507502017 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-25T12:21:01.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.452+0000 7f159ad9d640 1 -- 172.21.15.134:0/1507502017 >> v1:172.21.15.134:6789/0 conn(0x7f159c06e720 legacy=0x7f159c15b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:01.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.452+0000 7f159ad9d640 1 -- 172.21.15.134:0/1507502017 >> v1:172.21.15.86:6789/0 conn(0x7f159c158880 legacy=0x7f159c0b1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:01.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.452+0000 7f159ad9d640 1 -- 172.21.15.134:0/1507502017 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f159c15b130 con 0x7f159c15bd40 2024-04-25T12:21:01.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.452+0000 7f159ad9d640 1 --2- 172.21.15.134:0/1507502017 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f159c15bd40 0x7f159c0676a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f158c0097c0 tx=0x7f158c01c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b010689cca49562c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:01.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.452+0000 7f159959a640 1 -- 172.21.15.134:0/1507502017 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f158c0b0070 con 0x7f159c15bd40 2024-04-25T12:21:01.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.452+0000 7f159959a640 1 -- 172.21.15.134:0/1507502017 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f158c004230 con 0x7f159c15bd40 2024-04-25T12:21:01.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.452+0000 7f159959a640 1 -- 172.21.15.134:0/1507502017 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f158c003620 con 0x7f159c15bd40 2024-04-25T12:21:01.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.452+0000 7f15a0fa8640 1 -- 172.21.15.134:0/1507502017 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f159c15bd40 msgr2=0x7f159c0676a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:01.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.452+0000 7f15a0fa8640 1 --2- 172.21.15.134:0/1507502017 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f159c15bd40 0x7f159c0676a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f158c0097c0 tx=0x7f158c01c460 comp rx=0 tx=0).stop 2024-04-25T12:21:01.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.452+0000 7f15a0fa8640 1 -- 172.21.15.134:0/1507502017 shutdown_connections 2024-04-25T12:21:01.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.452+0000 7f15a0fa8640 1 --2- 172.21.15.134:0/1507502017 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f159c15bd40 0x7f159c0676a0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:01.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.456+0000 7f15a0fa8640 1 -- 172.21.15.134:0/1507502017 >> 172.21.15.134:0/1507502017 conn(0x7f159c06f280 msgr2=0x7f159c06f690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:01.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.456+0000 7f15a0fa8640 1 -- 172.21.15.134:0/1507502017 shutdown_connections 2024-04-25T12:21:01.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.456+0000 7f15a0fa8640 1 -- 172.21.15.134:0/1507502017 wait complete. 2024-04-25T12:21:01.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.456+0000 7f15a0fa8640 1 Processor -- start 2024-04-25T12:21:01.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.456+0000 7f15a0fa8640 1 -- start start 2024-04-25T12:21:01.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.456+0000 7f15a0fa8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f159c06e720 0x7f159c0c6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:01.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.456+0000 7f15a0fa8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f159c158880 0x7f159c1f8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:01.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.456+0000 7f15a0fa8640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f159c15bd40 0x7f159c0732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:01.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.456+0000 7f15a0fa8640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f159c0b22a0 con 0x7f159c15bd40 2024-04-25T12:21:01.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.456+0000 7f15a0fa8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f159c0b2120 con 0x7f159c158880 2024-04-25T12:21:01.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.456+0000 7f15a0fa8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f159c169650 con 0x7f159c06e720 2024-04-25T12:21:01.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.456+0000 7f1599d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f159c158880 0x7f159c1f8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:01.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.456+0000 7f159a59c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f159c06e720 0x7f159c0c6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:01.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.456+0000 7f159a59c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f159c06e720 0x7f159c0c6290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.134:52510/0 (socket says 172.21.15.134:52510) 2024-04-25T12:21:01.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.456+0000 7f1599d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f159c158880 0x7f159c1f8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50956/0 (socket says 172.21.15.134:50956) 2024-04-25T12:21:01.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.456+0000 7f159a59c640 1 -- 172.21.15.134:0/4133537707 learned_addr learned my addr 172.21.15.134:0/4133537707 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-25T12:21:01.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.456+0000 7f159ad9d640 1 --2- 172.21.15.134:0/4133537707 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f159c15bd40 0x7f159c0732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:01.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.456+0000 7f159a59c640 1 -- 172.21.15.134:0/4133537707 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f159c158880 msgr2=0x7f159c1f8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:01.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.456+0000 7f159a59c640 1 --2- 172.21.15.134:0/4133537707 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f159c158880 0x7f159c1f8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:01.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.456+0000 7f159a59c640 1 -- 172.21.15.134:0/4133537707 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f159c15bd40 msgr2=0x7f159c0732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:01.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.456+0000 7f159a59c640 1 --2- 172.21.15.134:0/4133537707 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f159c15bd40 0x7f159c0732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:01.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.456+0000 7f159a59c640 1 -- 172.21.15.134:0/4133537707 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f159c0c6890 con 0x7f159c06e720 2024-04-25T12:21:01.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.456+0000 7f1599d9b640 1 --2- 172.21.15.134:0/4133537707 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f159c158880 0x7f159c1f8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T12:21:01.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.456+0000 7f159a59c640 1 --2- 172.21.15.134:0/4133537707 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f159c06e720 0x7f159c0c6290 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f159400ba80 tx=0x7f159400bf40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:01.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.456+0000 7f1592ffd640 1 -- 172.21.15.134:0/4133537707 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f159400cc00 con 0x7f159c06e720 2024-04-25T12:21:01.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.456+0000 7f1592ffd640 1 -- 172.21.15.134:0/4133537707 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f159400cda0 con 0x7f159c06e720 2024-04-25T12:21:01.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.456+0000 7f15a0fa8640 1 -- 172.21.15.134:0/4133537707 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f159c0c6b70 con 0x7f159c06e720 2024-04-25T12:21:01.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.456+0000 7f1592ffd640 1 -- 172.21.15.134:0/4133537707 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1594003bc0 con 0x7f159c06e720 2024-04-25T12:21:01.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.456+0000 7f15a0fa8640 1 -- 172.21.15.134:0/4133537707 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f159c1f5250 con 0x7f159c06e720 2024-04-25T12:21:01.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.456+0000 7f1592ffd640 1 -- 172.21.15.134:0/4133537707 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1594006d10 con 0x7f159c06e720 2024-04-25T12:21:01.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.456+0000 7f1592ffd640 1 -- 172.21.15.134:0/4133537707 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f159401dbe0 con 0x7f159c06e720 2024-04-25T12:21:01.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.460+0000 7f15a0fa8640 1 -- 172.21.15.134:0/4133537707 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f159c075df0 con 0x7f159c06e720 2024-04-25T12:21:01.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.460+0000 7f1592ffd640 1 -- 172.21.15.134:0/4133537707 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f159401d580 con 0x7f159c06e720 2024-04-25T12:21:01.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.528+0000 7f15a0fa8640 1 -- 172.21.15.134:0/4133537707 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c5597e50-1962-4103-9124-dd7bceb8ac97", "id": 7} v 0) -- 0x7f159c166800 con 0x7f159c06e720 2024-04-25T12:21:01.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.536+0000 7f1592ffd640 1 -- 172.21.15.134:0/4133537707 <== mon.2 v2:172.21.15.134:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c5597e50-1962-4103-9124-dd7bceb8ac97", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f159401d830 con 0x7f159c06e720 2024-04-25T12:21:01.541 INFO:teuthology.orchestra.run.smithi134.stdout:7 2024-04-25T12:21:01.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.536+0000 7f15a0fa8640 1 -- 172.21.15.134:0/4133537707 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f159c06e720 msgr2=0x7f159c0c6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:01.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.536+0000 7f15a0fa8640 1 --2- 172.21.15.134:0/4133537707 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f159c06e720 0x7f159c0c6290 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f159400ba80 tx=0x7f159400bf40 comp rx=0 tx=0).stop 2024-04-25T12:21:01.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.536+0000 7f15a0fa8640 1 -- 172.21.15.134:0/4133537707 shutdown_connections 2024-04-25T12:21:01.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.536+0000 7f15a0fa8640 1 --2- 172.21.15.134:0/4133537707 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f159c15bd40 0x7f159c0732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:01.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.536+0000 7f15a0fa8640 1 --2- 172.21.15.134:0/4133537707 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f159c158880 0x7f159c1f8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:01.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.536+0000 7f15a0fa8640 1 --2- 172.21.15.134:0/4133537707 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f159c06e720 0x7f159c0c6290 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:01.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.536+0000 7f15a0fa8640 1 -- 172.21.15.134:0/4133537707 >> 172.21.15.134:0/4133537707 conn(0x7f159c06f280 msgr2=0x7f159c06c300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:01.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.536+0000 7f15a0fa8640 1 -- 172.21.15.134:0/4133537707 shutdown_connections 2024-04-25T12:21:01.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-25T12:21:01.536+0000 7f15a0fa8640 1 -- 172.21.15.134:0/4133537707 wait complete. 2024-04-25T12:21:01.557 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-25T12:21:01.557 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-25T12:21:01.560 INFO:tasks.ceph.osd.0:Started 2024-04-25T12:21:01.560 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-25T12:21:01.560 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-25T12:21:01.563 INFO:tasks.ceph.osd.1:Started 2024-04-25T12:21:01.563 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-25T12:21:01.563 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-25T12:21:01.565 INFO:tasks.ceph.osd.2:Started 2024-04-25T12:21:01.565 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-25T12:21:01.565 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-25T12:21:01.568 INFO:tasks.ceph.osd.3:Started 2024-04-25T12:21:01.568 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-25T12:21:01.568 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-25T12:21:01.570 INFO:tasks.ceph.osd.4:Started 2024-04-25T12:21:01.570 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-25T12:21:01.570 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-25T12:21:01.572 INFO:tasks.ceph.osd.5:Started 2024-04-25T12:21:01.572 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-25T12:21:01.572 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-25T12:21:01.574 INFO:tasks.ceph.osd.6:Started 2024-04-25T12:21:01.574 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-25T12:21:01.574 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-25T12:21:01.576 INFO:tasks.ceph.osd.7:Started 2024-04-25T12:21:01.576 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T12:21:01.741 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:01.736+0000 7f481df86640 1 Processor -- start 2024-04-25T12:21:01.741 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:01.736+0000 7f481df86640 1 -- start start 2024-04-25T12:21:01.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:01.736+0000 7f481df86640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f481815b7c0 0x7f48180c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:01.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:01.736+0000 7f481df86640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f481815bc10 con 0x7f48180cda50 2024-04-25T12:21:01.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:01.736+0000 7f481df86640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f481815beb0 con 0x7f4818155350 2024-04-25T12:21:01.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:01.736+0000 7f481df86640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f48180cca40 con 0x7f481815b7c0 2024-04-25T12:21:01.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:01.740+0000 7f4816ffd640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f48180cda50 0x7f481815b0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:41440/0 (socket says 172.21.15.86:41440) 2024-04-25T12:21:01.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:01.740+0000 7f4816ffd640 1 -- 172.21.15.86:0/697717862 learned_addr learned my addr 172.21.15.86:0/697717862 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-04-25T12:21:01.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:01.740+0000 7f4817fff640 1 --2- 172.21.15.86:0/697717862 >> v2:172.21.15.134:3300/0 conn(0x7f481815b7c0 0x7f48180c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:01.743 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:01.740+0000 7f48167fc640 1 -- 172.21.15.86:0/697717862 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4144614372 0 0) 0x7f481815bc10 con 0x7f48180cda50 2024-04-25T12:21:01.743 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:01.740+0000 7f48167fc640 1 -- 172.21.15.86:0/697717862 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4800003530 con 0x7f48180cda50 2024-04-25T12:21:01.743 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:01.740+0000 7f48167fc640 1 -- 172.21.15.86:0/697717862 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4227718425 0 0) 0x7f481815beb0 con 0x7f4818155350 2024-04-25T12:21:01.743 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:01.740+0000 7f48167fc640 1 -- 172.21.15.86:0/697717862 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f481815bc10 con 0x7f4818155350 2024-04-25T12:21:01.743 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:01.740+0000 7f4817fff640 1 -- 172.21.15.86:0/697717862 >> v1:172.21.15.134:6789/0 conn(0x7f4818155350 legacy=0x7f48180cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:01.743 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:01.740+0000 7f4817fff640 1 -- 172.21.15.86:0/697717862 >> v1:172.21.15.86:6789/0 conn(0x7f48180cda50 legacy=0x7f481815b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:01.743 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:01.740+0000 7f4817fff640 1 -- 172.21.15.86:0/697717862 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48180ccc90 con 0x7f481815b7c0 2024-04-25T12:21:01.745 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:01.740+0000 7f4817fff640 1 --2- 172.21.15.86:0/697717862 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f481815b7c0 0x7f48180c59c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f48100097c0 tx=0x7f481001ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=957daa24846640ef server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:01.745 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:01.740+0000 7f48167fc640 1 -- 172.21.15.86:0/697717862 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48100b5070 con 0x7f481815b7c0 2024-04-25T12:21:01.745 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:01.740+0000 7f48167fc640 1 -- 172.21.15.86:0/697717862 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48100a8990 con 0x7f481815b7c0 2024-04-25T12:21:01.745 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:01.740+0000 7f48167fc640 1 -- 172.21.15.86:0/697717862 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48100a8d60 con 0x7f481815b7c0 2024-04-25T12:21:01.745 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:01.740+0000 7f481df86640 1 -- 172.21.15.86:0/697717862 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f481815b7c0 msgr2=0x7f48180c59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:01.745 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:01.740+0000 7f481df86640 1 --2- 172.21.15.86:0/697717862 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f481815b7c0 0x7f48180c59c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f48100097c0 tx=0x7f481001ec90 comp rx=0 tx=0).stop 2024-04-25T12:21:01.746 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:01.740+0000 7f481df86640 1 -- 172.21.15.86:0/697717862 shutdown_connections 2024-04-25T12:21:01.746 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:01.740+0000 7f481df86640 1 --2- 172.21.15.86:0/697717862 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f481815b7c0 0x7f48180c59c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:01.746 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:01.740+0000 7f481df86640 1 -- 172.21.15.86:0/697717862 >> 172.21.15.86:0/697717862 conn(0x7f481806cc30 msgr2=0x7f481806d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:01.746 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:01.740+0000 7f481df86640 1 -- 172.21.15.86:0/697717862 shutdown_connections 2024-04-25T12:21:01.746 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:01.740+0000 7f481df86640 1 -- 172.21.15.86:0/697717862 wait complete. 2024-04-25T12:21:01.746 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:01.744+0000 7f481df86640 1 Processor -- start 2024-04-25T12:21:01.746 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:01.744+0000 7f481df86640 1 -- start start 2024-04-25T12:21:01.748 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:01.744+0000 7f481df86640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f48180cda50 0x7f48180b6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:01.749 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:01.744+0000 7f481df86640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4818155350 0x7f48180b4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:01.749 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:01.744+0000 7f481df86640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f481815b7c0 0x7f48181f1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:01.749 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:01.744+0000 7f481df86640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f48180cd530 con 0x7f481815b7c0 2024-04-25T12:21:01.749 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:01.744+0000 7f481df86640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f48180cd250 con 0x7f4818155350 2024-04-25T12:21:01.749 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:01.744+0000 7f481df86640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f4818155730 con 0x7f48180cda50 2024-04-25T12:21:01.749 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:01.744+0000 7f4817fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f481815b7c0 0x7f48181f1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:01.749 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:01.744+0000 7f4817fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f481815b7c0 0x7f48181f1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:47262/0 (socket says 172.21.15.86:47262) 2024-04-25T12:21:01.749 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:01.744+0000 7f4817fff640 1 -- 172.21.15.86:0/824865223 learned_addr learned my addr 172.21.15.86:0/824865223 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:01.749 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:01.744+0000 7f4816ffd640 1 --2- 172.21.15.86:0/824865223 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4818155350 0x7f48180b4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:01.749 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:01.744+0000 7f48177fe640 1 --2- 172.21.15.86:0/824865223 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f48180cda50 0x7f48180b6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:01.749 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:01.744+0000 7f4817fff640 1 -- 172.21.15.86:0/824865223 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f48180cda50 msgr2=0x7f48180b6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:01.749 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:01.744+0000 7f4817fff640 1 --2- 172.21.15.86:0/824865223 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f48180cda50 0x7f48180b6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:01.749 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:01.744+0000 7f4817fff640 1 -- 172.21.15.86:0/824865223 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4818155350 msgr2=0x7f48180b4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:01.749 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:01.744+0000 7f4817fff640 1 --2- 172.21.15.86:0/824865223 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4818155350 0x7f48180b4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:01.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:01.744+0000 7f4817fff640 1 -- 172.21.15.86:0/824865223 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48181f0dc0 con 0x7f481815b7c0 2024-04-25T12:21:01.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:01.744+0000 7f4817fff640 1 --2- 172.21.15.86:0/824865223 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f481815b7c0 0x7f48181f1880 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f481001b8a0 tx=0x7f481001ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:01.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:01.744+0000 7f47fffff640 1 -- 172.21.15.86:0/824865223 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48100bf070 con 0x7f481815b7c0 2024-04-25T12:21:01.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:01.744+0000 7f47fffff640 1 -- 172.21.15.86:0/824865223 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48100b0640 con 0x7f481815b7c0 2024-04-25T12:21:01.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:01.744+0000 7f481df86640 1 -- 172.21.15.86:0/824865223 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48180b5f50 con 0x7f481815b7c0 2024-04-25T12:21:01.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:01.744+0000 7f47fffff640 1 -- 172.21.15.86:0/824865223 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48100b5040 con 0x7f481815b7c0 2024-04-25T12:21:01.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:01.744+0000 7f481df86640 1 -- 172.21.15.86:0/824865223 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48181f1080 con 0x7f481815b7c0 2024-04-25T12:21:01.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:01.744+0000 7f47fffff640 1 -- 172.21.15.86:0/824865223 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f48100c2070 con 0x7f481815b7c0 2024-04-25T12:21:01.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:01.744+0000 7f47fffff640 1 -- 172.21.15.86:0/824865223 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f48100b9ac0 con 0x7f481815b7c0 2024-04-25T12:21:01.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:01.744+0000 7f481df86640 1 -- 172.21.15.86:0/824865223 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4818075df0 con 0x7f481815b7c0 2024-04-25T12:21:01.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:01.748+0000 7f47fffff640 1 -- 172.21.15.86:0/824865223 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f48100c9020 con 0x7f481815b7c0 2024-04-25T12:21:01.808 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:01.804+0000 7f481df86640 1 -- 172.21.15.86:0/824865223 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f48180cc610 con 0x7f481815b7c0 2024-04-25T12:21:01.809 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:01.804+0000 7f47fffff640 1 -- 172.21.15.86:0/824865223 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f48100187f0 con 0x7f481815b7c0 2024-04-25T12:21:01.809 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:21:01.809 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":10,"fsid":"f2ef5c0c-9576-4650-b4f7-6cb14247f62a","created":"2024-04-25T12:20:59.241733+0000","modified":"2024-04-25T12:21:01.534145+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T12:21:01.534145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"1f713f00-ef9f-4a6f-a620-38a8a1f8a822","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"baf6606d-a556-4fbe-a930-855e04ff1534","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c983d68e-6d60-434f-aed6-108420c5dd09","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e77657bb-45aa-43bf-ab41-c7377eb495ea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"252bd300-d75a-4b00-be4b-27e6b51de4ab","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4135da3f-7427-4409-a48e-78bd8a7b46ba","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b6e7a5f1-fa7e-497d-abac-a19994d26820","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c5597e50-1962-4103-9124-dd7bceb8ac97","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T12:21:01.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:01.804+0000 7f481df86640 1 -- 172.21.15.86:0/824865223 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f481815b7c0 msgr2=0x7f48181f1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:01.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:01.804+0000 7f481df86640 1 --2- 172.21.15.86:0/824865223 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f481815b7c0 0x7f48181f1880 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f481001b8a0 tx=0x7f481001ba30 comp rx=0 tx=0).stop 2024-04-25T12:21:01.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:01.808+0000 7f481df86640 1 -- 172.21.15.86:0/824865223 shutdown_connections 2024-04-25T12:21:01.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:01.808+0000 7f481df86640 1 --2- 172.21.15.86:0/824865223 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f481815b7c0 0x7f48181f1880 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:01.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:01.808+0000 7f481df86640 1 --2- 172.21.15.86:0/824865223 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4818155350 0x7f48180b4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:01.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:01.808+0000 7f481df86640 1 --2- 172.21.15.86:0/824865223 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f48180cda50 0x7f48180b6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:01.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:01.808+0000 7f481df86640 1 -- 172.21.15.86:0/824865223 >> 172.21.15.86:0/824865223 conn(0x7f481806cc30 msgr2=0x7f48181e6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:01.811 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:01.808+0000 7f481df86640 1 -- 172.21.15.86:0/824865223 shutdown_connections 2024-04-25T12:21:01.811 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:01.808+0000 7f481df86640 1 -- 172.21.15.86:0/824865223 wait complete. 2024-04-25T12:21:01.825 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-25T12:21:01.826 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-25T12:21:01.888 INFO:tasks.ceph.mgr.y.smithi086.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-25T12:21:01.888 INFO:tasks.ceph.mgr.y.smithi086.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-25T12:21:01.888 INFO:tasks.ceph.mgr.y.smithi086.stderr: from numpy import show_config as show_numpy_config 2024-04-25T12:21:01.926 INFO:tasks.ceph.mgr.x.smithi134.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-25T12:21:01.926 INFO:tasks.ceph.mgr.x.smithi134.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-25T12:21:01.926 INFO:tasks.ceph.mgr.x.smithi134.stderr: from numpy import show_config as show_numpy_config 2024-04-25T12:21:01.927 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-04-25T12:21:01.924+0000 7f606f77e180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T12:21:01.957 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-04-25T12:21:01.952+0000 7fe46337d7c0 -1 Falling back to public interface 2024-04-25T12:21:01.957 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-04-25T12:21:01.952+0000 7efe474947c0 -1 Falling back to public interface 2024-04-25T12:21:01.976 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-04-25T12:21:01.972+0000 7fc89e9637c0 -1 Falling back to public interface 2024-04-25T12:21:01.981 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-25T12:21:01.976+0000 7faf748c5180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T12:21:01.984 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-04-25T12:21:01.980+0000 7ff8fde347c0 -1 Falling back to public interface 2024-04-25T12:21:02.057 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-04-25T12:21:02.052+0000 7f606f77e180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T12:21:02.128 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-25T12:21:02.124+0000 7faf748c5180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T12:21:02.211 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-04-25T12:21:02.208+0000 7f606f77e180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T12:21:02.215 INFO:tasks.ceph.osd.0.smithi086.stderr:2024-04-25T12:21:02.212+0000 7f3f64e787c0 -1 Falling back to public interface 2024-04-25T12:21:02.219 INFO:tasks.ceph.osd.1.smithi086.stderr:2024-04-25T12:21:02.216+0000 7fce62f057c0 -1 Falling back to public interface 2024-04-25T12:21:02.238 INFO:tasks.ceph.osd.2.smithi086.stderr:2024-04-25T12:21:02.236+0000 7fb0337d17c0 -1 Falling back to public interface 2024-04-25T12:21:02.239 INFO:tasks.ceph.osd.3.smithi086.stderr:2024-04-25T12:21:02.236+0000 7f32f20d07c0 -1 Falling back to public interface 2024-04-25T12:21:02.280 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-04-25T12:21:02.276+0000 7f606f77e180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T12:21:02.303 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-25T12:21:02.296+0000 7faf748c5180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T12:21:02.366 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-25T12:21:02.360+0000 7faf748c5180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T12:21:02.412 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-04-25T12:21:02.408+0000 7f606f77e180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T12:21:02.499 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-25T12:21:02.492+0000 7faf748c5180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T12:21:02.630 DEBUG:teuthology.orchestra.run.smithi086:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T12:21:02.737 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.732+0000 7f2de22c2640 1 Processor -- start 2024-04-25T12:21:02.737 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.732+0000 7f2de22c2640 1 -- start start 2024-04-25T12:21:02.740 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.736+0000 7f2de22c2640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ddc06cd50 0x7f2ddc15bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:02.740 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.736+0000 7f2de22c2640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ddc0735c0 con 0x7f2ddc06d130 2024-04-25T12:21:02.740 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.736+0000 7f2de22c2640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ddc0738a0 con 0x7f2ddc0cf3b0 2024-04-25T12:21:02.740 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.736+0000 7f2de22c2640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f2ddc15c0c0 con 0x7f2ddc06cd50 2024-04-25T12:21:02.740 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.736+0000 7f2dd3fff640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f2ddc06d130 0x7f2ddc144020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:44470/0 (socket says 172.21.15.86:44470) 2024-04-25T12:21:02.740 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.736+0000 7f2dd3fff640 1 -- 172.21.15.86:0/345612476 learned_addr learned my addr 172.21.15.86:0/345612476 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-04-25T12:21:02.740 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.736+0000 7f2ddbfff640 1 --2- 172.21.15.86:0/345612476 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ddc06cd50 0x7f2ddc15bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:02.741 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.736+0000 7f2ddb7fe640 1 -- 172.21.15.86:0/345612476 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2266639794 0 0) 0x7f2ddc0735c0 con 0x7f2ddc06d130 2024-04-25T12:21:02.741 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.736+0000 7f2ddb7fe640 1 -- 172.21.15.86:0/345612476 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2dc8003530 con 0x7f2ddc06d130 2024-04-25T12:21:02.741 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.736+0000 7f2ddb7fe640 1 -- 172.21.15.86:0/345612476 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4209217370 0 0) 0x7f2dc8003530 con 0x7f2ddc06d130 2024-04-25T12:21:02.741 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.736+0000 7f2ddb7fe640 1 -- 172.21.15.86:0/345612476 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ddc06cd50 msgr2=0x7f2ddc15bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:02.741 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.736+0000 7f2ddb7fe640 1 --2- 172.21.15.86:0/345612476 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ddc06cd50 0x7f2ddc15bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:02.741 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.736+0000 7f2ddb7fe640 1 -- 172.21.15.86:0/345612476 >> v1:172.21.15.134:6789/0 conn(0x7f2ddc0cf3b0 legacy=0x7f2ddc071160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:02.741 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.736+0000 7f2ddb7fe640 1 -- 172.21.15.86:0/345612476 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ddc073b80 con 0x7f2ddc06d130 2024-04-25T12:21:02.741 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.736+0000 7f2ddb7fe640 1 -- 172.21.15.86:0/345612476 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1387950573 0 0) 0x7f2dc4001680 con 0x7f2ddc06d130 2024-04-25T12:21:02.741 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.736+0000 7f2ddbfff640 1 --2- 172.21.15.86:0/345612476 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ddc06cd50 0x7f2ddc15bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T12:21:02.741 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.736+0000 7f2ddb7fe640 1 -- 172.21.15.86:0/345612476 >> v1:172.21.15.86:6789/0 conn(0x7f2ddc06d130 legacy=0x7f2ddc144020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:02.741 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.736+0000 7f2ddb7fe640 1 --2- 172.21.15.86:0/345612476 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2dc80039f0 0x7f2dc8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:02.741 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.736+0000 7f2ddb7fe640 1 --2- 172.21.15.86:0/345612476 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ddc06cd50 0x7f2dc8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:02.741 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.736+0000 7f2ddb7fe640 1 --2- 172.21.15.86:0/345612476 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2dc8004d50 0x7f2dc80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:02.741 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.736+0000 7f2ddb7fe640 1 -- 172.21.15.86:0/345612476 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc800b9d0 con 0x7f2dc80039f0 2024-04-25T12:21:02.742 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.736+0000 7f2ddb7fe640 1 -- 172.21.15.86:0/345612476 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc800bb50 con 0x7f2dc8004d50 2024-04-25T12:21:02.742 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.736+0000 7f2ddb7fe640 1 -- 172.21.15.86:0/345612476 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f2dc800bd00 con 0x7f2ddc06cd50 2024-04-25T12:21:02.742 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.736+0000 7f2ddbfff640 1 --2- 172.21.15.86:0/345612476 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2dc80039f0 0x7f2dc8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:02.742 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.736+0000 7f2dd3fff640 1 --2- 172.21.15.86:0/345612476 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ddc06cd50 0x7f2dc8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:02.742 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.736+0000 7f2de085f640 1 --2- 172.21.15.86:0/345612476 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2dc8004d50 0x7f2dc80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:02.742 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.736+0000 7f2ddbfff640 1 -- 172.21.15.86:0/345612476 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ddc06cd50 msgr2=0x7f2dc8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:02.742 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.736+0000 7f2ddbfff640 1 --2- 172.21.15.86:0/345612476 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ddc06cd50 0x7f2dc8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:02.742 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.736+0000 7f2ddbfff640 1 -- 172.21.15.86:0/345612476 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2dc8004d50 msgr2=0x7f2dc80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:02.742 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.736+0000 7f2ddbfff640 1 --2- 172.21.15.86:0/345612476 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2dc8004d50 0x7f2dc80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:02.742 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.736+0000 7f2ddbfff640 1 -- 172.21.15.86:0/345612476 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dc8003530 con 0x7f2dc80039f0 2024-04-25T12:21:02.743 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.736+0000 7f2ddbfff640 1 --2- 172.21.15.86:0/345612476 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2dc80039f0 0x7f2dc8003dd0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc009cb0 tx=0x7f2dcc01cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4657382af6f58c2e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:02.743 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.740+0000 7f2ddb7fe640 1 -- 172.21.15.86:0/345612476 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dcc0b2070 con 0x7f2dc80039f0 2024-04-25T12:21:02.743 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.740+0000 7f2ddb7fe640 1 -- 172.21.15.86:0/345612476 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dcc0a58d0 con 0x7f2dc80039f0 2024-04-25T12:21:02.743 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.740+0000 7f2ddb7fe640 1 -- 172.21.15.86:0/345612476 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dcc009880 con 0x7f2dc80039f0 2024-04-25T12:21:02.743 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.740+0000 7f2de22c2640 1 -- 172.21.15.86:0/345612476 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2dc80039f0 msgr2=0x7f2dc8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:02.743 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.740+0000 7f2de22c2640 1 --2- 172.21.15.86:0/345612476 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2dc80039f0 0x7f2dc8003dd0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc009cb0 tx=0x7f2dcc01cc10 comp rx=0 tx=0).stop 2024-04-25T12:21:02.743 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.740+0000 7f2de085f640 1 -- 172.21.15.86:0/345612476 reap_dead start 2024-04-25T12:21:02.744 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.740+0000 7f2de22c2640 1 -- 172.21.15.86:0/345612476 shutdown_connections 2024-04-25T12:21:02.744 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.740+0000 7f2de22c2640 1 -- 172.21.15.86:0/345612476 >> 172.21.15.86:0/345612476 conn(0x7f2ddc0ce890 msgr2=0x7f2ddc0ceca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:02.744 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.740+0000 7f2de22c2640 1 -- 172.21.15.86:0/345612476 shutdown_connections 2024-04-25T12:21:02.744 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.740+0000 7f2de22c2640 1 -- 172.21.15.86:0/345612476 wait complete. 2024-04-25T12:21:02.746 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.740+0000 7f2de22c2640 1 Processor -- start 2024-04-25T12:21:02.746 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.740+0000 7f2de22c2640 1 -- start start 2024-04-25T12:21:02.746 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.740+0000 7f2de22c2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2dc80039f0 0x7f2ddc157c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:02.746 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.740+0000 7f2de22c2640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2ddc14a430 0x7f2ddc0cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:02.747 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.740+0000 7f2de22c2640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ddc1f3e20 0x7f2ddc1f42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:02.747 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.740+0000 7f2de22c2640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f2ddc070cd0 con 0x7f2ddc14a430 2024-04-25T12:21:02.747 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.740+0000 7f2de22c2640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2ddc073370 con 0x7f2dc80039f0 2024-04-25T12:21:02.747 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.740+0000 7f2de22c2640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f2ddc074140 con 0x7f2ddc1f3e20 2024-04-25T12:21:02.747 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.740+0000 7f2dd3fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2ddc14a430 0x7f2ddc0cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:02.747 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.740+0000 7f2dd3fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2ddc14a430 0x7f2ddc0cd1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35040/0 (socket says 172.21.15.86:35040) 2024-04-25T12:21:02.747 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.740+0000 7f2dd3fff640 1 -- 172.21.15.86:0/987271253 learned_addr learned my addr 172.21.15.86:0/987271253 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:02.747 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.740+0000 7f2de085f640 1 --2- 172.21.15.86:0/987271253 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ddc1f3e20 0x7f2ddc1f42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:02.747 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.740+0000 7f2ddbfff640 1 --2- 172.21.15.86:0/987271253 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2dc80039f0 0x7f2ddc157c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:02.747 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.740+0000 7f2dd3fff640 1 -- 172.21.15.86:0/987271253 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ddc1f3e20 msgr2=0x7f2ddc1f42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:02.747 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.740+0000 7f2dd3fff640 1 --2- 172.21.15.86:0/987271253 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ddc1f3e20 0x7f2ddc1f42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:02.747 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.740+0000 7f2dd3fff640 1 -- 172.21.15.86:0/987271253 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2dc80039f0 msgr2=0x7f2ddc157c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:02.747 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.740+0000 7f2dd3fff640 1 --2- 172.21.15.86:0/987271253 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2dc80039f0 0x7f2ddc157c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:02.747 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.740+0000 7f2dd3fff640 1 -- 172.21.15.86:0/987271253 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ddc151020 con 0x7f2ddc14a430 2024-04-25T12:21:02.747 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.740+0000 7f2de085f640 1 --2- 172.21.15.86:0/987271253 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ddc1f3e20 0x7f2ddc1f42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:21:02.748 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.740+0000 7f2dd3fff640 1 --2- 172.21.15.86:0/987271253 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2ddc14a430 0x7f2ddc0cd1b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2dc400e880 tx=0x7f2dc400ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:02.748 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.740+0000 7f2dd97fa640 1 -- 172.21.15.86:0/987271253 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc400c8d0 con 0x7f2ddc14a430 2024-04-25T12:21:02.748 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.740+0000 7f2dd97fa640 1 -- 172.21.15.86:0/987271253 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dc4018070 con 0x7f2ddc14a430 2024-04-25T12:21:02.748 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.740+0000 7f2de22c2640 1 -- 172.21.15.86:0/987271253 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ddc1f47e0 con 0x7f2ddc14a430 2024-04-25T12:21:02.748 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.740+0000 7f2dd97fa640 1 -- 172.21.15.86:0/987271253 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc400ccd0 con 0x7f2ddc14a430 2024-04-25T12:21:02.748 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.740+0000 7f2de22c2640 1 -- 172.21.15.86:0/987271253 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ddc150d40 con 0x7f2ddc14a430 2024-04-25T12:21:02.748 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.740+0000 7f2dd97fa640 1 -- 172.21.15.86:0/987271253 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2dc401d460 con 0x7f2ddc14a430 2024-04-25T12:21:02.748 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.740+0000 7f2dd97fa640 1 -- 172.21.15.86:0/987271253 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f2dc4013d70 con 0x7f2ddc14a430 2024-04-25T12:21:02.748 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.744+0000 7f2de22c2640 1 -- 172.21.15.86:0/987271253 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ddc0763e0 con 0x7f2ddc14a430 2024-04-25T12:21:02.748 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.744+0000 7f2dd97fa640 1 -- 172.21.15.86:0/987271253 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f2ddc1f47e0 con 0x7f2ddc14a430 2024-04-25T12:21:02.846 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.844+0000 7f2de22c2640 1 -- 172.21.15.86:0/987271253 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2ddc0c5930 con 0x7f2ddc14a430 2024-04-25T12:21:02.847 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.844+0000 7f2dd97fa640 1 -- 172.21.15.86:0/987271253 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f2dc40136a0 con 0x7f2ddc14a430 2024-04-25T12:21:02.847 INFO:teuthology.misc.health.smithi086.stdout: 2024-04-25T12:21:02.847 INFO:teuthology.misc.health.smithi086.stdout:{"epoch":10,"fsid":"f2ef5c0c-9576-4650-b4f7-6cb14247f62a","created":"2024-04-25T12:20:59.241733+0000","modified":"2024-04-25T12:21:01.534145+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T12:21:01.534145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"1f713f00-ef9f-4a6f-a620-38a8a1f8a822","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"baf6606d-a556-4fbe-a930-855e04ff1534","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c983d68e-6d60-434f-aed6-108420c5dd09","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e77657bb-45aa-43bf-ab41-c7377eb495ea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"252bd300-d75a-4b00-be4b-27e6b51de4ab","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4135da3f-7427-4409-a48e-78bd8a7b46ba","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b6e7a5f1-fa7e-497d-abac-a19994d26820","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c5597e50-1962-4103-9124-dd7bceb8ac97","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T12:21:02.848 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.844+0000 7f2de22c2640 1 -- 172.21.15.86:0/987271253 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2ddc14a430 msgr2=0x7f2ddc0cd1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:02.848 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.844+0000 7f2de22c2640 1 --2- 172.21.15.86:0/987271253 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2ddc14a430 0x7f2ddc0cd1b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2dc400e880 tx=0x7f2dc400ed40 comp rx=0 tx=0).stop 2024-04-25T12:21:02.848 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.844+0000 7f2de22c2640 1 -- 172.21.15.86:0/987271253 shutdown_connections 2024-04-25T12:21:02.848 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.844+0000 7f2de22c2640 1 --2- 172.21.15.86:0/987271253 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ddc1f3e20 0x7f2ddc1f42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:02.848 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.844+0000 7f2de22c2640 1 --2- 172.21.15.86:0/987271253 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2ddc14a430 0x7f2ddc0cd1b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:02.848 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.844+0000 7f2de22c2640 1 --2- 172.21.15.86:0/987271253 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2dc80039f0 0x7f2ddc157c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:02.848 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.844+0000 7f2de22c2640 1 -- 172.21.15.86:0/987271253 >> 172.21.15.86:0/987271253 conn(0x7f2ddc0ce890 msgr2=0x7f2ddc15a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:02.849 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.844+0000 7f2de22c2640 1 -- 172.21.15.86:0/987271253 shutdown_connections 2024-04-25T12:21:02.849 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:02.844+0000 7f2de22c2640 1 -- 172.21.15.86:0/987271253 wait complete. 2024-04-25T12:21:02.865 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-25T12:21:03.087 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-04-25T12:21:03.084+0000 7f606f77e180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T12:21:03.115 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-25T12:21:03.108+0000 7faf748c5180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T12:21:03.161 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-04-25T12:21:03.156+0000 7f606f77e180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T12:21:03.189 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-25T12:21:03.184+0000 7faf748c5180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T12:21:03.342 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-04-25T12:21:03.340+0000 7f606f77e180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T12:21:03.372 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-25T12:21:03.368+0000 7faf748c5180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T12:21:03.415 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-04-25T12:21:03.412+0000 7f606f77e180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T12:21:03.445 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-25T12:21:03.440+0000 7faf748c5180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T12:21:03.702 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-04-25T12:21:03.696+0000 7f606f77e180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T12:21:03.733 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-25T12:21:03.728+0000 7faf748c5180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T12:21:03.763 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-04-25T12:21:03.760+0000 7f606f77e180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T12:21:03.796 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-25T12:21:03.792+0000 7faf748c5180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T12:21:04.803 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-04-25T12:21:04.800+0000 7f6016bc9640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-25T12:21:04.808 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-04-25T12:21:04.804+0000 7f6016bc9640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-25T12:21:05.799 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-04-25T12:21:05.792+0000 7ff8fde347c0 -1 osd.6 0 log_to_monitors true 2024-04-25T12:21:05.802 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-04-25T12:21:05.796+0000 7fe46337d7c0 -1 osd.4 0 log_to_monitors true 2024-04-25T12:21:05.837 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-04-25T12:21:05.832+0000 7efe474947c0 -1 osd.5 0 log_to_monitors true 2024-04-25T12:21:05.842 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-04-25T12:21:05.836+0000 7fc89e9637c0 -1 osd.7 0 log_to_monitors true 2024-04-25T12:21:06.038 INFO:tasks.ceph.osd.0.smithi086.stderr:2024-04-25T12:21:06.036+0000 7f3f64e787c0 -1 osd.0 0 log_to_monitors true 2024-04-25T12:21:06.139 INFO:tasks.ceph.osd.3.smithi086.stderr:2024-04-25T12:21:06.136+0000 7f32f20d07c0 -1 osd.3 0 log_to_monitors true 2024-04-25T12:21:06.152 INFO:tasks.ceph.osd.1.smithi086.stderr:2024-04-25T12:21:06.148+0000 7fce62f057c0 -1 osd.1 0 log_to_monitors true 2024-04-25T12:21:06.159 INFO:tasks.ceph.osd.2.smithi086.stderr:2024-04-25T12:21:06.156+0000 7fb0337d17c0 -1 osd.2 0 log_to_monitors true 2024-04-25T12:21:09.670 DEBUG:teuthology.orchestra.run.smithi086:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T12:21:09.814 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:09.812+0000 7fb9f11f0640 1 Processor -- start 2024-04-25T12:21:09.815 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:09.812+0000 7fb9f11f0640 1 -- start start 2024-04-25T12:21:09.815 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:09.812+0000 7fb9f11f0640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb9ec151c70 0x7fb9ec158710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:09.815 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:09.812+0000 7fb9f11f0640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb9ec15bf00 0x7fb9ec072820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:09.815 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:09.812+0000 7fb9f11f0640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9ec0c3580 con 0x7fb9ec0718e0 2024-04-25T12:21:09.816 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:09.812+0000 7fb9f11f0640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7fb9ec072d60 con 0x7fb9ec15bf00 2024-04-25T12:21:09.816 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:09.812+0000 7fb9f11f0640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fb9ec0c3860 con 0x7fb9ec151c70 2024-04-25T12:21:09.816 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:09.812+0000 7fb9ea59c640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb9ec15bf00 0x7fb9ec072820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:09.816 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:09.812+0000 7fb9ead9d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb9ec151c70 0x7fb9ec158710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:09.816 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:09.812+0000 7fb9eb59e640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fb9ec0718e0 0x7fb9ec0c8870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.86:54500/0 (socket says 172.21.15.86:54500) 2024-04-25T12:21:09.817 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:09.812+0000 7fb9eb59e640 1 -- 172.21.15.86:0/2819986622 learned_addr learned my addr 172.21.15.86:0/2819986622 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-04-25T12:21:09.817 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:09.812+0000 7fb9e9d9b640 1 -- 172.21.15.86:0/2819986622 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3314053334 0 0) 0x7fb9ec0c3580 con 0x7fb9ec0718e0 2024-04-25T12:21:09.817 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:09.812+0000 7fb9e9d9b640 1 -- 172.21.15.86:0/2819986622 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb9d4003530 con 0x7fb9ec0718e0 2024-04-25T12:21:09.817 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:09.812+0000 7fb9ead9d640 1 -- 172.21.15.86:0/2819986622 >> v2:172.21.15.86:3300/0 conn(0x7fb9ec15bf00 msgr2=0x7fb9ec072820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:09.817 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:09.812+0000 7fb9ead9d640 1 --2- 172.21.15.86:0/2819986622 >> v2:172.21.15.86:3300/0 conn(0x7fb9ec15bf00 0x7fb9ec072820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:09.817 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:09.812+0000 7fb9ead9d640 1 -- 172.21.15.86:0/2819986622 >> v1:172.21.15.134:6789/0 conn(0x7fb9ec0718e0 legacy=0x7fb9ec0c8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:09.817 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:09.812+0000 7fb9ead9d640 1 -- 172.21.15.86:0/2819986622 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9ec15b420 con 0x7fb9ec151c70 2024-04-25T12:21:09.818 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:09.812+0000 7fb9ea59c640 1 --2- 172.21.15.86:0/2819986622 >> v2:172.21.15.86:3300/0 conn(0x7fb9ec15bf00 0x7fb9ec072820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T12:21:09.820 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:09.816+0000 7fb9ead9d640 1 --2- 172.21.15.86:0/2819986622 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9ec151c70 0x7fb9ec158710 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec0cddb0 tx=0x7fb9dc01ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d735960d214973ff server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:09.821 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:09.816+0000 7fb9e9d9b640 1 -- 172.21.15.86:0/2819986622 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc0b5070 con 0x7fb9ec151c70 2024-04-25T12:21:09.821 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:09.816+0000 7fb9e9d9b640 1 -- 172.21.15.86:0/2819986622 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9dc0a8970 con 0x7fb9ec151c70 2024-04-25T12:21:09.821 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:09.816+0000 7fb9e9d9b640 1 -- 172.21.15.86:0/2819986622 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc0a8d40 con 0x7fb9ec151c70 2024-04-25T12:21:09.824 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:09.820+0000 7fb9f11f0640 1 -- 172.21.15.86:0/2819986622 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9ec151c70 msgr2=0x7fb9ec158710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:09.824 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:09.820+0000 7fb9f11f0640 1 --2- 172.21.15.86:0/2819986622 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9ec151c70 0x7fb9ec158710 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec0cddb0 tx=0x7fb9dc01ec70 comp rx=0 tx=0).stop 2024-04-25T12:21:09.824 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:09.820+0000 7fb9f11f0640 1 -- 172.21.15.86:0/2819986622 shutdown_connections 2024-04-25T12:21:09.824 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:09.820+0000 7fb9f11f0640 1 --2- 172.21.15.86:0/2819986622 >> v2:172.21.15.86:3300/0 conn(0x7fb9ec15bf00 0x7fb9ec072820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:09.824 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:09.820+0000 7fb9f11f0640 1 --2- 172.21.15.86:0/2819986622 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9ec151c70 0x7fb9ec158710 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:09.824 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:09.820+0000 7fb9f11f0640 1 -- 172.21.15.86:0/2819986622 >> 172.21.15.86:0/2819986622 conn(0x7fb9ec0ccd60 msgr2=0x7fb9ec0cd170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:09.824 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:09.820+0000 7fb9f11f0640 1 -- 172.21.15.86:0/2819986622 shutdown_connections 2024-04-25T12:21:09.824 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:09.820+0000 7fb9f11f0640 1 -- 172.21.15.86:0/2819986622 wait complete. 2024-04-25T12:21:09.826 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:09.824+0000 7fb9f11f0640 1 Processor -- start 2024-04-25T12:21:09.828 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:09.824+0000 7fb9f11f0640 1 -- start start 2024-04-25T12:21:09.828 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:09.824+0000 7fb9f11f0640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb9ec0718e0 0x7fb9ec14e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:09.828 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:09.824+0000 7fb9f11f0640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9ec151c70 0x7fb9ec142a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:09.828 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:09.824+0000 7fb9f11f0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9ec15bf00 0x7fb9ec144550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:09.828 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:09.824+0000 7fb9f11f0640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb9ec152050 con 0x7fb9ec151c70 2024-04-25T12:21:09.828 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:09.824+0000 7fb9f11f0640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb9ec15b9e0 con 0x7fb9ec15bf00 2024-04-25T12:21:09.829 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:09.824+0000 7fb9f11f0640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fb9ec1521d0 con 0x7fb9ec0718e0 2024-04-25T12:21:09.829 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:09.824+0000 7fb9ea59c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9ec151c70 0x7fb9ec142a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:09.829 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:09.824+0000 7fb9ea59c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9ec151c70 0x7fb9ec142a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35164/0 (socket says 172.21.15.86:35164) 2024-04-25T12:21:09.829 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:09.824+0000 7fb9ea59c640 1 -- 172.21.15.86:0/3796565434 learned_addr learned my addr 172.21.15.86:0/3796565434 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:09.829 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:09.824+0000 7fb9eb59e640 1 --2- 172.21.15.86:0/3796565434 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9ec15bf00 0x7fb9ec144550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:09.829 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:09.824+0000 7fb9ead9d640 1 --2- 172.21.15.86:0/3796565434 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb9ec0718e0 0x7fb9ec14e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:09.829 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:09.824+0000 7fb9ea59c640 1 -- 172.21.15.86:0/3796565434 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb9ec0718e0 msgr2=0x7fb9ec14e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:09.829 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:09.824+0000 7fb9ea59c640 1 --2- 172.21.15.86:0/3796565434 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb9ec0718e0 0x7fb9ec14e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:09.829 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:09.824+0000 7fb9ea59c640 1 -- 172.21.15.86:0/3796565434 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9ec15bf00 msgr2=0x7fb9ec144550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:09.830 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:09.824+0000 7fb9ea59c640 1 --2- 172.21.15.86:0/3796565434 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9ec15bf00 0x7fb9ec144550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:09.830 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:09.824+0000 7fb9ea59c640 1 -- 172.21.15.86:0/3796565434 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9ec14db00 con 0x7fb9ec151c70 2024-04-25T12:21:09.830 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:09.824+0000 7fb9ea59c640 1 --2- 172.21.15.86:0/3796565434 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9ec151c70 0x7fb9ec142a80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb9e000e9b0 tx=0x7fb9e000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:09.830 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:09.824+0000 7fb9d37fe640 1 -- 172.21.15.86:0/3796565434 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9e0017070 con 0x7fb9ec151c70 2024-04-25T12:21:09.830 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:09.824+0000 7fb9f11f0640 1 -- 172.21.15.86:0/3796565434 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9ec14dde0 con 0x7fb9ec151c70 2024-04-25T12:21:09.830 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:09.824+0000 7fb9f11f0640 1 -- 172.21.15.86:0/3796565434 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9ec14e3a0 con 0x7fb9ec151c70 2024-04-25T12:21:09.830 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:09.824+0000 7fb9d37fe640 1 -- 172.21.15.86:0/3796565434 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9e0009420 con 0x7fb9ec151c70 2024-04-25T12:21:09.830 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:09.824+0000 7fb9d37fe640 1 -- 172.21.15.86:0/3796565434 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9e000cc20 con 0x7fb9ec151c70 2024-04-25T12:21:09.831 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:09.828+0000 7fb9f11f0640 1 -- 172.21.15.86:0/3796565434 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9cc0052a0 con 0x7fb9ec151c70 2024-04-25T12:21:09.832 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:09.828+0000 7fb9d37fe640 1 -- 172.21.15.86:0/3796565434 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) ==== 87931+0+0 (secure 0 0 0) 0x7fb9e001a070 con 0x7fb9ec151c70 2024-04-25T12:21:09.833 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:09.828+0000 7fb9d37fe640 1 --2- 172.21.15.86:0/3796565434 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fb9d80682f0 0x7fb9d806a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:09.833 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:09.828+0000 7fb9d37fe640 1 -- 172.21.15.86:0/3796565434 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7fb9e0085c70 con 0x7fb9ec151c70 2024-04-25T12:21:09.833 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:09.828+0000 7fb9ead9d640 1 --2- 172.21.15.86:0/3796565434 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fb9d80682f0 0x7fb9d806a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:09.833 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:09.828+0000 7fb9ead9d640 1 --2- 172.21.15.86:0/3796565434 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fb9d80682f0 0x7fb9d806a7b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc0b2000 tx=0x7fb9dc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:09.840 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:09.836+0000 7fb9d37fe640 1 -- 172.21.15.86:0/3796565434 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb9e0056a50 con 0x7fb9ec151c70 2024-04-25T12:21:09.918 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-04-25T12:21:09.916+0000 7ff8f9ddd640 -1 osd.6 0 waiting for initial osdmap 2024-04-25T12:21:09.938 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-04-25T12:21:09.936+0000 7fe45f326640 -1 osd.4 0 waiting for initial osdmap 2024-04-25T12:21:09.941 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-04-25T12:21:09.940+0000 7ff8f1c11640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T12:21:09.960 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-04-25T12:21:09.960+0000 7fe45715a640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T12:21:10.000 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-04-25T12:21:10.000+0000 7efe4343d640 -1 osd.5 0 waiting for initial osdmap 2024-04-25T12:21:10.017 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-04-25T12:21:10.016+0000 7fc89a90c640 -1 osd.7 0 waiting for initial osdmap 2024-04-25T12:21:10.032 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-04-25T12:21:10.032+0000 7efe3b271640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T12:21:10.044 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-04-25T12:21:10.044+0000 7fc892740640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T12:21:10.066 INFO:tasks.ceph.osd.0.smithi086.stderr:2024-04-25T12:21:10.060+0000 7f3f60e21640 -1 osd.0 0 waiting for initial osdmap 2024-04-25T12:21:10.111 INFO:tasks.ceph.osd.0.smithi086.stderr:2024-04-25T12:21:10.108+0000 7f3f58c55640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T12:21:10.122 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:10.120+0000 7fb9f11f0640 1 -- 172.21.15.86:0/3796565434 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb9cc005590 con 0x7fb9ec151c70 2024-04-25T12:21:10.123 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:10.120+0000 7fb9d37fe640 1 -- 172.21.15.86:0/3796565434 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7fb9e005ad50 con 0x7fb9ec151c70 2024-04-25T12:21:10.123 INFO:teuthology.misc.health.smithi086.stdout: 2024-04-25T12:21:10.123 INFO:teuthology.misc.health.smithi086.stdout:{"epoch":12,"fsid":"f2ef5c0c-9576-4650-b4f7-6cb14247f62a","created":"2024-04-25T12:20:59.241733+0000","modified":"2024-04-25T12:21:07.806241+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T12:21:01.534145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"1f713f00-ef9f-4a6f-a620-38a8a1f8a822","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"baf6606d-a556-4fbe-a930-855e04ff1534","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c983d68e-6d60-434f-aed6-108420c5dd09","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e77657bb-45aa-43bf-ab41-c7377eb495ea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"252bd300-d75a-4b00-be4b-27e6b51de4ab","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4135da3f-7427-4409-a48e-78bd8a7b46ba","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b6e7a5f1-fa7e-497d-abac-a19994d26820","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c5597e50-1962-4103-9124-dd7bceb8ac97","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T12:21:10.125 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:10.120+0000 7fb9f11f0640 1 -- 172.21.15.86:0/3796565434 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fb9d80682f0 msgr2=0x7fb9d806a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:10.125 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:10.120+0000 7fb9f11f0640 1 --2- 172.21.15.86:0/3796565434 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fb9d80682f0 0x7fb9d806a7b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc0b2000 tx=0x7fb9dc008040 comp rx=0 tx=0).stop 2024-04-25T12:21:10.126 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:10.120+0000 7fb9f11f0640 1 -- 172.21.15.86:0/3796565434 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9ec151c70 msgr2=0x7fb9ec142a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:10.126 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:10.120+0000 7fb9f11f0640 1 --2- 172.21.15.86:0/3796565434 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9ec151c70 0x7fb9ec142a80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb9e000e9b0 tx=0x7fb9e000ee70 comp rx=0 tx=0).stop 2024-04-25T12:21:10.126 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:10.120+0000 7fb9f11f0640 1 -- 172.21.15.86:0/3796565434 shutdown_connections 2024-04-25T12:21:10.126 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:10.120+0000 7fb9f11f0640 1 --2- 172.21.15.86:0/3796565434 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9ec15bf00 0x7fb9ec144550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:10.126 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:10.120+0000 7fb9f11f0640 1 --2- 172.21.15.86:0/3796565434 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fb9d80682f0 0x7fb9d806a7b0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:10.126 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:10.120+0000 7fb9f11f0640 1 --2- 172.21.15.86:0/3796565434 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9ec151c70 0x7fb9ec142a80 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:10.126 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:10.120+0000 7fb9f11f0640 1 --2- 172.21.15.86:0/3796565434 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb9ec0718e0 0x7fb9ec14e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:10.126 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:10.120+0000 7fb9f11f0640 1 -- 172.21.15.86:0/3796565434 >> 172.21.15.86:0/3796565434 conn(0x7fb9ec0ccd60 msgr2=0x7fb9ec150ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:10.126 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:10.120+0000 7fb9f11f0640 1 -- 172.21.15.86:0/3796565434 shutdown_connections 2024-04-25T12:21:10.126 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:10.120+0000 7fb9f11f0640 1 -- 172.21.15.86:0/3796565434 wait complete. 2024-04-25T12:21:10.142 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-25T12:21:10.174 INFO:tasks.ceph.osd.3.smithi086.stderr:2024-04-25T12:21:10.168+0000 7f32ee079640 -1 osd.3 0 waiting for initial osdmap 2024-04-25T12:21:10.203 INFO:tasks.ceph.osd.3.smithi086.stderr:2024-04-25T12:21:10.200+0000 7f32e5ead640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T12:21:10.208 INFO:tasks.ceph.osd.2.smithi086.stderr:2024-04-25T12:21:10.204+0000 7fb02f77a640 -1 osd.2 0 waiting for initial osdmap 2024-04-25T12:21:10.214 INFO:tasks.ceph.osd.1.smithi086.stderr:2024-04-25T12:21:10.212+0000 7fce5f6c0640 -1 osd.1 0 waiting for initial osdmap 2024-04-25T12:21:10.235 INFO:tasks.ceph.osd.1.smithi086.stderr:2024-04-25T12:21:10.232+0000 7fce56ce2640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T12:21:10.235 INFO:tasks.ceph.osd.2.smithi086.stderr:2024-04-25T12:21:10.232+0000 7fb0275ae640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T12:21:16.948 DEBUG:teuthology.orchestra.run.smithi086:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T12:21:17.070 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.068+0000 7f0b9eda6640 1 Processor -- start 2024-04-25T12:21:17.070 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.068+0000 7f0b9eda6640 1 -- start start 2024-04-25T12:21:17.072 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.068+0000 7f0b9eda6640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0b98151dd0 0x7f0b980c4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:17.072 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.068+0000 7f0b9eda6640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0b98070e90 0x7f0b9806b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:17.072 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.068+0000 7f0b9eda6640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b980c8240 con 0x7f0b980c7a00 2024-04-25T12:21:17.072 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.068+0000 7f0b9eda6640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f0b980c7570 con 0x7f0b98070e90 2024-04-25T12:21:17.072 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.068+0000 7f0b9eda6640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f0b980c84e0 con 0x7f0b98151dd0 2024-04-25T12:21:17.072 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.068+0000 7f0b9d343640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0b98070e90 0x7f0b9806b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:17.073 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.068+0000 7f0b9d343640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0b98070e90 0x7f0b9806b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41560/0 (socket says 172.21.15.86:41560) 2024-04-25T12:21:17.073 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.068+0000 7f0b9d343640 1 -- 172.21.15.86:0/1088924553 learned_addr learned my addr 172.21.15.86:0/1088924553 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:17.073 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.068+0000 7f0b9cb42640 1 --2- 172.21.15.86:0/1088924553 >> v2:172.21.15.134:3300/0 conn(0x7f0b98151dd0 0x7f0b980c4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:17.073 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.068+0000 7f0b9d343640 1 -- 172.21.15.86:0/1088924553 >> v2:172.21.15.134:3300/0 conn(0x7f0b98151dd0 msgr2=0x7f0b980c4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:17.073 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.068+0000 7f0b9d343640 1 --2- 172.21.15.86:0/1088924553 >> v2:172.21.15.134:3300/0 conn(0x7f0b98151dd0 0x7f0b980c4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:17.073 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.068+0000 7f0b9d343640 1 -- 172.21.15.86:0/1088924553 >> v1:172.21.15.134:6789/0 conn(0x7f0b980c7a00 legacy=0x7f0b98158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:17.073 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.068+0000 7f0b9d343640 1 -- 172.21.15.86:0/1088924553 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b980c8780 con 0x7f0b98070e90 2024-04-25T12:21:17.073 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.068+0000 7f0b9cb42640 1 --2- 172.21.15.86:0/1088924553 >> v2:172.21.15.134:3300/0 conn(0x7f0b98151dd0 0x7f0b980c4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:21:17.074 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.072+0000 7f0b9d343640 1 --2- 172.21.15.86:0/1088924553 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b98070e90 0x7f0b9806b9e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0b980c76f0 tx=0x7f0b9001f1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=791dadb9327be89a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:17.075 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.072+0000 7f0b977fe640 1 -- 172.21.15.86:0/1088924553 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b900b4070 con 0x7f0b98070e90 2024-04-25T12:21:17.075 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.072+0000 7f0b977fe640 1 -- 172.21.15.86:0/1088924553 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b900af400 con 0x7f0b98070e90 2024-04-25T12:21:17.075 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.072+0000 7f0b977fe640 1 -- 172.21.15.86:0/1088924553 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b900af7d0 con 0x7f0b98070e90 2024-04-25T12:21:17.076 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.072+0000 7f0b9eda6640 1 -- 172.21.15.86:0/1088924553 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b98070e90 msgr2=0x7f0b9806b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:17.076 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.072+0000 7f0b9eda6640 1 --2- 172.21.15.86:0/1088924553 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b98070e90 0x7f0b9806b9e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0b980c76f0 tx=0x7f0b9001f1a0 comp rx=0 tx=0).stop 2024-04-25T12:21:17.076 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.072+0000 7f0b9eda6640 1 -- 172.21.15.86:0/1088924553 shutdown_connections 2024-04-25T12:21:17.076 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.072+0000 7f0b9eda6640 1 --2- 172.21.15.86:0/1088924553 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b98070e90 0x7f0b9806b9e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:17.076 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.072+0000 7f0b9eda6640 1 --2- 172.21.15.86:0/1088924553 >> v2:172.21.15.134:3300/0 conn(0x7f0b98151dd0 0x7f0b980c4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:17.076 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.072+0000 7f0b9eda6640 1 -- 172.21.15.86:0/1088924553 >> 172.21.15.86:0/1088924553 conn(0x7f0b980cc520 msgr2=0x7f0b980cc930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:17.076 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.072+0000 7f0b9eda6640 1 -- 172.21.15.86:0/1088924553 shutdown_connections 2024-04-25T12:21:17.076 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.072+0000 7f0b9eda6640 1 -- 172.21.15.86:0/1088924553 wait complete. 2024-04-25T12:21:17.077 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.072+0000 7f0b9eda6640 1 Processor -- start 2024-04-25T12:21:17.077 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.072+0000 7f0b9eda6640 1 -- start start 2024-04-25T12:21:17.079 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.072+0000 7f0b9eda6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b98070e90 0x7f0b98150060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:17.079 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.072+0000 7f0b9eda6640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b980c7a00 0x7f0b98145580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:17.079 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.072+0000 7f0b9eda6640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0b98151dd0 0x7f0b98145ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:17.079 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.072+0000 7f0b9eda6640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f0b980c7de0 con 0x7f0b980c7a00 2024-04-25T12:21:17.079 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.072+0000 7f0b9eda6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0b980c7200 con 0x7f0b98070e90 2024-04-25T12:21:17.079 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.072+0000 7f0b9eda6640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f0b981521b0 con 0x7f0b98151dd0 2024-04-25T12:21:17.079 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.072+0000 7f0b97fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b980c7a00 0x7f0b98145580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:17.079 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.072+0000 7f0b97fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b980c7a00 0x7f0b98145580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41564/0 (socket says 172.21.15.86:41564) 2024-04-25T12:21:17.079 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.072+0000 7f0b97fff640 1 -- 172.21.15.86:0/963858460 learned_addr learned my addr 172.21.15.86:0/963858460 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:17.079 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.072+0000 7f0b9cb42640 1 --2- 172.21.15.86:0/963858460 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b98070e90 0x7f0b98150060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:17.079 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.072+0000 7f0b97fff640 1 -- 172.21.15.86:0/963858460 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0b98151dd0 msgr2=0x7f0b98145ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:17.080 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.072+0000 7f0b9d343640 1 --2- 172.21.15.86:0/963858460 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0b98151dd0 0x7f0b98145ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:17.080 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.072+0000 7f0b97fff640 1 --2- 172.21.15.86:0/963858460 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0b98151dd0 0x7f0b98145ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:17.080 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.072+0000 7f0b97fff640 1 -- 172.21.15.86:0/963858460 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b98070e90 msgr2=0x7f0b98150060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:17.080 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.072+0000 7f0b97fff640 1 --2- 172.21.15.86:0/963858460 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b98070e90 0x7f0b98150060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:17.080 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.072+0000 7f0b97fff640 1 -- 172.21.15.86:0/963858460 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b9814ce80 con 0x7f0b980c7a00 2024-04-25T12:21:17.080 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.072+0000 7f0b9cb42640 1 --2- 172.21.15.86:0/963858460 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b98070e90 0x7f0b98150060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:21:17.080 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.072+0000 7f0b97fff640 1 --2- 172.21.15.86:0/963858460 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b980c7a00 0x7f0b98145580 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0b8400c480 tx=0x7f0b8400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:17.080 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.072+0000 7f0b957fa640 1 -- 172.21.15.86:0/963858460 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b84012830 con 0x7f0b980c7a00 2024-04-25T12:21:17.080 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.072+0000 7f0b957fa640 1 -- 172.21.15.86:0/963858460 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b84017070 con 0x7f0b980c7a00 2024-04-25T12:21:17.080 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.072+0000 7f0b9eda6640 1 -- 172.21.15.86:0/963858460 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b9814d120 con 0x7f0b980c7a00 2024-04-25T12:21:17.080 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.072+0000 7f0b957fa640 1 -- 172.21.15.86:0/963858460 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b84012c30 con 0x7f0b980c7a00 2024-04-25T12:21:17.080 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.072+0000 7f0b9eda6640 1 -- 172.21.15.86:0/963858460 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b9814d6e0 con 0x7f0b980c7a00 2024-04-25T12:21:17.080 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.076+0000 7f0b9eda6640 1 -- 172.21.15.86:0/963858460 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b980763e0 con 0x7f0b980c7a00 2024-04-25T12:21:17.081 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.076+0000 7f0b957fa640 1 -- 172.21.15.86:0/963858460 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0b8401c460 con 0x7f0b980c7a00 2024-04-25T12:21:17.081 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.076+0000 7f0b957fa640 1 --2- 172.21.15.86:0/963858460 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f0b7c0683b0 0x7f0b7c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:17.081 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.076+0000 7f0b9cb42640 1 --2- 172.21.15.86:0/963858460 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f0b7c0683b0 0x7f0b7c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:17.081 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.076+0000 7f0b957fa640 1 -- 172.21.15.86:0/963858460 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f0b84086410 con 0x7f0b980c7a00 2024-04-25T12:21:17.081 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.076+0000 7f0b9cb42640 1 --2- 172.21.15.86:0/963858460 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f0b7c0683b0 0x7f0b7c06a870 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c008890 tx=0x7f0b8c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:17.112 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.108+0000 7f0b957fa640 1 -- 172.21.15.86:0/963858460 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0b84056d10 con 0x7f0b980c7a00 2024-04-25T12:21:17.277 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.272+0000 7f0b9eda6640 1 -- 172.21.15.86:0/963858460 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0b981452e0 con 0x7f0b980c7a00 2024-04-25T12:21:17.278 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.276+0000 7f0b957fa640 1 -- 172.21.15.86:0/963858460 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12884 (secure 0 0 0) 0x7f0b84056610 con 0x7f0b980c7a00 2024-04-25T12:21:17.279 INFO:teuthology.misc.health.smithi086.stdout: 2024-04-25T12:21:17.279 INFO:teuthology.misc.health.smithi086.stdout:{"epoch":16,"fsid":"f2ef5c0c-9576-4650-b4f7-6cb14247f62a","created":"2024-04-25T12:20:59.241733+0000","modified":"2024-04-25T12:21:14.033457+0000","last_up_change":"2024-04-25T12:21:10.939617+0000","last_in_change":"2024-04-25T12:21:01.534145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T12:21:11.839922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1f713f00-ef9f-4a6f-a620-38a8a1f8a822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6801","nonce":2812764579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6803","nonce":2812764579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6807","nonce":2812764579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6805","nonce":2812764579}]},"public_addr":"172.21.15.86:6801/2812764579","cluster_addr":"172.21.15.86:6803/2812764579","heartbeat_back_addr":"172.21.15.86:6807/2812764579","heartbeat_front_addr":"172.21.15.86:6805/2812764579","state":["exists","up"]},{"osd":1,"uuid":"baf6606d-a556-4fbe-a930-855e04ff1534","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6809","nonce":467966038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6811","nonce":467966038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6815","nonce":467966038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6813","nonce":467966038}]},"public_addr":"172.21.15.86:6809/467966038","cluster_addr":"172.21.15.86:6811/467966038","heartbeat_back_addr":"172.21.15.86:6815/467966038","heartbeat_front_addr":"172.21.15.86:6813/467966038","state":["exists","up"]},{"osd":2,"uuid":"c983d68e-6d60-434f-aed6-108420c5dd09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6817","nonce":3279762843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6820","nonce":3279762843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6825","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6827","nonce":3279762843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6824","nonce":3279762843}]},"public_addr":"172.21.15.86:6817/3279762843","cluster_addr":"172.21.15.86:6820/3279762843","heartbeat_back_addr":"172.21.15.86:6827/3279762843","heartbeat_front_addr":"172.21.15.86:6824/3279762843","state":["exists","up"]},{"osd":3,"uuid":"e77657bb-45aa-43bf-ab41-c7377eb495ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6821","nonce":2861354413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6826","nonce":2861354413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6831","nonce":2861354413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6829","nonce":2861354413}]},"public_addr":"172.21.15.86:6821/2861354413","cluster_addr":"172.21.15.86:6826/2861354413","heartbeat_back_addr":"172.21.15.86:6831/2861354413","heartbeat_front_addr":"172.21.15.86:6829/2861354413","state":["exists","up"]},{"osd":4,"uuid":"252bd300-d75a-4b00-be4b-27e6b51de4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6802","nonce":1872913602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6805","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6808","nonce":1872913602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6815","nonce":1872913602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6813","nonce":1872913602}]},"public_addr":"172.21.15.134:6802/1872913602","cluster_addr":"172.21.15.134:6808/1872913602","heartbeat_back_addr":"172.21.15.134:6815/1872913602","heartbeat_front_addr":"172.21.15.134:6813/1872913602","state":["exists","up"]},{"osd":5,"uuid":"4135da3f-7427-4409-a48e-78bd8a7b46ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6801","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6803","nonce":2261413981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6806","nonce":2261413981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6812","nonce":2261413981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6809","nonce":2261413981}]},"public_addr":"172.21.15.134:6803/2261413981","cluster_addr":"172.21.15.134:6806/2261413981","heartbeat_back_addr":"172.21.15.134:6812/2261413981","heartbeat_front_addr":"172.21.15.134:6809/2261413981","state":["exists","up"]},{"osd":6,"uuid":"b6e7a5f1-fa7e-497d-abac-a19994d26820","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6825","nonce":2841082767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6827","nonce":2841082767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6831","nonce":2841082767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6829","nonce":2841082767}]},"public_addr":"172.21.15.134:6825/2841082767","cluster_addr":"172.21.15.134:6827/2841082767","heartbeat_back_addr":"172.21.15.134:6831/2841082767","heartbeat_front_addr":"172.21.15.134:6829/2841082767","state":["exists","up"]},{"osd":7,"uuid":"c5597e50-1962-4103-9124-dd7bceb8ac97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6817","nonce":1277404274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6819","nonce":1277404274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6823","nonce":1277404274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6821","nonce":1277404274}]},"public_addr":"172.21.15.134:6817/1277404274","cluster_addr":"172.21.15.134:6819/1277404274","heartbeat_back_addr":"172.21.15.134:6823/1277404274","heartbeat_front_addr":"172.21.15.134:6821/1277404274","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.018125+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.157958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.113619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.136904+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.844514+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.872629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.775339+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.822867+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T12:21:17.281 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.276+0000 7f0b9eda6640 1 -- 172.21.15.86:0/963858460 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f0b7c0683b0 msgr2=0x7f0b7c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:17.281 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.276+0000 7f0b9eda6640 1 --2- 172.21.15.86:0/963858460 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f0b7c0683b0 0x7f0b7c06a870 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c008890 tx=0x7f0b8c008040 comp rx=0 tx=0).stop 2024-04-25T12:21:17.281 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.276+0000 7f0b9eda6640 1 -- 172.21.15.86:0/963858460 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b980c7a00 msgr2=0x7f0b98145580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:17.281 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.276+0000 7f0b9eda6640 1 --2- 172.21.15.86:0/963858460 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b980c7a00 0x7f0b98145580 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0b8400c480 tx=0x7f0b8400c940 comp rx=0 tx=0).stop 2024-04-25T12:21:17.282 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.276+0000 7f0b9eda6640 1 -- 172.21.15.86:0/963858460 shutdown_connections 2024-04-25T12:21:17.282 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.276+0000 7f0b9eda6640 1 --2- 172.21.15.86:0/963858460 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0b98151dd0 0x7f0b98145ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:17.282 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.276+0000 7f0b9eda6640 1 --2- 172.21.15.86:0/963858460 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f0b7c0683b0 0x7f0b7c06a870 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:17.282 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.276+0000 7f0b9eda6640 1 --2- 172.21.15.86:0/963858460 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b980c7a00 0x7f0b98145580 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:17.282 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.276+0000 7f0b9eda6640 1 --2- 172.21.15.86:0/963858460 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b98070e90 0x7f0b98150060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:17.282 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.276+0000 7f0b9eda6640 1 -- 172.21.15.86:0/963858460 >> 172.21.15.86:0/963858460 conn(0x7f0b980cc520 msgr2=0x7f0b9814f600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:17.282 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.276+0000 7f0b9eda6640 1 -- 172.21.15.86:0/963858460 shutdown_connections 2024-04-25T12:21:17.282 INFO:teuthology.misc.health.smithi086.stderr:2024-04-25T12:21:17.276+0000 7f0b9eda6640 1 -- 172.21.15.86:0/963858460 wait complete. 2024-04-25T12:21:17.297 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-25T12:21:17.297 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-25T12:21:17.297 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T12:21:17.297 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T12:21:17.300 INFO:tasks.ceph.mds.a:Started 2024-04-25T12:21:17.300 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T12:21:17.300 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T12:21:17.302 INFO:tasks.ceph.mds.c:Started 2024-04-25T12:21:17.303 INFO:tasks.ceph.mds.e:Restarting daemon 2024-04-25T12:21:17.303 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2024-04-25T12:21:17.305 INFO:tasks.ceph.mds.e:Started 2024-04-25T12:21:17.305 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T12:21:17.305 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T12:21:17.308 INFO:tasks.ceph.mds.b:Started 2024-04-25T12:21:17.308 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T12:21:17.308 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T12:21:17.310 INFO:tasks.ceph.mds.d:Started 2024-04-25T12:21:17.311 INFO:tasks.ceph.mds.f:Restarting daemon 2024-04-25T12:21:17.311 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i f 2024-04-25T12:21:17.313 INFO:tasks.ceph.mds.f:Started 2024-04-25T12:21:17.313 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-25T12:21:17.313 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T12:21:17.377 INFO:tasks.ceph.mds.e.smithi086.stdout:starting mds.e at 2024-04-25T12:21:17.384 INFO:tasks.ceph.mds.c.smithi086.stdout:starting mds.c at 2024-04-25T12:21:17.384 INFO:tasks.ceph.mds.a.smithi086.stdout:starting mds.a at 2024-04-25T12:21:17.397 INFO:tasks.ceph.mds.d.smithi134.stdout:starting mds.d at 2024-04-25T12:21:17.403 INFO:tasks.ceph.mds.f.smithi134.stdout:starting mds.f at 2024-04-25T12:21:17.404 INFO:tasks.ceph.mds.b.smithi134.stdout:starting mds.b at 2024-04-25T12:21:17.429 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.424+0000 7f76aaa3a640 1 Processor -- start 2024-04-25T12:21:17.429 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.424+0000 7f76aaa3a640 1 -- start start 2024-04-25T12:21:17.430 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.424+0000 7f76aaa3a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f76a40c9c10 0x7f76a40c91c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:17.430 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.424+0000 7f76aaa3a640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f76a40c9700 0x7f76a4152c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:17.430 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.424+0000 7f76aaa3a640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76a40ca960 con 0x7f76a40c5f20 2024-04-25T12:21:17.430 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.424+0000 7f76aaa3a640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f76a40c7f30 con 0x7f76a40c9700 2024-04-25T12:21:17.430 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.424+0000 7f76aaa3a640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f76a40ca0c0 con 0x7f76a40c9c10 2024-04-25T12:21:17.430 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.424+0000 7f76a8fd7640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f76a40c9700 0x7f76a4152c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:17.430 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.424+0000 7f76a8fd7640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f76a40c9700 0x7f76a4152c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41634/0 (socket says 172.21.15.86:41634) 2024-04-25T12:21:17.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.424+0000 7f76a8fd7640 1 -- 172.21.15.86:0/3534324487 learned_addr learned my addr 172.21.15.86:0/3534324487 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:17.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.424+0000 7f76a37fe640 1 --2- 172.21.15.86:0/3534324487 >> v2:172.21.15.134:3300/0 conn(0x7f76a40c9c10 0x7f76a40c91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:17.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.424+0000 7f76a8fd7640 1 -- 172.21.15.86:0/3534324487 >> v2:172.21.15.134:3300/0 conn(0x7f76a40c9c10 msgr2=0x7f76a40c91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:17.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.424+0000 7f76a8fd7640 1 --2- 172.21.15.86:0/3534324487 >> v2:172.21.15.134:3300/0 conn(0x7f76a40c9c10 0x7f76a40c91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:17.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.424+0000 7f76a8fd7640 1 -- 172.21.15.86:0/3534324487 >> v1:172.21.15.134:6789/0 conn(0x7f76a40c5f20 legacy=0x7f76a40c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:17.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.424+0000 7f76a8fd7640 1 -- 172.21.15.86:0/3534324487 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76a40ca3a0 con 0x7f76a40c9700 2024-04-25T12:21:17.433 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.428+0000 7f76a8fd7640 1 --2- 172.21.15.86:0/3534324487 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76a40c9700 0x7f76a4152c70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f76a4068500 tx=0x7f769c01f1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b976d99f6dbda78 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:17.433 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.428+0000 7f76a2ffd640 1 -- 172.21.15.86:0/3534324487 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f769c0b4070 con 0x7f76a40c9700 2024-04-25T12:21:17.433 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.428+0000 7f76a2ffd640 1 -- 172.21.15.86:0/3534324487 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f769c0af400 con 0x7f76a40c9700 2024-04-25T12:21:17.433 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.428+0000 7f76a2ffd640 1 -- 172.21.15.86:0/3534324487 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f769c0af7d0 con 0x7f76a40c9700 2024-04-25T12:21:17.433 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.428+0000 7f76aaa3a640 1 -- 172.21.15.86:0/3534324487 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76a40c9700 msgr2=0x7f76a4152c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:17.433 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.428+0000 7f76aaa3a640 1 --2- 172.21.15.86:0/3534324487 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76a40c9700 0x7f76a4152c70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f76a4068500 tx=0x7f769c01f1a0 comp rx=0 tx=0).stop 2024-04-25T12:21:17.433 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.428+0000 7f76aaa3a640 1 -- 172.21.15.86:0/3534324487 shutdown_connections 2024-04-25T12:21:17.433 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.428+0000 7f76aaa3a640 1 --2- 172.21.15.86:0/3534324487 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76a40c9700 0x7f76a4152c70 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:17.433 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.428+0000 7f76aaa3a640 1 --2- 172.21.15.86:0/3534324487 >> v2:172.21.15.134:3300/0 conn(0x7f76a40c9c10 0x7f76a40c91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:17.434 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.428+0000 7f76aaa3a640 1 -- 172.21.15.86:0/3534324487 >> 172.21.15.86:0/3534324487 conn(0x7f76a40676a0 msgr2=0x7f76a4067ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:17.434 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.428+0000 7f76aaa3a640 1 -- 172.21.15.86:0/3534324487 shutdown_connections 2024-04-25T12:21:17.434 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.428+0000 7f76aaa3a640 1 -- 172.21.15.86:0/3534324487 wait complete. 2024-04-25T12:21:17.434 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.428+0000 7f76aaa3a640 1 Processor -- start 2024-04-25T12:21:17.434 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.428+0000 7f76aaa3a640 1 -- start start 2024-04-25T12:21:17.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.432+0000 7f76aaa3a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f76a40c5f20 0x7f76a4156d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:17.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.432+0000 7f76aaa3a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76a40c9700 0x7f76a41f08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:17.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.432+0000 7f76aaa3a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76a40c9c10 0x7f76a41f0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:17.437 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.432+0000 7f76aaa3a640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f76a40c5830 con 0x7f76a40c9c10 2024-04-25T12:21:17.437 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.432+0000 7f76aaa3a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f76a40c81d0 con 0x7f76a40c9700 2024-04-25T12:21:17.437 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.432+0000 7f76aaa3a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f76a40c59b0 con 0x7f76a40c5f20 2024-04-25T12:21:17.437 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.432+0000 7f76a8fd7640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76a40c9c10 0x7f76a41f0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:17.437 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.432+0000 7f76a8fd7640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76a40c9c10 0x7f76a41f0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41638/0 (socket says 172.21.15.86:41638) 2024-04-25T12:21:17.437 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.432+0000 7f76a8fd7640 1 -- 172.21.15.86:0/3118561312 learned_addr learned my addr 172.21.15.86:0/3118561312 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:17.437 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.432+0000 7f76a3fff640 1 --2- 172.21.15.86:0/3118561312 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f76a40c5f20 0x7f76a4156d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:17.437 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.432+0000 7f76a37fe640 1 --2- 172.21.15.86:0/3118561312 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76a40c9700 0x7f76a41f08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:17.437 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.432+0000 7f76a8fd7640 1 -- 172.21.15.86:0/3118561312 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f76a40c5f20 msgr2=0x7f76a4156d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:17.437 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.432+0000 7f76a8fd7640 1 --2- 172.21.15.86:0/3118561312 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f76a40c5f20 0x7f76a4156d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:17.437 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.432+0000 7f76a8fd7640 1 -- 172.21.15.86:0/3118561312 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76a40c9700 msgr2=0x7f76a41f08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:17.437 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.432+0000 7f76a8fd7640 1 --2- 172.21.15.86:0/3118561312 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76a40c9700 0x7f76a41f08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:17.437 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.432+0000 7f76a8fd7640 1 -- 172.21.15.86:0/3118561312 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76a41f14b0 con 0x7f76a40c9c10 2024-04-25T12:21:17.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.432+0000 7f76a37fe640 1 --2- 172.21.15.86:0/3118561312 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76a40c9700 0x7f76a41f08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:21:17.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.432+0000 7f76a8fd7640 1 --2- 172.21.15.86:0/3118561312 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76a40c9c10 0x7f76a41f0df0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f769c01cdd0 tx=0x7f769c01bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:17.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.432+0000 7f76a0ff9640 1 -- 172.21.15.86:0/3118561312 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f769c0b4040 con 0x7f76a40c9c10 2024-04-25T12:21:17.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.432+0000 7f76a0ff9640 1 -- 172.21.15.86:0/3118561312 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f769c0c0070 con 0x7f76a40c9c10 2024-04-25T12:21:17.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.432+0000 7f76a0ff9640 1 -- 172.21.15.86:0/3118561312 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f769c009510 con 0x7f76a40c9c10 2024-04-25T12:21:17.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.432+0000 7f76aaa3a640 1 -- 172.21.15.86:0/3118561312 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76a414a090 con 0x7f76a40c9c10 2024-04-25T12:21:17.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.432+0000 7f76aaa3a640 1 -- 172.21.15.86:0/3118561312 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76a414a650 con 0x7f76a40c9c10 2024-04-25T12:21:17.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.432+0000 7f76aaa3a640 1 -- 172.21.15.86:0/3118561312 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76a4075df0 con 0x7f76a40c9c10 2024-04-25T12:21:17.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.432+0000 7f76a0ff9640 1 -- 172.21.15.86:0/3118561312 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f769c0c5460 con 0x7f76a40c9c10 2024-04-25T12:21:17.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.432+0000 7f76a0ff9640 1 --2- 172.21.15.86:0/3118561312 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f76900683b0 0x7f769006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:17.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.436+0000 7f76a0ff9640 1 -- 172.21.15.86:0/3118561312 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f769c1248f0 con 0x7f76a40c9c10 2024-04-25T12:21:17.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.436+0000 7f76a3fff640 1 --2- 172.21.15.86:0/3118561312 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f76900683b0 0x7f769006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:17.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.436+0000 7f76a3fff640 1 --2- 172.21.15.86:0/3118561312 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f76900683b0 0x7f769006a870 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7698004e30 tx=0x7f7698009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:17.442 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.440+0000 7f76a0ff9640 1 -- 172.21.15.86:0/3118561312 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f769c018d00 con 0x7f76a40c9c10 2024-04-25T12:21:17.600 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.596+0000 7f76aaa3a640 1 -- 172.21.15.86:0/3118561312 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f76a40c8940 con 0x7f76a40c9c10 2024-04-25T12:21:17.602 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.600+0000 7f76a0ff9640 1 -- 172.21.15.86:0/3118561312 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12884 (secure 0 0 0) 0x7f769c0f5290 con 0x7f76a40c9c10 2024-04-25T12:21:17.603 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:21:17.603 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":16,"fsid":"f2ef5c0c-9576-4650-b4f7-6cb14247f62a","created":"2024-04-25T12:20:59.241733+0000","modified":"2024-04-25T12:21:14.033457+0000","last_up_change":"2024-04-25T12:21:10.939617+0000","last_in_change":"2024-04-25T12:21:01.534145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T12:21:11.839922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1f713f00-ef9f-4a6f-a620-38a8a1f8a822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6801","nonce":2812764579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6803","nonce":2812764579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6807","nonce":2812764579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6805","nonce":2812764579}]},"public_addr":"172.21.15.86:6801/2812764579","cluster_addr":"172.21.15.86:6803/2812764579","heartbeat_back_addr":"172.21.15.86:6807/2812764579","heartbeat_front_addr":"172.21.15.86:6805/2812764579","state":["exists","up"]},{"osd":1,"uuid":"baf6606d-a556-4fbe-a930-855e04ff1534","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6809","nonce":467966038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6811","nonce":467966038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6815","nonce":467966038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6813","nonce":467966038}]},"public_addr":"172.21.15.86:6809/467966038","cluster_addr":"172.21.15.86:6811/467966038","heartbeat_back_addr":"172.21.15.86:6815/467966038","heartbeat_front_addr":"172.21.15.86:6813/467966038","state":["exists","up"]},{"osd":2,"uuid":"c983d68e-6d60-434f-aed6-108420c5dd09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6817","nonce":3279762843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6820","nonce":3279762843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6825","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6827","nonce":3279762843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6824","nonce":3279762843}]},"public_addr":"172.21.15.86:6817/3279762843","cluster_addr":"172.21.15.86:6820/3279762843","heartbeat_back_addr":"172.21.15.86:6827/3279762843","heartbeat_front_addr":"172.21.15.86:6824/3279762843","state":["exists","up"]},{"osd":3,"uuid":"e77657bb-45aa-43bf-ab41-c7377eb495ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6821","nonce":2861354413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6826","nonce":2861354413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6831","nonce":2861354413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6829","nonce":2861354413}]},"public_addr":"172.21.15.86:6821/2861354413","cluster_addr":"172.21.15.86:6826/2861354413","heartbeat_back_addr":"172.21.15.86:6831/2861354413","heartbeat_front_addr":"172.21.15.86:6829/2861354413","state":["exists","up"]},{"osd":4,"uuid":"252bd300-d75a-4b00-be4b-27e6b51de4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6802","nonce":1872913602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6805","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6808","nonce":1872913602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6815","nonce":1872913602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6813","nonce":1872913602}]},"public_addr":"172.21.15.134:6802/1872913602","cluster_addr":"172.21.15.134:6808/1872913602","heartbeat_back_addr":"172.21.15.134:6815/1872913602","heartbeat_front_addr":"172.21.15.134:6813/1872913602","state":["exists","up"]},{"osd":5,"uuid":"4135da3f-7427-4409-a48e-78bd8a7b46ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6801","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6803","nonce":2261413981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6806","nonce":2261413981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6812","nonce":2261413981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6809","nonce":2261413981}]},"public_addr":"172.21.15.134:6803/2261413981","cluster_addr":"172.21.15.134:6806/2261413981","heartbeat_back_addr":"172.21.15.134:6812/2261413981","heartbeat_front_addr":"172.21.15.134:6809/2261413981","state":["exists","up"]},{"osd":6,"uuid":"b6e7a5f1-fa7e-497d-abac-a19994d26820","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6825","nonce":2841082767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6827","nonce":2841082767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6831","nonce":2841082767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6829","nonce":2841082767}]},"public_addr":"172.21.15.134:6825/2841082767","cluster_addr":"172.21.15.134:6827/2841082767","heartbeat_back_addr":"172.21.15.134:6831/2841082767","heartbeat_front_addr":"172.21.15.134:6829/2841082767","state":["exists","up"]},{"osd":7,"uuid":"c5597e50-1962-4103-9124-dd7bceb8ac97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6817","nonce":1277404274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6819","nonce":1277404274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6823","nonce":1277404274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6821","nonce":1277404274}]},"public_addr":"172.21.15.134:6817/1277404274","cluster_addr":"172.21.15.134:6819/1277404274","heartbeat_back_addr":"172.21.15.134:6823/1277404274","heartbeat_front_addr":"172.21.15.134:6821/1277404274","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.018125+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.157958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.113619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.136904+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.844514+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.872629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.775339+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.822867+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T12:21:17.605 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.600+0000 7f76aaa3a640 1 -- 172.21.15.86:0/3118561312 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f76900683b0 msgr2=0x7f769006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:17.605 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.600+0000 7f76aaa3a640 1 --2- 172.21.15.86:0/3118561312 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f76900683b0 0x7f769006a870 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7698004e30 tx=0x7f7698009040 comp rx=0 tx=0).stop 2024-04-25T12:21:17.605 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.600+0000 7f76aaa3a640 1 -- 172.21.15.86:0/3118561312 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76a40c9c10 msgr2=0x7f76a41f0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:17.605 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.600+0000 7f76aaa3a640 1 --2- 172.21.15.86:0/3118561312 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76a40c9c10 0x7f76a41f0df0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f769c01cdd0 tx=0x7f769c01bf40 comp rx=0 tx=0).stop 2024-04-25T12:21:17.605 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.600+0000 7f76aaa3a640 1 -- 172.21.15.86:0/3118561312 shutdown_connections 2024-04-25T12:21:17.605 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.600+0000 7f76aaa3a640 1 --2- 172.21.15.86:0/3118561312 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f76900683b0 0x7f769006a870 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:17.605 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.600+0000 7f76aaa3a640 1 --2- 172.21.15.86:0/3118561312 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76a40c9c10 0x7f76a41f0df0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:17.605 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.600+0000 7f76aaa3a640 1 --2- 172.21.15.86:0/3118561312 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76a40c9700 0x7f76a41f08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:17.605 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.600+0000 7f76aaa3a640 1 --2- 172.21.15.86:0/3118561312 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f76a40c5f20 0x7f76a4156d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:17.605 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.600+0000 7f76aaa3a640 1 -- 172.21.15.86:0/3118561312 >> 172.21.15.86:0/3118561312 conn(0x7f76a40676a0 msgr2=0x7f76a40cafe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:17.606 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.600+0000 7f76aaa3a640 1 -- 172.21.15.86:0/3118561312 shutdown_connections 2024-04-25T12:21:17.606 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.600+0000 7f76aaa3a640 1 -- 172.21.15.86:0/3118561312 wait complete. 2024-04-25T12:21:17.620 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T12:21:11.839922+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T12:21:17.620 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T12:21:17.743 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.740+0000 7f1bb4b9f640 1 Processor -- start 2024-04-25T12:21:17.743 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.740+0000 7f1bb4b9f640 1 -- start start 2024-04-25T12:21:17.744 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.740+0000 7f1bb4b9f640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1bb0074100 0x7f1bb006f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:17.744 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.740+0000 7f1bb4b9f640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bb00c5d70 con 0x7f1bb014ffa0 2024-04-25T12:21:17.744 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.740+0000 7f1bb4b9f640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bb00c6050 con 0x7f1bb014fbc0 2024-04-25T12:21:17.744 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.740+0000 7f1bb4b9f640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f1bb00c6330 con 0x7f1bb0074100 2024-04-25T12:21:17.744 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.740+0000 7f1ba5d9b640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f1bb014ffa0 0x7f1bb00c7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:54636/0 (socket says 172.21.15.86:54636) 2024-04-25T12:21:17.744 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.740+0000 7f1ba5d9b640 1 -- 172.21.15.86:0/819232020 learned_addr learned my addr 172.21.15.86:0/819232020 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-04-25T12:21:17.744 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.740+0000 7f1baed9d640 1 --2- 172.21.15.86:0/819232020 >> v2:172.21.15.86:3300/0 conn(0x7f1bb0074100 0x7f1bb006f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:17.744 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.740+0000 7f1badd9b640 1 -- 172.21.15.86:0/819232020 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 384417283 0 0) 0x7f1bb00c5d70 con 0x7f1bb014ffa0 2024-04-25T12:21:17.745 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.740+0000 7f1badd9b640 1 -- 172.21.15.86:0/819232020 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b9c003530 con 0x7f1bb014ffa0 2024-04-25T12:21:17.745 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.740+0000 7f1baed9d640 1 -- 172.21.15.86:0/819232020 >> v1:172.21.15.134:6789/0 conn(0x7f1bb014fbc0 legacy=0x7f1bb00c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:17.745 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.740+0000 7f1baed9d640 1 -- 172.21.15.86:0/819232020 >> v1:172.21.15.86:6789/0 conn(0x7f1bb014ffa0 legacy=0x7f1bb00c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:17.745 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.740+0000 7f1baed9d640 1 -- 172.21.15.86:0/819232020 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bb00c6610 con 0x7f1bb0074100 2024-04-25T12:21:17.747 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.744+0000 7f1baed9d640 1 --2- 172.21.15.86:0/819232020 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1bb0074100 0x7f1bb006f700 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1ba8009dc0 tx=0x7f1ba801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f458340dc42602d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:17.747 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.744+0000 7f1badd9b640 1 -- 172.21.15.86:0/819232020 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba80b2070 con 0x7f1bb0074100 2024-04-25T12:21:17.747 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.744+0000 7f1badd9b640 1 -- 172.21.15.86:0/819232020 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ba80a5a30 con 0x7f1bb0074100 2024-04-25T12:21:17.747 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.744+0000 7f1badd9b640 1 -- 172.21.15.86:0/819232020 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba80a5e00 con 0x7f1bb0074100 2024-04-25T12:21:17.748 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.744+0000 7f1bb4b9f640 1 -- 172.21.15.86:0/819232020 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1bb0074100 msgr2=0x7f1bb006f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:17.748 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.744+0000 7f1bb4b9f640 1 --2- 172.21.15.86:0/819232020 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1bb0074100 0x7f1bb006f700 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1ba8009dc0 tx=0x7f1ba801c950 comp rx=0 tx=0).stop 2024-04-25T12:21:17.748 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.744+0000 7f1bb4b9f640 1 -- 172.21.15.86:0/819232020 shutdown_connections 2024-04-25T12:21:17.748 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.744+0000 7f1bb4b9f640 1 --2- 172.21.15.86:0/819232020 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1bb0074100 0x7f1bb006f700 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:17.748 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.744+0000 7f1bb4b9f640 1 -- 172.21.15.86:0/819232020 >> 172.21.15.86:0/819232020 conn(0x7f1bb006b9d0 msgr2=0x7f1bb006bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:17.748 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.744+0000 7f1bb4b9f640 1 -- 172.21.15.86:0/819232020 shutdown_connections 2024-04-25T12:21:17.749 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.744+0000 7f1bb4b9f640 1 -- 172.21.15.86:0/819232020 wait complete. 2024-04-25T12:21:17.749 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.744+0000 7f1bb4b9f640 1 Processor -- start 2024-04-25T12:21:17.749 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.744+0000 7f1bb4b9f640 1 -- start start 2024-04-25T12:21:17.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.744+0000 7f1bb4b9f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1bb0074100 0x7f1bb0152d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:17.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.744+0000 7f1bb4b9f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1bb014fbc0 0x7f1bb01f57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:17.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.744+0000 7f1bb4b9f640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1bb014ffa0 0x7f1bb013edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:17.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.744+0000 7f1bb4b9f640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb0167630 con 0x7f1bb0074100 2024-04-25T12:21:17.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.744+0000 7f1bb4b9f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb01674b0 con 0x7f1bb014fbc0 2024-04-25T12:21:17.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.744+0000 7f1bb4b9f640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f1bb01677b0 con 0x7f1bb014ffa0 2024-04-25T12:21:17.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.744+0000 7f1bae59c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1bb0074100 0x7f1bb0152d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:17.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.744+0000 7f1bae59c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1bb0074100 0x7f1bb0152d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41670/0 (socket says 172.21.15.86:41670) 2024-04-25T12:21:17.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.744+0000 7f1bae59c640 1 -- 172.21.15.86:0/1388479820 learned_addr learned my addr 172.21.15.86:0/1388479820 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:17.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.744+0000 7f1bae59c640 1 -- 172.21.15.86:0/1388479820 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1bb014ffa0 msgr2=0x7f1bb013edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:17.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.744+0000 7f1bae59c640 1 --2- 172.21.15.86:0/1388479820 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1bb014ffa0 0x7f1bb013edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:17.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.744+0000 7f1bae59c640 1 -- 172.21.15.86:0/1388479820 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1bb014fbc0 msgr2=0x7f1bb01f57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:17.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.744+0000 7f1bae59c640 1 --2- 172.21.15.86:0/1388479820 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1bb014fbc0 0x7f1bb01f57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:17.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.744+0000 7f1bae59c640 1 -- 172.21.15.86:0/1388479820 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bb00c4120 con 0x7f1bb0074100 2024-04-25T12:21:17.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.748+0000 7f1bae59c640 1 --2- 172.21.15.86:0/1388479820 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1bb0074100 0x7f1bb0152d90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1ba000c420 tx=0x7f1ba000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:17.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.748+0000 7f1ba77fe640 1 -- 172.21.15.86:0/1388479820 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba00052d0 con 0x7f1bb0074100 2024-04-25T12:21:17.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.748+0000 7f1ba77fe640 1 -- 172.21.15.86:0/1388479820 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ba0005470 con 0x7f1bb0074100 2024-04-25T12:21:17.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.748+0000 7f1bb4b9f640 1 -- 172.21.15.86:0/1388479820 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bb00c4400 con 0x7f1bb0074100 2024-04-25T12:21:17.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.748+0000 7f1ba77fe640 1 -- 172.21.15.86:0/1388479820 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba0007240 con 0x7f1bb0074100 2024-04-25T12:21:17.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.748+0000 7f1bb4b9f640 1 -- 172.21.15.86:0/1388479820 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bb00c49c0 con 0x7f1bb0074100 2024-04-25T12:21:17.754 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.748+0000 7f1bb4b9f640 1 -- 172.21.15.86:0/1388479820 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bb0075df0 con 0x7f1bb0074100 2024-04-25T12:21:17.754 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.748+0000 7f1ba77fe640 1 -- 172.21.15.86:0/1388479820 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1ba00073e0 con 0x7f1bb0074100 2024-04-25T12:21:17.754 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.748+0000 7f1ba77fe640 1 --2- 172.21.15.86:0/1388479820 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f1b900683b0 0x7f1b9006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:17.754 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.748+0000 7f1ba5d9b640 1 --2- 172.21.15.86:0/1388479820 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f1b900683b0 0x7f1b9006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:17.754 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.748+0000 7f1ba77fe640 1 -- 172.21.15.86:0/1388479820 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f1ba0085b30 con 0x7f1bb0074100 2024-04-25T12:21:17.754 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.748+0000 7f1ba5d9b640 1 --2- 172.21.15.86:0/1388479820 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f1b900683b0 0x7f1b9006a870 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1b98007fd0 tx=0x7f1b98007940 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:17.757 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.752+0000 7f1ba77fe640 1 -- 172.21.15.86:0/1388479820 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1ba0056440 con 0x7f1bb0074100 2024-04-25T12:21:17.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.904+0000 7f1bb4b9f640 1 -- 172.21.15.86:0/1388479820 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1bb015d430 con 0x7f1bb0074100 2024-04-25T12:21:17.909 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.904+0000 7f1ba77fe640 1 -- 172.21.15.86:0/1388479820 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7f1bb015d430 con 0x7f1bb0074100 2024-04-25T12:21:17.909 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 1 2024-04-25T12:21:17.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.908+0000 7f1bb4b9f640 1 -- 172.21.15.86:0/1388479820 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f1b900683b0 msgr2=0x7f1b9006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:17.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.908+0000 7f1bb4b9f640 1 --2- 172.21.15.86:0/1388479820 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f1b900683b0 0x7f1b9006a870 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1b98007fd0 tx=0x7f1b98007940 comp rx=0 tx=0).stop 2024-04-25T12:21:17.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.908+0000 7f1bb4b9f640 1 -- 172.21.15.86:0/1388479820 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1bb0074100 msgr2=0x7f1bb0152d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:17.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.908+0000 7f1bb4b9f640 1 --2- 172.21.15.86:0/1388479820 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1bb0074100 0x7f1bb0152d90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1ba000c420 tx=0x7f1ba000c8e0 comp rx=0 tx=0).stop 2024-04-25T12:21:17.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.908+0000 7f1bb4b9f640 1 -- 172.21.15.86:0/1388479820 shutdown_connections 2024-04-25T12:21:17.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.908+0000 7f1bb4b9f640 1 --2- 172.21.15.86:0/1388479820 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1bb014ffa0 0x7f1bb013edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:17.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.908+0000 7f1bb4b9f640 1 --2- 172.21.15.86:0/1388479820 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1bb014fbc0 0x7f1bb01f57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:17.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.908+0000 7f1bb4b9f640 1 --2- 172.21.15.86:0/1388479820 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f1b900683b0 0x7f1b9006a870 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:17.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.908+0000 7f1bb4b9f640 1 --2- 172.21.15.86:0/1388479820 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1bb0074100 0x7f1bb0152d90 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:17.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.908+0000 7f1bb4b9f640 1 -- 172.21.15.86:0/1388479820 >> 172.21.15.86:0/1388479820 conn(0x7f1bb006b9d0 msgr2=0x7f1bb014ea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:17.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.908+0000 7f1bb4b9f640 1 -- 172.21.15.86:0/1388479820 shutdown_connections 2024-04-25T12:21:17.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:17.908+0000 7f1bb4b9f640 1 -- 172.21.15.86:0/1388479820 wait complete. 2024-04-25T12:21:17.926 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T12:21:18.041 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.036+0000 7f762cb07640 1 Processor -- start 2024-04-25T12:21:18.042 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.036+0000 7f762cb07640 1 -- start start 2024-04-25T12:21:18.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.040+0000 7f762cb07640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7628074100 0x7f762806f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:18.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.040+0000 7f762cb07640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76280c5d70 con 0x7f762814ffa0 2024-04-25T12:21:18.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.040+0000 7f762cb07640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76280c6050 con 0x7f762814fbc0 2024-04-25T12:21:18.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.040+0000 7f762cb07640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f76280c6330 con 0x7f7628074100 2024-04-25T12:21:18.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.040+0000 7f761dd9b640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f762814ffa0 0x7f76280c7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:54648/0 (socket says 172.21.15.86:54648) 2024-04-25T12:21:18.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.040+0000 7f761dd9b640 1 -- 172.21.15.86:0/34502161 learned_addr learned my addr 172.21.15.86:0/34502161 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-04-25T12:21:18.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.040+0000 7f7626d9d640 1 --2- 172.21.15.86:0/34502161 >> v2:172.21.15.134:3300/0 conn(0x7f7628074100 0x7f762806f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:18.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.040+0000 7f7625d9b640 1 -- 172.21.15.86:0/34502161 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1305262821 0 0) 0x7f76280c5d70 con 0x7f762814ffa0 2024-04-25T12:21:18.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.040+0000 7f7625d9b640 1 -- 172.21.15.86:0/34502161 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7614003530 con 0x7f762814ffa0 2024-04-25T12:21:18.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.040+0000 7f7625d9b640 1 -- 172.21.15.86:0/34502161 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3846965267 0 0) 0x7f7614003530 con 0x7f762814ffa0 2024-04-25T12:21:18.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.040+0000 7f7625d9b640 1 -- 172.21.15.86:0/34502161 >> v2:172.21.15.134:3300/0 conn(0x7f7628074100 msgr2=0x7f762806f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:18.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.040+0000 7f7625d9b640 1 --2- 172.21.15.86:0/34502161 >> v2:172.21.15.134:3300/0 conn(0x7f7628074100 0x7f762806f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:18.046 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.040+0000 7f7625d9b640 1 -- 172.21.15.86:0/34502161 >> v1:172.21.15.134:6789/0 conn(0x7f762814fbc0 legacy=0x7f76280c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:18.046 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.040+0000 7f7625d9b640 1 -- 172.21.15.86:0/34502161 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76280c6610 con 0x7f762814ffa0 2024-04-25T12:21:18.046 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.040+0000 7f7625d9b640 1 -- 172.21.15.86:0/34502161 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1387950573 0 0) 0x7f7610001680 con 0x7f762814ffa0 2024-04-25T12:21:18.046 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.040+0000 7f7625d9b640 1 -- 172.21.15.86:0/34502161 >> v1:172.21.15.86:6789/0 conn(0x7f762814ffa0 legacy=0x7f76280c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:18.046 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.040+0000 7f7625d9b640 1 --2- 172.21.15.86:0/34502161 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76140039f0 0x7f7614003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:18.046 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.040+0000 7f7625d9b640 1 --2- 172.21.15.86:0/34502161 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7614004810 0x7f7614004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:18.046 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.040+0000 7f7625d9b640 1 --2- 172.21.15.86:0/34502161 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76140051d0 0x7f761400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:18.046 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.040+0000 7f7625d9b640 1 -- 172.21.15.86:0/34502161 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f76280c6330 con 0x7f76140051d0 2024-04-25T12:21:18.046 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.040+0000 7f7625d9b640 1 -- 172.21.15.86:0/34502161 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f761400c0a0 con 0x7f76140039f0 2024-04-25T12:21:18.046 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.040+0000 7f7625d9b640 1 -- 172.21.15.86:0/34502161 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f761400c2a0 con 0x7f7614004810 2024-04-25T12:21:18.046 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.040+0000 7f7626d9d640 1 --2- 172.21.15.86:0/34502161 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76140051d0 0x7f761400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:18.046 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.040+0000 7f762659c640 1 --2- 172.21.15.86:0/34502161 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76140039f0 0x7f7614003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:18.046 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.040+0000 7f761dd9b640 1 --2- 172.21.15.86:0/34502161 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7614004810 0x7f7614004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:18.047 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.040+0000 7f7626d9d640 1 -- 172.21.15.86:0/34502161 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7614004810 msgr2=0x7f7614004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:18.047 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.040+0000 7f7626d9d640 1 --2- 172.21.15.86:0/34502161 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7614004810 0x7f7614004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:18.047 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.040+0000 7f7626d9d640 1 -- 172.21.15.86:0/34502161 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76140039f0 msgr2=0x7f7614003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:18.047 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.040+0000 7f7626d9d640 1 --2- 172.21.15.86:0/34502161 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76140039f0 0x7f7614003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:18.047 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.040+0000 7f7626d9d640 1 -- 172.21.15.86:0/34502161 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7614003530 con 0x7f76140051d0 2024-04-25T12:21:18.047 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.040+0000 7f762659c640 1 --2- 172.21.15.86:0/34502161 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76140039f0 0x7f7614003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:21:18.047 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.040+0000 7f761dd9b640 1 --2- 172.21.15.86:0/34502161 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7614004810 0x7f7614004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:21:18.048 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.040+0000 7f7626d9d640 1 -- 172.21.15.86:0/34502161 reap_dead start 2024-04-25T12:21:18.048 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.044+0000 7f7626d9d640 1 --2- 172.21.15.86:0/34502161 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76140051d0 0x7f761400b9d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f762815a080 tx=0x7f762001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2f1507695f1a0ad server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:18.048 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.044+0000 7f7625d9b640 1 -- 172.21.15.86:0/34502161 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7620009c10 con 0x7f76140051d0 2024-04-25T12:21:18.048 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.044+0000 7f7625d9b640 1 -- 172.21.15.86:0/34502161 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76200a5c70 con 0x7f76140051d0 2024-04-25T12:21:18.049 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.044+0000 7f7625d9b640 1 -- 172.21.15.86:0/34502161 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7620003be0 con 0x7f76140051d0 2024-04-25T12:21:18.049 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.044+0000 7f762cb07640 1 -- 172.21.15.86:0/34502161 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76140051d0 msgr2=0x7f761400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:18.049 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.044+0000 7f762cb07640 1 --2- 172.21.15.86:0/34502161 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76140051d0 0x7f761400b9d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f762815a080 tx=0x7f762001cc60 comp rx=0 tx=0).stop 2024-04-25T12:21:18.049 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.044+0000 7f762cb07640 1 -- 172.21.15.86:0/34502161 shutdown_connections 2024-04-25T12:21:18.049 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.044+0000 7f762cb07640 1 --2- 172.21.15.86:0/34502161 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76140051d0 0x7f761400b9d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:18.049 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.044+0000 7f762cb07640 1 -- 172.21.15.86:0/34502161 >> 172.21.15.86:0/34502161 conn(0x7f762806b9d0 msgr2=0x7f762806bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:18.049 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.044+0000 7f762cb07640 1 -- 172.21.15.86:0/34502161 shutdown_connections 2024-04-25T12:21:18.049 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.044+0000 7f762cb07640 1 -- 172.21.15.86:0/34502161 wait complete. 2024-04-25T12:21:18.049 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.044+0000 7f762cb07640 1 Processor -- start 2024-04-25T12:21:18.049 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.044+0000 7f762cb07640 1 -- start start 2024-04-25T12:21:18.051 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.044+0000 7f762cb07640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f76140051d0 0x7f76281f2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:18.051 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.044+0000 7f762cb07640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7628159ab0 0x7f7628145210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:18.051 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.044+0000 7f762cb07640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7628147f30 0x7f76281483b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:18.051 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.044+0000 7f762cb07640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7628074530 con 0x7f7628159ab0 2024-04-25T12:21:18.052 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.044+0000 7f762cb07640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f76280c5bf0 con 0x7f7628147f30 2024-04-25T12:21:18.052 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.044+0000 7f762cb07640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f76280681d0 con 0x7f76140051d0 2024-04-25T12:21:18.052 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.044+0000 7f761dd9b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7628159ab0 0x7f7628145210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:18.052 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.044+0000 7f761dd9b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7628159ab0 0x7f7628145210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41688/0 (socket says 172.21.15.86:41688) 2024-04-25T12:21:18.052 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.044+0000 7f761dd9b640 1 -- 172.21.15.86:0/4177280857 learned_addr learned my addr 172.21.15.86:0/4177280857 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:18.052 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.044+0000 7f7626d9d640 1 --2- 172.21.15.86:0/4177280857 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7628147f30 0x7f76281483b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:18.052 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.044+0000 7f762659c640 1 --2- 172.21.15.86:0/4177280857 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f76140051d0 0x7f76281f2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:18.052 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.044+0000 7f761dd9b640 1 -- 172.21.15.86:0/4177280857 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f76140051d0 msgr2=0x7f76281f2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:18.052 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.044+0000 7f761dd9b640 1 --2- 172.21.15.86:0/4177280857 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f76140051d0 0x7f76281f2720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:18.052 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.044+0000 7f761dd9b640 1 -- 172.21.15.86:0/4177280857 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7628147f30 msgr2=0x7f76281483b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:18.052 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.044+0000 7f761dd9b640 1 --2- 172.21.15.86:0/4177280857 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7628147f30 0x7f76281483b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:18.053 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.044+0000 7f761dd9b640 1 -- 172.21.15.86:0/4177280857 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76281f2c60 con 0x7f7628159ab0 2024-04-25T12:21:18.053 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.044+0000 7f7626d9d640 1 --2- 172.21.15.86:0/4177280857 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7628147f30 0x7f76281483b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:21:18.053 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.044+0000 7f761dd9b640 1 --2- 172.21.15.86:0/4177280857 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7628159ab0 0x7f7628145210 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f761000e760 tx=0x7f761000ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:18.053 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.044+0000 7f761f7fe640 1 -- 172.21.15.86:0/4177280857 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7610019070 con 0x7f7628159ab0 2024-04-25T12:21:18.053 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.044+0000 7f761f7fe640 1 -- 172.21.15.86:0/4177280857 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f761000c6c0 con 0x7f7628159ab0 2024-04-25T12:21:18.053 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.044+0000 7f761f7fe640 1 -- 172.21.15.86:0/4177280857 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f761000ca70 con 0x7f7628159ab0 2024-04-25T12:21:18.053 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.044+0000 7f762cb07640 1 -- 172.21.15.86:0/4177280857 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7628149a80 con 0x7f7628159ab0 2024-04-25T12:21:18.053 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.044+0000 7f762cb07640 1 -- 172.21.15.86:0/4177280857 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7628147750 con 0x7f7628159ab0 2024-04-25T12:21:18.053 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.048+0000 7f762cb07640 1 -- 172.21.15.86:0/4177280857 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7628075df0 con 0x7f7628159ab0 2024-04-25T12:21:18.053 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.048+0000 7f761f7fe640 1 -- 172.21.15.86:0/4177280857 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f761001c070 con 0x7f7628159ab0 2024-04-25T12:21:18.054 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.048+0000 7f761f7fe640 1 --2- 172.21.15.86:0/4177280857 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f7608068380 0x7f760806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:18.054 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.048+0000 7f762659c640 1 --2- 172.21.15.86:0/4177280857 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f7608068380 0x7f760806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:18.054 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.048+0000 7f761f7fe640 1 -- 172.21.15.86:0/4177280857 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f7610085bf0 con 0x7f7628159ab0 2024-04-25T12:21:18.054 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.048+0000 7f762659c640 1 --2- 172.21.15.86:0/4177280857 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f7608068380 0x7f760806a840 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7618001660 tx=0x7f7618009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:18.056 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.052+0000 7f761f7fe640 1 -- 172.21.15.86:0/4177280857 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7610055eb0 con 0x7f7628159ab0 2024-04-25T12:21:18.247 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.244+0000 7f762cb07640 1 -- 172.21.15.86:0/4177280857 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f76280c7df0 con 0x7f7628159ab0 2024-04-25T12:21:18.248 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.244+0000 7f761f7fe640 1 -- 172.21.15.86:0/4177280857 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1392 (secure 0 0 0) 0x7f761005a1b0 con 0x7f7628159ab0 2024-04-25T12:21:18.248 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:21:18.248 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6839/4002713597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6837","nonce":4002713597},{"type":"v1","addr":"172.21.15.86:6839","nonce":4002713597}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-25T12:21:18.249 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 2 2024-04-25T12:21:18.250 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.244+0000 7f762cb07640 1 -- 172.21.15.86:0/4177280857 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f7608068380 msgr2=0x7f760806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:18.250 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.244+0000 7f762cb07640 1 --2- 172.21.15.86:0/4177280857 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f7608068380 0x7f760806a840 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7618001660 tx=0x7f7618009040 comp rx=0 tx=0).stop 2024-04-25T12:21:18.250 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.244+0000 7f762cb07640 1 -- 172.21.15.86:0/4177280857 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7628159ab0 msgr2=0x7f7628145210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:18.251 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.244+0000 7f762cb07640 1 --2- 172.21.15.86:0/4177280857 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7628159ab0 0x7f7628145210 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f761000e760 tx=0x7f761000ec20 comp rx=0 tx=0).stop 2024-04-25T12:21:18.251 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.244+0000 7f762cb07640 1 -- 172.21.15.86:0/4177280857 shutdown_connections 2024-04-25T12:21:18.251 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.244+0000 7f762cb07640 1 --2- 172.21.15.86:0/4177280857 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7628147f30 0x7f76281483b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:18.251 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.244+0000 7f762cb07640 1 --2- 172.21.15.86:0/4177280857 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f7608068380 0x7f760806a840 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:18.251 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.244+0000 7f762cb07640 1 --2- 172.21.15.86:0/4177280857 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7628159ab0 0x7f7628145210 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:18.251 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.244+0000 7f762cb07640 1 --2- 172.21.15.86:0/4177280857 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f76140051d0 0x7f76281f2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:18.251 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.244+0000 7f762cb07640 1 -- 172.21.15.86:0/4177280857 >> 172.21.15.86:0/4177280857 conn(0x7f762806b9d0 msgr2=0x7f76280cb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:18.251 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.244+0000 7f762cb07640 1 -- 172.21.15.86:0/4177280857 shutdown_connections 2024-04-25T12:21:18.251 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:18.244+0000 7f762cb07640 1 -- 172.21.15.86:0/4177280857 wait complete. 2024-04-25T12:21:20.266 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T12:21:20.395 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.392+0000 7f816caa4640 1 Processor -- start 2024-04-25T12:21:20.395 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.392+0000 7f816caa4640 1 -- start start 2024-04-25T12:21:20.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.392+0000 7f816caa4640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f81680c8340 0x7f81680703c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:20.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.392+0000 7f816caa4640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f816806d5a0 0x7f8168154da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:20.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.392+0000 7f816caa4640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81680709e0 con 0x7f816806d1c0 2024-04-25T12:21:20.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.392+0000 7f816caa4640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f816815bf60 con 0x7f81680c8340 2024-04-25T12:21:20.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.392+0000 7f816caa4640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f816815b350 con 0x7f816806d5a0 2024-04-25T12:21:20.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.392+0000 7f816659c640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f816806d1c0 0x7f816815e8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:54662/0 (socket says 172.21.15.86:54662) 2024-04-25T12:21:20.399 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.392+0000 7f816659c640 1 -- 172.21.15.86:0/3928595215 learned_addr learned my addr 172.21.15.86:0/3928595215 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-04-25T12:21:20.399 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.392+0000 7f8166d9d640 1 --2- 172.21.15.86:0/3928595215 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f816806d5a0 0x7f8168154da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:20.399 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.392+0000 7f8165d9b640 1 --2- 172.21.15.86:0/3928595215 >> v2:172.21.15.134:3300/0 conn(0x7f81680c8340 0x7f81680703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:20.399 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.392+0000 7f816559a640 1 -- 172.21.15.86:0/3928595215 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2425398154 0 0) 0x7f81680709e0 con 0x7f816806d1c0 2024-04-25T12:21:20.399 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.392+0000 7f816559a640 1 -- 172.21.15.86:0/3928595215 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8150003530 con 0x7f816806d1c0 2024-04-25T12:21:20.399 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.392+0000 7f816559a640 1 -- 172.21.15.86:0/3928595215 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4243415414 0 0) 0x7f8150003530 con 0x7f816806d1c0 2024-04-25T12:21:20.399 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.392+0000 7f816559a640 1 -- 172.21.15.86:0/3928595215 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f816806d5a0 msgr2=0x7f8168154da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:20.399 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.392+0000 7f816559a640 1 --2- 172.21.15.86:0/3928595215 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f816806d5a0 0x7f8168154da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:20.399 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.392+0000 7f816559a640 1 -- 172.21.15.86:0/3928595215 >> v2:172.21.15.134:3300/0 conn(0x7f81680c8340 msgr2=0x7f81680703c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:20.399 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.392+0000 7f816559a640 1 --2- 172.21.15.86:0/3928595215 >> v2:172.21.15.134:3300/0 conn(0x7f81680c8340 0x7f81680703c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:20.399 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.392+0000 7f816559a640 1 -- 172.21.15.86:0/3928595215 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f816815b630 con 0x7f816806d1c0 2024-04-25T12:21:20.399 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.392+0000 7f816559a640 1 -- 172.21.15.86:0/3928595215 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1387950573 0 0) 0x7f815c001680 con 0x7f816806d1c0 2024-04-25T12:21:20.399 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.392+0000 7f816559a640 1 -- 172.21.15.86:0/3928595215 >> v1:172.21.15.86:6789/0 conn(0x7f816806d1c0 legacy=0x7f816815e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:20.400 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.392+0000 7f816559a640 1 --2- 172.21.15.86:0/3928595215 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81500039c0 0x7f8150003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:20.400 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.392+0000 7f816559a640 1 --2- 172.21.15.86:0/3928595215 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8150004370 0x7f8150004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:20.400 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.392+0000 7f816559a640 1 --2- 172.21.15.86:0/3928595215 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f816806d5a0 0x7f8150004f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:20.400 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.392+0000 7f816559a640 1 -- 172.21.15.86:0/3928595215 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f816815bf60 con 0x7f81500039c0 2024-04-25T12:21:20.400 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.392+0000 7f816559a640 1 -- 172.21.15.86:0/3928595215 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f816815b350 con 0x7f8150004370 2024-04-25T12:21:20.400 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.392+0000 7f816559a640 1 -- 172.21.15.86:0/3928595215 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f815000b9d0 con 0x7f816806d5a0 2024-04-25T12:21:20.400 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.392+0000 7f816659c640 1 --2- 172.21.15.86:0/3928595215 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81500039c0 0x7f8150003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:20.400 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.392+0000 7f8166d9d640 1 --2- 172.21.15.86:0/3928595215 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f816806d5a0 0x7f8150004f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:20.400 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.392+0000 7f8165d9b640 1 --2- 172.21.15.86:0/3928595215 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8150004370 0x7f8150004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:20.400 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.392+0000 7f816659c640 1 -- 172.21.15.86:0/3928595215 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f816806d5a0 msgr2=0x7f8150004f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:20.400 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.392+0000 7f816659c640 1 --2- 172.21.15.86:0/3928595215 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f816806d5a0 0x7f8150004f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:20.400 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.392+0000 7f816659c640 1 -- 172.21.15.86:0/3928595215 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8150004370 msgr2=0x7f8150004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:20.400 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.392+0000 7f816659c640 1 --2- 172.21.15.86:0/3928595215 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8150004370 0x7f8150004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:20.400 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.392+0000 7f816659c640 1 -- 172.21.15.86:0/3928595215 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8150003530 con 0x7f81500039c0 2024-04-25T12:21:20.402 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.396+0000 7f816659c640 1 --2- 172.21.15.86:0/3928595215 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81500039c0 0x7f8150003da0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f815c005100 tx=0x7f815c01fad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46be42e54f3bd45b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:20.402 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.396+0000 7f816559a640 1 -- 172.21.15.86:0/3928595215 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f815c004cd0 con 0x7f81500039c0 2024-04-25T12:21:20.402 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.396+0000 7f816559a640 1 -- 172.21.15.86:0/3928595215 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f815c005ae0 con 0x7f81500039c0 2024-04-25T12:21:20.402 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.396+0000 7f816559a640 1 -- 172.21.15.86:0/3928595215 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f815c008110 con 0x7f81500039c0 2024-04-25T12:21:20.402 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.396+0000 7f816caa4640 1 -- 172.21.15.86:0/3928595215 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81500039c0 msgr2=0x7f8150003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:20.402 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.396+0000 7f816caa4640 1 --2- 172.21.15.86:0/3928595215 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81500039c0 0x7f8150003da0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f815c005100 tx=0x7f815c01fad0 comp rx=0 tx=0).stop 2024-04-25T12:21:20.402 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.396+0000 7f8166d9d640 1 -- 172.21.15.86:0/3928595215 reap_dead start 2024-04-25T12:21:20.402 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.396+0000 7f816caa4640 1 -- 172.21.15.86:0/3928595215 shutdown_connections 2024-04-25T12:21:20.402 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.396+0000 7f816caa4640 1 -- 172.21.15.86:0/3928595215 >> 172.21.15.86:0/3928595215 conn(0x7f81680ca570 msgr2=0x7f81680ca980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:20.403 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.396+0000 7f816caa4640 1 -- 172.21.15.86:0/3928595215 shutdown_connections 2024-04-25T12:21:20.403 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.396+0000 7f816caa4640 1 -- 172.21.15.86:0/3928595215 wait complete. 2024-04-25T12:21:20.403 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.396+0000 7f816caa4640 1 Processor -- start 2024-04-25T12:21:20.403 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.396+0000 7f816caa4640 1 -- start start 2024-04-25T12:21:20.405 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.400+0000 7f816caa4640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81500039c0 0x7f81681f0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:20.405 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.400+0000 7f816caa4640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f81681f4a80 0x7f8168156f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:20.405 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.400+0000 7f816caa4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f816806bc30 0x7f81681510b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:20.405 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.400+0000 7f816caa4640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f816815b000 con 0x7f81500039c0 2024-04-25T12:21:20.405 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.400+0000 7f816caa4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f816815bbf0 con 0x7f816806bc30 2024-04-25T12:21:20.405 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.400+0000 7f816caa4640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f81680c9db0 con 0x7f81681f4a80 2024-04-25T12:21:20.405 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.400+0000 7f816659c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81500039c0 0x7f81681f0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:20.405 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.400+0000 7f816659c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81500039c0 0x7f81681f0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41712/0 (socket says 172.21.15.86:41712) 2024-04-25T12:21:20.405 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.400+0000 7f816659c640 1 -- 172.21.15.86:0/293511560 learned_addr learned my addr 172.21.15.86:0/293511560 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:20.405 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.400+0000 7f8166d9d640 1 --2- 172.21.15.86:0/293511560 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f816806bc30 0x7f81681510b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:20.406 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.400+0000 7f8165d9b640 1 --2- 172.21.15.86:0/293511560 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f81681f4a80 0x7f8168156f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:20.406 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.400+0000 7f816659c640 1 -- 172.21.15.86:0/293511560 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f81681f4a80 msgr2=0x7f8168156f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:20.406 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.400+0000 7f816659c640 1 --2- 172.21.15.86:0/293511560 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f81681f4a80 0x7f8168156f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:20.406 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.400+0000 7f816659c640 1 -- 172.21.15.86:0/293511560 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f816806bc30 msgr2=0x7f81681510b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:20.406 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.400+0000 7f816659c640 1 --2- 172.21.15.86:0/293511560 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f816806bc30 0x7f81681510b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:20.406 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.400+0000 7f816659c640 1 -- 172.21.15.86:0/293511560 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81681f3fe0 con 0x7f81500039c0 2024-04-25T12:21:20.406 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.400+0000 7f8166d9d640 1 --2- 172.21.15.86:0/293511560 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f816806bc30 0x7f81681510b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:21:20.406 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.400+0000 7f816659c640 1 --2- 172.21.15.86:0/293511560 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81500039c0 0x7f81681f0a70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f815c0051f0 tx=0x7f8150005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:20.406 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.400+0000 7f8156ffd640 1 -- 172.21.15.86:0/293511560 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f815c0058c0 con 0x7f81500039c0 2024-04-25T12:21:20.406 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.400+0000 7f8156ffd640 1 -- 172.21.15.86:0/293511560 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f815c0047f0 con 0x7f81500039c0 2024-04-25T12:21:20.406 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.400+0000 7f8156ffd640 1 -- 172.21.15.86:0/293511560 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f815c008110 con 0x7f81500039c0 2024-04-25T12:21:20.406 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.400+0000 7f816caa4640 1 -- 172.21.15.86:0/293511560 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81681543c0 con 0x7f81500039c0 2024-04-25T12:21:20.406 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.400+0000 7f816caa4640 1 -- 172.21.15.86:0/293511560 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81681f4280 con 0x7f81500039c0 2024-04-25T12:21:20.406 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.400+0000 7f816caa4640 1 -- 172.21.15.86:0/293511560 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8168075df0 con 0x7f81500039c0 2024-04-25T12:21:20.407 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.400+0000 7f8156ffd640 1 -- 172.21.15.86:0/293511560 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f815c0082b0 con 0x7f81500039c0 2024-04-25T12:21:20.407 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.400+0000 7f8156ffd640 1 --2- 172.21.15.86:0/293511560 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f8148068380 0x7f814806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:20.407 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.400+0000 7f8156ffd640 1 -- 172.21.15.86:0/293511560 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f815c1248f0 con 0x7f81500039c0 2024-04-25T12:21:20.407 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.400+0000 7f8165d9b640 1 --2- 172.21.15.86:0/293511560 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f8148068380 0x7f814806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:20.408 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.400+0000 7f8165d9b640 1 --2- 172.21.15.86:0/293511560 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f8148068380 0x7f814806a840 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8168154120 tx=0x7f8158008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:20.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.404+0000 7f8156ffd640 1 -- 172.21.15.86:0/293511560 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f815c0c3060 con 0x7f81500039c0 2024-04-25T12:21:20.602 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.600+0000 7f816caa4640 1 -- 172.21.15.86:0/293511560 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8168151ca0 con 0x7f81500039c0 2024-04-25T12:21:20.603 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.600+0000 7f8156ffd640 1 -- 172.21.15.86:0/293511560 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+5521 (secure 0 0 0) 0x7f815c0197e0 con 0x7f81500039c0 2024-04-25T12:21:20.604 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:21:20.604 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/1969068022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1969068022},{"type":"v1","addr":"172.21.15.86:6835","nonce":1969068022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6838/3213562806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":3213562806},{"type":"v1","addr":"172.21.15.86:6838","nonce":3213562806}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6839/4002713597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6837","nonce":4002713597},{"type":"v1","addr":"172.21.15.86:6839","nonce":4002713597}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4245,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/3114005030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3114005030},{"type":"v1","addr":"172.21.15.134:6833","nonce":3114005030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/1079608447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":1079608447},{"type":"v1","addr":"172.21.15.134:6837","nonce":1079608447}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4294,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/3044511437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3044511437},{"type":"v1","addr":"172.21.15.134:6836","nonce":3044511437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-25T12:21:20.604 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 3 2024-04-25T12:21:20.606 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.600+0000 7f816caa4640 1 -- 172.21.15.86:0/293511560 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f8148068380 msgr2=0x7f814806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:20.606 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.600+0000 7f816caa4640 1 --2- 172.21.15.86:0/293511560 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f8148068380 0x7f814806a840 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8168154120 tx=0x7f8158008040 comp rx=0 tx=0).stop 2024-04-25T12:21:20.606 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.600+0000 7f816caa4640 1 -- 172.21.15.86:0/293511560 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81500039c0 msgr2=0x7f81681f0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:20.607 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.600+0000 7f816caa4640 1 --2- 172.21.15.86:0/293511560 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81500039c0 0x7f81681f0a70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f815c0051f0 tx=0x7f8150005840 comp rx=0 tx=0).stop 2024-04-25T12:21:20.607 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.600+0000 7f816caa4640 1 -- 172.21.15.86:0/293511560 shutdown_connections 2024-04-25T12:21:20.607 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.600+0000 7f816caa4640 1 --2- 172.21.15.86:0/293511560 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f816806bc30 0x7f81681510b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:20.607 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.600+0000 7f816caa4640 1 --2- 172.21.15.86:0/293511560 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f81681f4a80 0x7f8168156f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:20.607 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.600+0000 7f816caa4640 1 --2- 172.21.15.86:0/293511560 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f8148068380 0x7f814806a840 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:20.607 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.600+0000 7f816caa4640 1 --2- 172.21.15.86:0/293511560 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81500039c0 0x7f81681f0a70 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:20.607 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.600+0000 7f816caa4640 1 -- 172.21.15.86:0/293511560 >> 172.21.15.86:0/293511560 conn(0x7f81680ca570 msgr2=0x7f8168151ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:20.607 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.600+0000 7f816caa4640 1 -- 172.21.15.86:0/293511560 shutdown_connections 2024-04-25T12:21:20.607 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.600+0000 7f816caa4640 1 -- 172.21.15.86:0/293511560 wait complete. 2024-04-25T12:21:20.621 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T12:21:20.741 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.736+0000 7fc24b917640 1 Processor -- start 2024-04-25T12:21:20.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.736+0000 7fc24b917640 1 -- start start 2024-04-25T12:21:20.743 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.740+0000 7fc24b917640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc24414fbc0 0x7fc24406f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:20.743 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.740+0000 7fc24b917640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc24414ffa0 0x7fc2440c8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:20.743 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.740+0000 7fc24b917640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc244074100 0x7fc2440c8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:20.743 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.740+0000 7fc24b917640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7fc2440c5d70 con 0x7fc244074100 2024-04-25T12:21:20.743 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.740+0000 7fc24b917640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fc2440c6050 con 0x7fc24414ffa0 2024-04-25T12:21:20.744 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.740+0000 7fc24b917640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fc2440c6330 con 0x7fc24414fbc0 2024-04-25T12:21:20.744 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.740+0000 7fc249eb4640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc244074100 0x7fc2440c8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:20.744 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.740+0000 7fc249eb4640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc244074100 0x7fc2440c8760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41722/0 (socket says 172.21.15.86:41722) 2024-04-25T12:21:20.744 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.740+0000 7fc249eb4640 1 -- 172.21.15.86:0/2454723338 learned_addr learned my addr 172.21.15.86:0/2454723338 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:20.744 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.740+0000 7fc2496b3640 1 --2- 172.21.15.86:0/2454723338 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc24414fbc0 0x7fc24406f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:20.744 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.740+0000 7fc248eb2640 1 --2- 172.21.15.86:0/2454723338 >> v2:172.21.15.134:3300/0 conn(0x7fc24414ffa0 0x7fc2440c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:20.744 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.740+0000 7fc249eb4640 1 -- 172.21.15.86:0/2454723338 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc24414fbc0 msgr2=0x7fc24406f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:20.744 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.740+0000 7fc249eb4640 1 --2- 172.21.15.86:0/2454723338 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc24414fbc0 0x7fc24406f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:20.744 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.740+0000 7fc249eb4640 1 -- 172.21.15.86:0/2454723338 >> v2:172.21.15.134:3300/0 conn(0x7fc24414ffa0 msgr2=0x7fc2440c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:20.744 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.740+0000 7fc249eb4640 1 --2- 172.21.15.86:0/2454723338 >> v2:172.21.15.134:3300/0 conn(0x7fc24414ffa0 0x7fc2440c8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:20.744 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.740+0000 7fc249eb4640 1 -- 172.21.15.86:0/2454723338 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2440c6610 con 0x7fc244074100 2024-04-25T12:21:20.746 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.740+0000 7fc249eb4640 1 --2- 172.21.15.86:0/2454723338 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc244074100 0x7fc2440c8760 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc24406a030 tx=0x7fc23c01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acd6c91fdf0441bb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:20.746 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.740+0000 7fc23bfff640 1 -- 172.21.15.86:0/2454723338 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc23c0a5890 con 0x7fc244074100 2024-04-25T12:21:20.746 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.740+0000 7fc23bfff640 1 -- 172.21.15.86:0/2454723338 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc23c0a5a30 con 0x7fc244074100 2024-04-25T12:21:20.746 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.740+0000 7fc23bfff640 1 -- 172.21.15.86:0/2454723338 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc23c0a5e00 con 0x7fc244074100 2024-04-25T12:21:20.747 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.744+0000 7fc24b917640 1 -- 172.21.15.86:0/2454723338 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc244074100 msgr2=0x7fc2440c8760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:20.747 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.744+0000 7fc24b917640 1 --2- 172.21.15.86:0/2454723338 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc244074100 0x7fc2440c8760 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc24406a030 tx=0x7fc23c01c9f0 comp rx=0 tx=0).stop 2024-04-25T12:21:20.747 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.744+0000 7fc24b917640 1 -- 172.21.15.86:0/2454723338 shutdown_connections 2024-04-25T12:21:20.747 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.744+0000 7fc24b917640 1 --2- 172.21.15.86:0/2454723338 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc244074100 0x7fc2440c8760 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:20.747 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.744+0000 7fc24b917640 1 --2- 172.21.15.86:0/2454723338 >> v2:172.21.15.134:3300/0 conn(0x7fc24414ffa0 0x7fc2440c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:20.747 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.744+0000 7fc24b917640 1 --2- 172.21.15.86:0/2454723338 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc24414fbc0 0x7fc24406f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:20.747 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.744+0000 7fc24b917640 1 -- 172.21.15.86:0/2454723338 >> 172.21.15.86:0/2454723338 conn(0x7fc24406b9d0 msgr2=0x7fc24406bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:20.747 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.744+0000 7fc24b917640 1 -- 172.21.15.86:0/2454723338 shutdown_connections 2024-04-25T12:21:20.748 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.744+0000 7fc24b917640 1 -- 172.21.15.86:0/2454723338 wait complete. 2024-04-25T12:21:20.748 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.744+0000 7fc24b917640 1 Processor -- start 2024-04-25T12:21:20.748 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.744+0000 7fc24b917640 1 -- start start 2024-04-25T12:21:20.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.744+0000 7fc24b917640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc244074100 0x7fc244140960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:20.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.744+0000 7fc24b917640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc24414fbc0 0x7fc24414b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:20.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.744+0000 7fc24b917640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc24414ffa0 0x7fc24413eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:20.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.744+0000 7fc24b917640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc2441592e0 con 0x7fc24414ffa0 2024-04-25T12:21:20.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.744+0000 7fc24b917640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc244159160 con 0x7fc244074100 2024-04-25T12:21:20.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.744+0000 7fc24b917640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fc244159460 con 0x7fc24414fbc0 2024-04-25T12:21:20.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.744+0000 7fc249eb4640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc24414ffa0 0x7fc24413eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:20.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.744+0000 7fc249eb4640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc24414ffa0 0x7fc24413eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41732/0 (socket says 172.21.15.86:41732) 2024-04-25T12:21:20.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.744+0000 7fc249eb4640 1 -- 172.21.15.86:0/3049255413 learned_addr learned my addr 172.21.15.86:0/3049255413 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:20.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.744+0000 7fc2496b3640 1 --2- 172.21.15.86:0/3049255413 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc244074100 0x7fc244140960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:20.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.744+0000 7fc248eb2640 1 --2- 172.21.15.86:0/3049255413 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc24414fbc0 0x7fc24414b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:20.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.744+0000 7fc249eb4640 1 -- 172.21.15.86:0/3049255413 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc24414fbc0 msgr2=0x7fc24414b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:20.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.744+0000 7fc249eb4640 1 --2- 172.21.15.86:0/3049255413 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc24414fbc0 0x7fc24414b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:20.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.744+0000 7fc249eb4640 1 -- 172.21.15.86:0/3049255413 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc244074100 msgr2=0x7fc244140960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:20.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.744+0000 7fc249eb4640 1 --2- 172.21.15.86:0/3049255413 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc244074100 0x7fc244140960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:20.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.744+0000 7fc249eb4640 1 -- 172.21.15.86:0/3049255413 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc24415a120 con 0x7fc24414ffa0 2024-04-25T12:21:20.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.744+0000 7fc248eb2640 1 --2- 172.21.15.86:0/3049255413 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc24414fbc0 0x7fc24414b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:21:20.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.744+0000 7fc249eb4640 1 --2- 172.21.15.86:0/3049255413 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc24414ffa0 0x7fc24413eec0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc23c01b0a0 tx=0x7fc23c019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:20.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.744+0000 7fc239ffb640 1 -- 172.21.15.86:0/3049255413 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc23c009250 con 0x7fc24414ffa0 2024-04-25T12:21:20.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.744+0000 7fc239ffb640 1 -- 172.21.15.86:0/3049255413 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc23c0be070 con 0x7fc24414ffa0 2024-04-25T12:21:20.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.744+0000 7fc239ffb640 1 -- 172.21.15.86:0/3049255413 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc23c0b86b0 con 0x7fc24414ffa0 2024-04-25T12:21:20.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.744+0000 7fc24b917640 1 -- 172.21.15.86:0/3049255413 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2440ca480 con 0x7fc24414ffa0 2024-04-25T12:21:20.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.744+0000 7fc24b917640 1 -- 172.21.15.86:0/3049255413 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2441f44e0 con 0x7fc24414ffa0 2024-04-25T12:21:20.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.748+0000 7fc24b917640 1 -- 172.21.15.86:0/3049255413 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc244075df0 con 0x7fc24414ffa0 2024-04-25T12:21:20.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.748+0000 7fc239ffb640 1 -- 172.21.15.86:0/3049255413 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc23c0b8850 con 0x7fc24414ffa0 2024-04-25T12:21:20.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.748+0000 7fc239ffb640 1 --2- 172.21.15.86:0/3049255413 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fc228068380 0x7fc22806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:20.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.748+0000 7fc239ffb640 1 -- 172.21.15.86:0/3049255413 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fc23c121470 con 0x7fc24414ffa0 2024-04-25T12:21:20.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.748+0000 7fc2496b3640 1 --2- 172.21.15.86:0/3049255413 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fc228068380 0x7fc22806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:20.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.748+0000 7fc2496b3640 1 --2- 172.21.15.86:0/3049255413 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fc228068380 0x7fc22806a840 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc24000ba30 tx=0x7fc240008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:20.756 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.752+0000 7fc239ffb640 1 -- 172.21.15.86:0/3049255413 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc23c0165e0 con 0x7fc24414ffa0 2024-04-25T12:21:20.916 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.912+0000 7fc24b917640 1 -- 172.21.15.86:0/3049255413 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc2440c7df0 con 0x7fc24414ffa0 2024-04-25T12:21:20.917 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.912+0000 7fc239ffb640 1 -- 172.21.15.86:0/3049255413 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12884 (secure 0 0 0) 0x7fc23c0f1e20 con 0x7fc24414ffa0 2024-04-25T12:21:20.918 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:21:20.918 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":16,"fsid":"f2ef5c0c-9576-4650-b4f7-6cb14247f62a","created":"2024-04-25T12:20:59.241733+0000","modified":"2024-04-25T12:21:14.033457+0000","last_up_change":"2024-04-25T12:21:10.939617+0000","last_in_change":"2024-04-25T12:21:01.534145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T12:21:11.839922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1f713f00-ef9f-4a6f-a620-38a8a1f8a822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6801","nonce":2812764579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6803","nonce":2812764579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6807","nonce":2812764579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6805","nonce":2812764579}]},"public_addr":"172.21.15.86:6801/2812764579","cluster_addr":"172.21.15.86:6803/2812764579","heartbeat_back_addr":"172.21.15.86:6807/2812764579","heartbeat_front_addr":"172.21.15.86:6805/2812764579","state":["exists","up"]},{"osd":1,"uuid":"baf6606d-a556-4fbe-a930-855e04ff1534","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6809","nonce":467966038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6811","nonce":467966038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6815","nonce":467966038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6813","nonce":467966038}]},"public_addr":"172.21.15.86:6809/467966038","cluster_addr":"172.21.15.86:6811/467966038","heartbeat_back_addr":"172.21.15.86:6815/467966038","heartbeat_front_addr":"172.21.15.86:6813/467966038","state":["exists","up"]},{"osd":2,"uuid":"c983d68e-6d60-434f-aed6-108420c5dd09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6817","nonce":3279762843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6820","nonce":3279762843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6825","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6827","nonce":3279762843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6824","nonce":3279762843}]},"public_addr":"172.21.15.86:6817/3279762843","cluster_addr":"172.21.15.86:6820/3279762843","heartbeat_back_addr":"172.21.15.86:6827/3279762843","heartbeat_front_addr":"172.21.15.86:6824/3279762843","state":["exists","up"]},{"osd":3,"uuid":"e77657bb-45aa-43bf-ab41-c7377eb495ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6821","nonce":2861354413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6826","nonce":2861354413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6831","nonce":2861354413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6829","nonce":2861354413}]},"public_addr":"172.21.15.86:6821/2861354413","cluster_addr":"172.21.15.86:6826/2861354413","heartbeat_back_addr":"172.21.15.86:6831/2861354413","heartbeat_front_addr":"172.21.15.86:6829/2861354413","state":["exists","up"]},{"osd":4,"uuid":"252bd300-d75a-4b00-be4b-27e6b51de4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6802","nonce":1872913602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6805","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6808","nonce":1872913602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6815","nonce":1872913602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6813","nonce":1872913602}]},"public_addr":"172.21.15.134:6802/1872913602","cluster_addr":"172.21.15.134:6808/1872913602","heartbeat_back_addr":"172.21.15.134:6815/1872913602","heartbeat_front_addr":"172.21.15.134:6813/1872913602","state":["exists","up"]},{"osd":5,"uuid":"4135da3f-7427-4409-a48e-78bd8a7b46ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6801","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6803","nonce":2261413981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6806","nonce":2261413981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6812","nonce":2261413981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6809","nonce":2261413981}]},"public_addr":"172.21.15.134:6803/2261413981","cluster_addr":"172.21.15.134:6806/2261413981","heartbeat_back_addr":"172.21.15.134:6812/2261413981","heartbeat_front_addr":"172.21.15.134:6809/2261413981","state":["exists","up"]},{"osd":6,"uuid":"b6e7a5f1-fa7e-497d-abac-a19994d26820","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6825","nonce":2841082767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6827","nonce":2841082767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6831","nonce":2841082767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6829","nonce":2841082767}]},"public_addr":"172.21.15.134:6825/2841082767","cluster_addr":"172.21.15.134:6827/2841082767","heartbeat_back_addr":"172.21.15.134:6831/2841082767","heartbeat_front_addr":"172.21.15.134:6829/2841082767","state":["exists","up"]},{"osd":7,"uuid":"c5597e50-1962-4103-9124-dd7bceb8ac97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6817","nonce":1277404274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6819","nonce":1277404274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6823","nonce":1277404274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6821","nonce":1277404274}]},"public_addr":"172.21.15.134:6817/1277404274","cluster_addr":"172.21.15.134:6819/1277404274","heartbeat_back_addr":"172.21.15.134:6823/1277404274","heartbeat_front_addr":"172.21.15.134:6821/1277404274","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.018125+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.157958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.113619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.136904+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.844514+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.872629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.775339+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.822867+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T12:21:20.920 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.916+0000 7fc24b917640 1 -- 172.21.15.86:0/3049255413 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fc228068380 msgr2=0x7fc22806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:20.920 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.916+0000 7fc24b917640 1 --2- 172.21.15.86:0/3049255413 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fc228068380 0x7fc22806a840 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc24000ba30 tx=0x7fc240008040 comp rx=0 tx=0).stop 2024-04-25T12:21:20.920 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.916+0000 7fc24b917640 1 -- 172.21.15.86:0/3049255413 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc24414ffa0 msgr2=0x7fc24413eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:20.920 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.916+0000 7fc24b917640 1 --2- 172.21.15.86:0/3049255413 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc24414ffa0 0x7fc24413eec0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc23c01b0a0 tx=0x7fc23c019790 comp rx=0 tx=0).stop 2024-04-25T12:21:20.920 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.916+0000 7fc24b917640 1 -- 172.21.15.86:0/3049255413 shutdown_connections 2024-04-25T12:21:20.920 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.916+0000 7fc24b917640 1 --2- 172.21.15.86:0/3049255413 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fc228068380 0x7fc22806a840 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:20.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.916+0000 7fc24b917640 1 --2- 172.21.15.86:0/3049255413 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc24414ffa0 0x7fc24413eec0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:20.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.916+0000 7fc24b917640 1 --2- 172.21.15.86:0/3049255413 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc24414fbc0 0x7fc24414b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:20.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.916+0000 7fc24b917640 1 --2- 172.21.15.86:0/3049255413 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc244074100 0x7fc244140960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:20.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.916+0000 7fc24b917640 1 -- 172.21.15.86:0/3049255413 >> 172.21.15.86:0/3049255413 conn(0x7fc24406b9d0 msgr2=0x7fc244071700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:20.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.916+0000 7fc24b917640 1 -- 172.21.15.86:0/3049255413 shutdown_connections 2024-04-25T12:21:20.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:20.916+0000 7fc24b917640 1 -- 172.21.15.86:0/3049255413 wait complete. 2024-04-25T12:21:20.936 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T12:21:11.839922+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T12:21:20.936 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T12:21:21.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.056+0000 7f5b93c1b640 1 Processor -- start 2024-04-25T12:21:21.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.056+0000 7f5b93c1b640 1 -- start start 2024-04-25T12:21:21.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.060+0000 7f5b93c1b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f5b8c072470 0x7f5b8c072890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:21.064 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.060+0000 7f5b93c1b640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b8c067740 con 0x7f5b8c15bcc0 2024-04-25T12:21:21.064 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.060+0000 7f5b93c1b640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b8c072dd0 con 0x7f5b8c15c490 2024-04-25T12:21:21.064 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.060+0000 7f5b93c1b640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f5b8c071fe0 con 0x7f5b8c072470 2024-04-25T12:21:21.064 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.060+0000 7f5b919b7640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f5b8c15bcc0 0x7f5b8c06e490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:54674/0 (socket says 172.21.15.86:54674) 2024-04-25T12:21:21.064 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.060+0000 7f5b919b7640 1 -- 172.21.15.86:0/1734801694 learned_addr learned my addr 172.21.15.86:0/1734801694 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-04-25T12:21:21.064 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.060+0000 7f5b911b6640 1 --2- 172.21.15.86:0/1734801694 >> v2:172.21.15.134:3300/0 conn(0x7f5b8c072470 0x7f5b8c072890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:21.064 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.060+0000 7f5b911b6640 1 -- 172.21.15.86:0/1734801694 >> v1:172.21.15.134:6789/0 conn(0x7f5b8c15c490 legacy=0x7f5b8c15c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:21.064 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.060+0000 7f5b911b6640 1 -- 172.21.15.86:0/1734801694 >> v1:172.21.15.86:6789/0 conn(0x7f5b8c15bcc0 legacy=0x7f5b8c06e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:21.065 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.060+0000 7f5b911b6640 1 -- 172.21.15.86:0/1734801694 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b8c0679b0 con 0x7f5b8c072470 2024-04-25T12:21:21.066 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.064+0000 7f5b911b6640 1 --2- 172.21.15.86:0/1734801694 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b8c072470 0x7f5b8c072890 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c0097c0 tx=0x7f5b7c01c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d8fffa2fb721728 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:21.068 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.064+0000 7f5b909b5640 1 -- 172.21.15.86:0/1734801694 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c0b0070 con 0x7f5b8c072470 2024-04-25T12:21:21.068 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.064+0000 7f5b909b5640 1 -- 172.21.15.86:0/1734801694 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b7c0ab600 con 0x7f5b8c072470 2024-04-25T12:21:21.068 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.064+0000 7f5b909b5640 1 -- 172.21.15.86:0/1734801694 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c0ab9d0 con 0x7f5b8c072470 2024-04-25T12:21:21.069 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.064+0000 7f5b93c1b640 1 -- 172.21.15.86:0/1734801694 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b8c072470 msgr2=0x7f5b8c072890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:21.069 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.064+0000 7f5b93c1b640 1 --2- 172.21.15.86:0/1734801694 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b8c072470 0x7f5b8c072890 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c0097c0 tx=0x7f5b7c01c410 comp rx=0 tx=0).stop 2024-04-25T12:21:21.069 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.064+0000 7f5b93c1b640 1 -- 172.21.15.86:0/1734801694 shutdown_connections 2024-04-25T12:21:21.069 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.064+0000 7f5b93c1b640 1 --2- 172.21.15.86:0/1734801694 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b8c072470 0x7f5b8c072890 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:21.069 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.064+0000 7f5b93c1b640 1 -- 172.21.15.86:0/1734801694 >> 172.21.15.86:0/1734801694 conn(0x7f5b8c0c9a70 msgr2=0x7f5b8c0c9e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:21.069 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.064+0000 7f5b93c1b640 1 -- 172.21.15.86:0/1734801694 shutdown_connections 2024-04-25T12:21:21.069 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.064+0000 7f5b93c1b640 1 -- 172.21.15.86:0/1734801694 wait complete. 2024-04-25T12:21:21.070 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.064+0000 7f5b93c1b640 1 Processor -- start 2024-04-25T12:21:21.070 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.064+0000 7f5b93c1b640 1 -- start start 2024-04-25T12:21:21.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.068+0000 7f5b93c1b640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5b8c072470 0x7f5b8c161940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:21.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.068+0000 7f5b93c1b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5b8c15bcc0 0x7f5b8c159ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:21.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.068+0000 7f5b93c1b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b8c15c490 0x7f5b8c1f72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:21.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.068+0000 7f5b93c1b640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f5b8c15c0a0 con 0x7f5b8c15bcc0 2024-04-25T12:21:21.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.068+0000 7f5b93c1b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5b8c067c90 con 0x7f5b8c15c490 2024-04-25T12:21:21.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.068+0000 7f5b93c1b640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f5b8c15c220 con 0x7f5b8c072470 2024-04-25T12:21:21.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.068+0000 7f5b911b6640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5b8c15bcc0 0x7f5b8c159ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:21.073 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.068+0000 7f5b911b6640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5b8c15bcc0 0x7f5b8c159ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41734/0 (socket says 172.21.15.86:41734) 2024-04-25T12:21:21.073 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.068+0000 7f5b911b6640 1 -- 172.21.15.86:0/1444276128 learned_addr learned my addr 172.21.15.86:0/1444276128 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:21.073 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.068+0000 7f5b919b7640 1 --2- 172.21.15.86:0/1444276128 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5b8c072470 0x7f5b8c161940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:21.073 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.068+0000 7f5b921b8640 1 --2- 172.21.15.86:0/1444276128 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b8c15c490 0x7f5b8c1f72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:21.073 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.068+0000 7f5b911b6640 1 -- 172.21.15.86:0/1444276128 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5b8c072470 msgr2=0x7f5b8c161940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:21.073 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.068+0000 7f5b911b6640 1 --2- 172.21.15.86:0/1444276128 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5b8c072470 0x7f5b8c161940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:21.073 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.068+0000 7f5b911b6640 1 -- 172.21.15.86:0/1444276128 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b8c15c490 msgr2=0x7f5b8c1f72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:21.073 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.068+0000 7f5b911b6640 1 --2- 172.21.15.86:0/1444276128 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b8c15c490 0x7f5b8c1f72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:21.073 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.068+0000 7f5b911b6640 1 -- 172.21.15.86:0/1444276128 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b8c1642e0 con 0x7f5b8c15bcc0 2024-04-25T12:21:21.073 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.068+0000 7f5b911b6640 1 --2- 172.21.15.86:0/1444276128 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5b8c15bcc0 0x7f5b8c159ae0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c0ae040 tx=0x7f5b7c0191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:21.073 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.068+0000 7f5b827fc640 1 -- 172.21.15.86:0/1444276128 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c0b8030 con 0x7f5b8c15bcc0 2024-04-25T12:21:21.073 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.068+0000 7f5b827fc640 1 -- 172.21.15.86:0/1444276128 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b7c0b4410 con 0x7f5b8c15bcc0 2024-04-25T12:21:21.073 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.068+0000 7f5b93c1b640 1 -- 172.21.15.86:0/1444276128 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b8c164580 con 0x7f5b8c15bcc0 2024-04-25T12:21:21.073 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.068+0000 7f5b827fc640 1 -- 172.21.15.86:0/1444276128 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c0b0040 con 0x7f5b8c15bcc0 2024-04-25T12:21:21.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.068+0000 7f5b93c1b640 1 -- 172.21.15.86:0/1444276128 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b8c158470 con 0x7f5b8c15bcc0 2024-04-25T12:21:21.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.068+0000 7f5b93c1b640 1 -- 172.21.15.86:0/1444276128 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b8c075df0 con 0x7f5b8c15bcc0 2024-04-25T12:21:21.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.068+0000 7f5b827fc640 1 -- 172.21.15.86:0/1444276128 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5b7c0bb070 con 0x7f5b8c15bcc0 2024-04-25T12:21:21.075 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.068+0000 7f5b827fc640 1 --2- 172.21.15.86:0/1444276128 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f5b70068380 0x7f5b7006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:21.075 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.068+0000 7f5b827fc640 1 -- 172.21.15.86:0/1444276128 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f5b7c11fcb0 con 0x7f5b8c15bcc0 2024-04-25T12:21:21.075 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.068+0000 7f5b919b7640 1 --2- 172.21.15.86:0/1444276128 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f5b70068380 0x7f5b7006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:21.075 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.068+0000 7f5b919b7640 1 --2- 172.21.15.86:0/1444276128 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f5b70068380 0x7f5b7006a840 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5b84005890 tx=0x7f5b84009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:21.078 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.072+0000 7f5b827fc640 1 -- 172.21.15.86:0/1444276128 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5b7c016090 con 0x7f5b8c15bcc0 2024-04-25T12:21:21.227 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.224+0000 7f5b93c1b640 1 -- 172.21.15.86:0/1444276128 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5b8c0cc970 con 0x7f5b8c15bcc0 2024-04-25T12:21:21.227 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.224+0000 7f5b827fc640 1 -- 172.21.15.86:0/1444276128 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7f5b7c0f05c0 con 0x7f5b8c15bcc0 2024-04-25T12:21:21.228 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 1 2024-04-25T12:21:21.230 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.224+0000 7f5b93c1b640 1 -- 172.21.15.86:0/1444276128 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f5b70068380 msgr2=0x7f5b7006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:21.230 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.224+0000 7f5b93c1b640 1 --2- 172.21.15.86:0/1444276128 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f5b70068380 0x7f5b7006a840 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5b84005890 tx=0x7f5b84009040 comp rx=0 tx=0).stop 2024-04-25T12:21:21.230 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.224+0000 7f5b93c1b640 1 -- 172.21.15.86:0/1444276128 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5b8c15bcc0 msgr2=0x7f5b8c159ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:21.230 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.224+0000 7f5b93c1b640 1 --2- 172.21.15.86:0/1444276128 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5b8c15bcc0 0x7f5b8c159ae0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c0ae040 tx=0x7f5b7c0191b0 comp rx=0 tx=0).stop 2024-04-25T12:21:21.230 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.224+0000 7f5b93c1b640 1 -- 172.21.15.86:0/1444276128 shutdown_connections 2024-04-25T12:21:21.230 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.224+0000 7f5b93c1b640 1 --2- 172.21.15.86:0/1444276128 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b8c15c490 0x7f5b8c1f72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:21.230 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.224+0000 7f5b93c1b640 1 --2- 172.21.15.86:0/1444276128 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f5b70068380 0x7f5b7006a840 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:21.230 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.224+0000 7f5b93c1b640 1 --2- 172.21.15.86:0/1444276128 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5b8c15bcc0 0x7f5b8c159ae0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:21.230 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.224+0000 7f5b93c1b640 1 --2- 172.21.15.86:0/1444276128 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5b8c072470 0x7f5b8c161940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:21.231 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.224+0000 7f5b93c1b640 1 -- 172.21.15.86:0/1444276128 >> 172.21.15.86:0/1444276128 conn(0x7f5b8c0c9a70 msgr2=0x7f5b8c0cb710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:21.231 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.224+0000 7f5b93c1b640 1 -- 172.21.15.86:0/1444276128 shutdown_connections 2024-04-25T12:21:21.231 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.224+0000 7f5b93c1b640 1 -- 172.21.15.86:0/1444276128 wait complete. 2024-04-25T12:21:21.245 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T12:21:21.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.356+0000 7f7c49f87640 1 Processor -- start 2024-04-25T12:21:21.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.360+0000 7f7c49f87640 1 -- start start 2024-04-25T12:21:21.365 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.360+0000 7f7c49f87640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7c4414ffa0 0x7f7c4406f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:21.365 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.360+0000 7f7c49f87640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c440c5d70 con 0x7f7c4414fbc0 2024-04-25T12:21:21.365 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.360+0000 7f7c49f87640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c440c6050 con 0x7f7c44074100 2024-04-25T12:21:21.365 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.360+0000 7f7c49f87640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f7c440c6330 con 0x7f7c4414ffa0 2024-04-25T12:21:21.365 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.360+0000 7f7c437fe640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f7c4414fbc0 0x7f7c440c8220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:54688/0 (socket says 172.21.15.86:54688) 2024-04-25T12:21:21.365 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.360+0000 7f7c437fe640 1 -- 172.21.15.86:0/2302481193 learned_addr learned my addr 172.21.15.86:0/2302481193 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-04-25T12:21:21.365 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.360+0000 7f7c3bfff640 1 --2- 172.21.15.86:0/2302481193 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7c4414ffa0 0x7f7c4406f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:21.366 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.360+0000 7f7c42ffd640 1 -- 172.21.15.86:0/2302481193 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3462580939 0 0) 0x7f7c440c5d70 con 0x7f7c4414fbc0 2024-04-25T12:21:21.366 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.360+0000 7f7c42ffd640 1 -- 172.21.15.86:0/2302481193 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c30003530 con 0x7f7c4414fbc0 2024-04-25T12:21:21.366 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.360+0000 7f7c42ffd640 1 -- 172.21.15.86:0/2302481193 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 453070282 0 0) 0x7f7c30003530 con 0x7f7c4414fbc0 2024-04-25T12:21:21.366 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.360+0000 7f7c42ffd640 1 -- 172.21.15.86:0/2302481193 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7c4414ffa0 msgr2=0x7f7c4406f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:21.366 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.360+0000 7f7c42ffd640 1 --2- 172.21.15.86:0/2302481193 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7c4414ffa0 0x7f7c4406f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:21.366 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.360+0000 7f7c42ffd640 1 -- 172.21.15.86:0/2302481193 >> v1:172.21.15.134:6789/0 conn(0x7f7c44074100 legacy=0x7f7c440c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:21.366 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.360+0000 7f7c42ffd640 1 -- 172.21.15.86:0/2302481193 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c440c6610 con 0x7f7c4414fbc0 2024-04-25T12:21:21.366 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.360+0000 7f7c42ffd640 1 -- 172.21.15.86:0/2302481193 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1387950573 0 0) 0x7f7c2c001680 con 0x7f7c4414fbc0 2024-04-25T12:21:21.366 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.360+0000 7f7c42ffd640 1 -- 172.21.15.86:0/2302481193 >> v1:172.21.15.86:6789/0 conn(0x7f7c4414fbc0 legacy=0x7f7c440c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:21.366 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.360+0000 7f7c42ffd640 1 --2- 172.21.15.86:0/2302481193 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c300039f0 0x7f7c30003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:21.366 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.360+0000 7f7c42ffd640 1 --2- 172.21.15.86:0/2302481193 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c30004810 0x7f7c30004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:21.366 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.360+0000 7f7c42ffd640 1 --2- 172.21.15.86:0/2302481193 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7c4414ffa0 0x7f7c300051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:21.366 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.360+0000 7f7c42ffd640 1 -- 172.21.15.86:0/2302481193 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7c440c6330 con 0x7f7c30004810 2024-04-25T12:21:21.366 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.360+0000 7f7c42ffd640 1 -- 172.21.15.86:0/2302481193 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7c3000ba80 con 0x7f7c300039f0 2024-04-25T12:21:21.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.360+0000 7f7c42ffd640 1 -- 172.21.15.86:0/2302481193 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f7c3000bc80 con 0x7f7c4414ffa0 2024-04-25T12:21:21.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.360+0000 7f7c3bfff640 1 --2- 172.21.15.86:0/2302481193 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c30004810 0x7f7c30004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:21.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.360+0000 7f7c437fe640 1 --2- 172.21.15.86:0/2302481193 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c300039f0 0x7f7c30003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:21.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.360+0000 7f7c3bfff640 1 -- 172.21.15.86:0/2302481193 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7c4414ffa0 msgr2=0x7f7c300051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:21.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.360+0000 7f7c3bfff640 1 --2- 172.21.15.86:0/2302481193 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7c4414ffa0 0x7f7c300051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:21.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.360+0000 7f7c3bfff640 1 -- 172.21.15.86:0/2302481193 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c300039f0 msgr2=0x7f7c30003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:21.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.360+0000 7f7c3bfff640 1 --2- 172.21.15.86:0/2302481193 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c300039f0 0x7f7c30003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:21.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.360+0000 7f7c3bfff640 1 -- 172.21.15.86:0/2302481193 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c30003530 con 0x7f7c30004810 2024-04-25T12:21:21.368 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.364+0000 7f7c3bfff640 1 --2- 172.21.15.86:0/2302481193 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c30004810 0x7f7c30004c90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7c34009ab0 tx=0x7f7c3401ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9e99664e5819ba server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:21.368 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.364+0000 7f7c42ffd640 1 -- 172.21.15.86:0/2302481193 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c340b2070 con 0x7f7c30004810 2024-04-25T12:21:21.368 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.364+0000 7f7c42ffd640 1 -- 172.21.15.86:0/2302481193 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c340a5550 con 0x7f7c30004810 2024-04-25T12:21:21.368 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.364+0000 7f7c42ffd640 1 -- 172.21.15.86:0/2302481193 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c340096b0 con 0x7f7c30004810 2024-04-25T12:21:21.368 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.364+0000 7f7c49f87640 1 -- 172.21.15.86:0/2302481193 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c30004810 msgr2=0x7f7c30004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:21.368 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.364+0000 7f7c49f87640 1 --2- 172.21.15.86:0/2302481193 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c30004810 0x7f7c30004c90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7c34009ab0 tx=0x7f7c3401ca70 comp rx=0 tx=0).stop 2024-04-25T12:21:21.368 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.364+0000 7f7c43fff640 1 -- 172.21.15.86:0/2302481193 reap_dead start 2024-04-25T12:21:21.368 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.364+0000 7f7c49f87640 1 -- 172.21.15.86:0/2302481193 shutdown_connections 2024-04-25T12:21:21.368 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.364+0000 7f7c49f87640 1 -- 172.21.15.86:0/2302481193 >> 172.21.15.86:0/2302481193 conn(0x7f7c4406b9d0 msgr2=0x7f7c4406bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:21.369 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.364+0000 7f7c49f87640 1 -- 172.21.15.86:0/2302481193 shutdown_connections 2024-04-25T12:21:21.369 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.364+0000 7f7c49f87640 1 -- 172.21.15.86:0/2302481193 wait complete. 2024-04-25T12:21:21.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.364+0000 7f7c49f87640 1 Processor -- start 2024-04-25T12:21:21.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.364+0000 7f7c49f87640 1 -- start start 2024-04-25T12:21:21.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.364+0000 7f7c49f87640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c30004810 0x7f7c441eee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:21.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.364+0000 7f7c49f87640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7c441e2340 0x7f7c441f2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:21.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.364+0000 7f7c49f87640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c440b9f20 0x7f7c440c2920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:21.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.364+0000 7f7c49f87640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7c44068350 con 0x7f7c440b9f20 2024-04-25T12:21:21.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.364+0000 7f7c49f87640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7c440681d0 con 0x7f7c30004810 2024-04-25T12:21:21.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.364+0000 7f7c49f87640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f7c440c8930 con 0x7f7c441e2340 2024-04-25T12:21:21.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.364+0000 7f7c43fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c440b9f20 0x7f7c440c2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:21.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.364+0000 7f7c43fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c440b9f20 0x7f7c440c2920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41752/0 (socket says 172.21.15.86:41752) 2024-04-25T12:21:21.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.364+0000 7f7c43fff640 1 -- 172.21.15.86:0/3045031997 learned_addr learned my addr 172.21.15.86:0/3045031997 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:21.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.364+0000 7f7c437fe640 1 --2- 172.21.15.86:0/3045031997 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c30004810 0x7f7c441eee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:21.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.364+0000 7f7c3bfff640 1 --2- 172.21.15.86:0/3045031997 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7c441e2340 0x7f7c441f2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:21.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.364+0000 7f7c43fff640 1 -- 172.21.15.86:0/3045031997 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7c441e2340 msgr2=0x7f7c441f2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:21.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.364+0000 7f7c43fff640 1 --2- 172.21.15.86:0/3045031997 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7c441e2340 0x7f7c441f2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:21.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.364+0000 7f7c43fff640 1 -- 172.21.15.86:0/3045031997 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c30004810 msgr2=0x7f7c441eee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:21.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.364+0000 7f7c43fff640 1 --2- 172.21.15.86:0/3045031997 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c30004810 0x7f7c441eee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:21.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.364+0000 7f7c43fff640 1 -- 172.21.15.86:0/3045031997 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c441efdb0 con 0x7f7c440b9f20 2024-04-25T12:21:21.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.364+0000 7f7c43fff640 1 --2- 172.21.15.86:0/3045031997 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c440b9f20 0x7f7c440c2920 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7c440ca3b0 tx=0x7f7c3c00cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:21.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.368+0000 7f7c40ff9640 1 -- 172.21.15.86:0/3045031997 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c017070 con 0x7f7c440b9f20 2024-04-25T12:21:21.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.368+0000 7f7c40ff9640 1 -- 172.21.15.86:0/3045031997 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c3c005d50 con 0x7f7c440b9f20 2024-04-25T12:21:21.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.368+0000 7f7c49f87640 1 -- 172.21.15.86:0/3045031997 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c441ef510 con 0x7f7c440b9f20 2024-04-25T12:21:21.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.368+0000 7f7c40ff9640 1 -- 172.21.15.86:0/3045031997 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c00a880 con 0x7f7c440b9f20 2024-04-25T12:21:21.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.368+0000 7f7c49f87640 1 -- 172.21.15.86:0/3045031997 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c441efad0 con 0x7f7c440b9f20 2024-04-25T12:21:21.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.368+0000 7f7c49f87640 1 -- 172.21.15.86:0/3045031997 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c44075df0 con 0x7f7c440b9f20 2024-04-25T12:21:21.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.368+0000 7f7c40ff9640 1 -- 172.21.15.86:0/3045031997 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7c3c01a070 con 0x7f7c440b9f20 2024-04-25T12:21:21.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.368+0000 7f7c40ff9640 1 --2- 172.21.15.86:0/3045031997 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f7c24068380 0x7f7c2406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:21.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.368+0000 7f7c437fe640 1 --2- 172.21.15.86:0/3045031997 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f7c24068380 0x7f7c2406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:21.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.368+0000 7f7c40ff9640 1 -- 172.21.15.86:0/3045031997 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f7c3c085990 con 0x7f7c440b9f20 2024-04-25T12:21:21.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.368+0000 7f7c437fe640 1 --2- 172.21.15.86:0/3045031997 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f7c24068380 0x7f7c2406a840 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c000c10 tx=0x7f7c2c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:21.377 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.372+0000 7f7c40ff9640 1 -- 172.21.15.86:0/3045031997 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7c3c0562a0 con 0x7f7c440b9f20 2024-04-25T12:21:21.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.536+0000 7f7c49f87640 1 -- 172.21.15.86:0/3045031997 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f7c4414d190 con 0x7f7c440b9f20 2024-04-25T12:21:21.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.536+0000 7f7c40ff9640 1 -- 172.21.15.86:0/3045031997 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+65 (secure 0 0 0) 0x7f7c3c055ba0 con 0x7f7c440b9f20 2024-04-25T12:21:21.540 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:21:21.540 INFO:teuthology.orchestra.run.smithi086.stdout:[ 2024-04-25T12:21:21.540 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-25T12:21:21.541 INFO:teuthology.orchestra.run.smithi086.stdout: "poolnum": 1, 2024-04-25T12:21:21.541 INFO:teuthology.orchestra.run.smithi086.stdout: "poolname": ".mgr" 2024-04-25T12:21:21.541 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-25T12:21:21.541 INFO:teuthology.orchestra.run.smithi086.stdout:] 2024-04-25T12:21:21.543 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.540+0000 7f7c49f87640 1 -- 172.21.15.86:0/3045031997 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f7c24068380 msgr2=0x7f7c2406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:21.543 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.540+0000 7f7c49f87640 1 --2- 172.21.15.86:0/3045031997 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f7c24068380 0x7f7c2406a840 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c000c10 tx=0x7f7c2c009040 comp rx=0 tx=0).stop 2024-04-25T12:21:21.543 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.540+0000 7f7c49f87640 1 -- 172.21.15.86:0/3045031997 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c440b9f20 msgr2=0x7f7c440c2920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:21.543 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.540+0000 7f7c49f87640 1 --2- 172.21.15.86:0/3045031997 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c440b9f20 0x7f7c440c2920 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7c440ca3b0 tx=0x7f7c3c00cb90 comp rx=0 tx=0).stop 2024-04-25T12:21:21.543 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.540+0000 7f7c49f87640 1 -- 172.21.15.86:0/3045031997 shutdown_connections 2024-04-25T12:21:21.543 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.540+0000 7f7c49f87640 1 --2- 172.21.15.86:0/3045031997 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f7c24068380 0x7f7c2406a840 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:21.543 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.540+0000 7f7c49f87640 1 --2- 172.21.15.86:0/3045031997 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c440b9f20 0x7f7c440c2920 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:21.543 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.540+0000 7f7c49f87640 1 --2- 172.21.15.86:0/3045031997 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7c441e2340 0x7f7c441f2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:21.543 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.540+0000 7f7c49f87640 1 --2- 172.21.15.86:0/3045031997 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c30004810 0x7f7c441eee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:21.543 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.540+0000 7f7c49f87640 1 -- 172.21.15.86:0/3045031997 >> 172.21.15.86:0/3045031997 conn(0x7f7c4406b9d0 msgr2=0x7f7c4414c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:21.544 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.540+0000 7f7c49f87640 1 -- 172.21.15.86:0/3045031997 shutdown_connections 2024-04-25T12:21:21.544 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.540+0000 7f7c49f87640 1 -- 172.21.15.86:0/3045031997 wait complete. 2024-04-25T12:21:21.559 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T12:21:21.559 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T12:21:21.679 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.676+0000 7f5206659640 1 Processor -- start 2024-04-25T12:21:21.680 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.676+0000 7f5206659640 1 -- start start 2024-04-25T12:21:21.681 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.676+0000 7f5206659640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f52000c5fa0 0x7f520015ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:21.681 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.676+0000 7f5206659640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f520015d340 0x7f5200152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:21.681 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.676+0000 7f5206659640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f520006ce60 con 0x7f52000c6380 2024-04-25T12:21:21.681 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.676+0000 7f5206659640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f52000c8890 con 0x7f520015d340 2024-04-25T12:21:21.682 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.676+0000 7f5206659640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f520015c970 con 0x7f52000c5fa0 2024-04-25T12:21:21.682 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.676+0000 7f5204bf6640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f52000c6380 0x7f520006b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:54700/0 (socket says 172.21.15.86:54700) 2024-04-25T12:21:21.682 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.676+0000 7f5204bf6640 1 -- 172.21.15.86:0/4131865172 learned_addr learned my addr 172.21.15.86:0/4131865172 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-04-25T12:21:21.682 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.676+0000 7f51ff7fe640 1 --2- 172.21.15.86:0/4131865172 >> v2:172.21.15.86:3300/0 conn(0x7f520015d340 0x7f5200152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:21.682 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.676+0000 7f51fffff640 1 --2- 172.21.15.86:0/4131865172 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f52000c5fa0 0x7f520015ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:21.682 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.676+0000 7f51feffd640 1 -- 172.21.15.86:0/4131865172 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3466258979 0 0) 0x7f520006ce60 con 0x7f52000c6380 2024-04-25T12:21:21.682 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.676+0000 7f51feffd640 1 -- 172.21.15.86:0/4131865172 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51ec003530 con 0x7f52000c6380 2024-04-25T12:21:21.682 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.676+0000 7f51ff7fe640 1 -- 172.21.15.86:0/4131865172 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f52000c5fa0 msgr2=0x7f520015ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:21.682 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.676+0000 7f51ff7fe640 1 --2- 172.21.15.86:0/4131865172 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f52000c5fa0 0x7f520015ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:21.682 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.676+0000 7f51feffd640 1 -- 172.21.15.86:0/4131865172 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3231271613 0 0) 0x7f51ec003530 con 0x7f52000c6380 2024-04-25T12:21:21.682 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.676+0000 7f51ff7fe640 1 -- 172.21.15.86:0/4131865172 >> v1:172.21.15.86:6789/0 conn(0x7f52000c6380 legacy=0x7f520006b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:21.682 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.676+0000 7f51ff7fe640 1 -- 172.21.15.86:0/4131865172 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52000c8ae0 con 0x7f520015d340 2024-04-25T12:21:21.684 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.680+0000 7f51ff7fe640 1 --2- 172.21.15.86:0/4131865172 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f520015d340 0x7f5200152cf0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f51e80097c0 tx=0x7f51e801c270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89f9a1509fb72bd7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:21.684 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.680+0000 7f51feffd640 1 -- 172.21.15.86:0/4131865172 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e80b0070 con 0x7f520015d340 2024-04-25T12:21:21.684 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.680+0000 7f51feffd640 1 -- 172.21.15.86:0/4131865172 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51e80ab400 con 0x7f520015d340 2024-04-25T12:21:21.684 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.680+0000 7f51feffd640 1 -- 172.21.15.86:0/4131865172 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f0001a00 con 0x7f520015d340 2024-04-25T12:21:21.685 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.680+0000 7f5206659640 1 -- 172.21.15.86:0/4131865172 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f520015d340 msgr2=0x7f5200152cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:21.685 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.680+0000 7f5206659640 1 --2- 172.21.15.86:0/4131865172 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f520015d340 0x7f5200152cf0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f51e80097c0 tx=0x7f51e801c270 comp rx=0 tx=0).stop 2024-04-25T12:21:21.685 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.680+0000 7f5206659640 1 -- 172.21.15.86:0/4131865172 shutdown_connections 2024-04-25T12:21:21.685 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.680+0000 7f5206659640 1 --2- 172.21.15.86:0/4131865172 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f520015d340 0x7f5200152cf0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:21.685 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.680+0000 7f5206659640 1 --2- 172.21.15.86:0/4131865172 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f52000c5fa0 0x7f520015ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:21.685 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.680+0000 7f5206659640 1 -- 172.21.15.86:0/4131865172 >> 172.21.15.86:0/4131865172 conn(0x7f52000c9130 msgr2=0x7f52000c9540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:21.685 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.680+0000 7f5206659640 1 -- 172.21.15.86:0/4131865172 shutdown_connections 2024-04-25T12:21:21.686 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.680+0000 7f5206659640 1 -- 172.21.15.86:0/4131865172 wait complete. 2024-04-25T12:21:21.686 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.680+0000 7f5206659640 1 Processor -- start 2024-04-25T12:21:21.686 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.680+0000 7f5206659640 1 -- start start 2024-04-25T12:21:21.688 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.684+0000 7f5206659640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52000c5fa0 0x7f5200146460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:21.688 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.684+0000 7f5206659640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52000c6380 0x7f520014f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:21.688 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.684+0000 7f5206659640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f520015d340 0x7f52001f5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:21.688 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.684+0000 7f5206659640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f520006cc10 con 0x7f52000c6380 2024-04-25T12:21:21.688 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.684+0000 7f5206659640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f520006ca90 con 0x7f52000c5fa0 2024-04-25T12:21:21.688 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.684+0000 7f5206659640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f52000c6fa0 con 0x7f520015d340 2024-04-25T12:21:21.688 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.684+0000 7f51ff7fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52000c6380 0x7f520014f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:21.688 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.684+0000 7f51ff7fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52000c6380 0x7f520014f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41762/0 (socket says 172.21.15.86:41762) 2024-04-25T12:21:21.688 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.684+0000 7f51ff7fe640 1 -- 172.21.15.86:0/1048471347 learned_addr learned my addr 172.21.15.86:0/1048471347 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:21.689 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.684+0000 7f5204bf6640 1 --2- 172.21.15.86:0/1048471347 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f520015d340 0x7f52001f5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:21.689 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.684+0000 7f51fffff640 1 --2- 172.21.15.86:0/1048471347 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52000c5fa0 0x7f5200146460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:21.689 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.684+0000 7f51ff7fe640 1 -- 172.21.15.86:0/1048471347 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f520015d340 msgr2=0x7f52001f5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:21.689 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.684+0000 7f51ff7fe640 1 --2- 172.21.15.86:0/1048471347 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f520015d340 0x7f52001f5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:21.689 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.684+0000 7f51ff7fe640 1 -- 172.21.15.86:0/1048471347 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52000c5fa0 msgr2=0x7f5200146460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:21.689 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.684+0000 7f51ff7fe640 1 --2- 172.21.15.86:0/1048471347 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52000c5fa0 0x7f5200146460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:21.689 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.684+0000 7f51ff7fe640 1 -- 172.21.15.86:0/1048471347 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5200157d90 con 0x7f52000c6380 2024-04-25T12:21:21.689 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.684+0000 7f5204bf6640 1 --2- 172.21.15.86:0/1048471347 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f520015d340 0x7f52001f5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:21:21.689 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.684+0000 7f51ff7fe640 1 --2- 172.21.15.86:0/1048471347 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52000c6380 0x7f520014f5c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f51e801a920 tx=0x7f51e8019010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:21.689 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.684+0000 7f51fcff9640 1 -- 172.21.15.86:0/1048471347 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e80b8020 con 0x7f52000c6380 2024-04-25T12:21:21.689 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.684+0000 7f51fcff9640 1 -- 172.21.15.86:0/1048471347 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51e80b4410 con 0x7f52000c6380 2024-04-25T12:21:21.689 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.684+0000 7f51fcff9640 1 -- 172.21.15.86:0/1048471347 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e80b0040 con 0x7f52000c6380 2024-04-25T12:21:21.689 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.684+0000 7f5206659640 1 -- 172.21.15.86:0/1048471347 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f520014fb00 con 0x7f52000c6380 2024-04-25T12:21:21.689 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.684+0000 7f5206659640 1 -- 172.21.15.86:0/1048471347 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f520014f310 con 0x7f52000c6380 2024-04-25T12:21:21.690 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.684+0000 7f5206659640 1 -- 172.21.15.86:0/1048471347 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5200075e60 con 0x7f52000c6380 2024-04-25T12:21:21.690 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.684+0000 7f51fcff9640 1 -- 172.21.15.86:0/1048471347 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f51e80bb020 con 0x7f52000c6380 2024-04-25T12:21:21.691 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.684+0000 7f51fcff9640 1 --2- 172.21.15.86:0/1048471347 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f51e0068380 0x7f51e006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:21.691 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.684+0000 7f51fcff9640 1 -- 172.21.15.86:0/1048471347 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f51e81204b0 con 0x7f52000c6380 2024-04-25T12:21:21.691 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.684+0000 7f51fffff640 1 --2- 172.21.15.86:0/1048471347 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f51e0068380 0x7f51e006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:21.691 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.688+0000 7f51fffff640 1 --2- 172.21.15.86:0/1048471347 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f51e0068380 0x7f51e006a840 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f51f8009990 tx=0x7f51f8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:21.695 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.692+0000 7f51fcff9640 1 -- 172.21.15.86:0/1048471347 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f51e80c2030 con 0x7f52000c6380 2024-04-25T12:21:21.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:21.844+0000 7f5206659640 1 -- 172.21.15.86:0/1048471347 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f520014e4e0 con 0x7f52000c6380 2024-04-25T12:21:22.073 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.068+0000 7f51fcff9640 1 -- 172.21.15.86:0/1048471347 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) ==== 138+0+0 (secure 0 0 0) 0x7f5200157d90 con 0x7f52000c6380 2024-04-25T12:21:22.073 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_metadata' created 2024-04-25T12:21:22.077 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.072+0000 7f5206659640 1 -- 172.21.15.86:0/1048471347 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f51e0068380 msgr2=0x7f51e006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:22.077 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.072+0000 7f5206659640 1 --2- 172.21.15.86:0/1048471347 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f51e0068380 0x7f51e006a840 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f51f8009990 tx=0x7f51f8008040 comp rx=0 tx=0).stop 2024-04-25T12:21:22.077 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.072+0000 7f5206659640 1 -- 172.21.15.86:0/1048471347 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52000c6380 msgr2=0x7f520014f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:22.077 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.072+0000 7f5206659640 1 --2- 172.21.15.86:0/1048471347 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52000c6380 0x7f520014f5c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f51e801a920 tx=0x7f51e8019010 comp rx=0 tx=0).stop 2024-04-25T12:21:22.077 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.072+0000 7f5206659640 1 -- 172.21.15.86:0/1048471347 shutdown_connections 2024-04-25T12:21:22.077 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.072+0000 7f5206659640 1 --2- 172.21.15.86:0/1048471347 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f520015d340 0x7f52001f5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:22.077 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.072+0000 7f5206659640 1 --2- 172.21.15.86:0/1048471347 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f51e0068380 0x7f51e006a840 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:22.077 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.072+0000 7f5206659640 1 --2- 172.21.15.86:0/1048471347 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52000c6380 0x7f520014f5c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:22.077 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.072+0000 7f5206659640 1 --2- 172.21.15.86:0/1048471347 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52000c5fa0 0x7f5200146460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:22.077 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.072+0000 7f5206659640 1 -- 172.21.15.86:0/1048471347 >> 172.21.15.86:0/1048471347 conn(0x7f52000c9130 msgr2=0x7f52000cba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:22.077 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.072+0000 7f5206659640 1 -- 172.21.15.86:0/1048471347 shutdown_connections 2024-04-25T12:21:22.078 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.072+0000 7f5206659640 1 -- 172.21.15.86:0/1048471347 wait complete. 2024-04-25T12:21:22.099 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-04-25T12:21:22.223 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.220+0000 7fec17aee640 1 Processor -- start 2024-04-25T12:21:22.223 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.220+0000 7fec17aee640 1 -- start start 2024-04-25T12:21:22.224 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.220+0000 7fec17aee640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fec10155350 0x7fec100c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:22.224 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.220+0000 7fec17aee640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fec1015b0b0 0x7fec1015b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:22.224 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.220+0000 7fec17aee640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec1015beb0 con 0x7fec100cda50 2024-04-25T12:21:22.225 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.220+0000 7fec17aee640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fec100cca40 con 0x7fec10155350 2024-04-25T12:21:22.225 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.220+0000 7fec17aee640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fec100ccc90 con 0x7fec1015b0b0 2024-04-25T12:21:22.225 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.220+0000 7fec15089640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fec100cda50 0x7fec100cb7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:54712/0 (socket says 172.21.15.86:54712) 2024-04-25T12:21:22.225 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.220+0000 7fec15089640 1 -- 172.21.15.86:0/572477465 learned_addr learned my addr 172.21.15.86:0/572477465 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-04-25T12:21:22.227 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.220+0000 7fec14888640 1 -- 172.21.15.86:0/572477465 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3638372405 0 0) 0x7fec1015beb0 con 0x7fec100cda50 2024-04-25T12:21:22.227 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.220+0000 7fec1608b640 1 --2- 172.21.15.86:0/572477465 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fec1015b0b0 0x7fec1015b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:22.227 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.220+0000 7fec14888640 1 -- 172.21.15.86:0/572477465 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7febfc003530 con 0x7fec100cda50 2024-04-25T12:21:22.227 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.220+0000 7fec1588a640 1 --2- 172.21.15.86:0/572477465 >> v2:172.21.15.134:3300/0 conn(0x7fec10155350 0x7fec100c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:22.227 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.220+0000 7fec14888640 1 -- 172.21.15.86:0/572477465 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3992293897 0 0) 0x7febfc003530 con 0x7fec100cda50 2024-04-25T12:21:22.227 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.220+0000 7fec14888640 1 -- 172.21.15.86:0/572477465 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fec1015b0b0 msgr2=0x7fec1015b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:22.227 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.220+0000 7fec14888640 1 --2- 172.21.15.86:0/572477465 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fec1015b0b0 0x7fec1015b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:22.227 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.220+0000 7fec14888640 1 -- 172.21.15.86:0/572477465 >> v2:172.21.15.134:3300/0 conn(0x7fec10155350 msgr2=0x7fec100c59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:22.228 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.220+0000 7fec14888640 1 --2- 172.21.15.86:0/572477465 >> v2:172.21.15.134:3300/0 conn(0x7fec10155350 0x7fec100c59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:22.228 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.220+0000 7fec14888640 1 -- 172.21.15.86:0/572477465 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec100ccf70 con 0x7fec100cda50 2024-04-25T12:21:22.228 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.220+0000 7fec14888640 1 -- 172.21.15.86:0/572477465 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1387950573 0 0) 0x7fec00001680 con 0x7fec100cda50 2024-04-25T12:21:22.228 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.220+0000 7fec14888640 1 -- 172.21.15.86:0/572477465 >> v1:172.21.15.86:6789/0 conn(0x7fec100cda50 legacy=0x7fec100cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:22.228 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.220+0000 7fec14888640 1 --2- 172.21.15.86:0/572477465 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7febfc0039c0 0x7febfc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:22.228 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.220+0000 7fec14888640 1 --2- 172.21.15.86:0/572477465 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fec1015b0b0 0x7febfc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:22.228 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.220+0000 7fec14888640 1 --2- 172.21.15.86:0/572477465 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7febfc004d50 0x7febfc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:22.228 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.220+0000 7fec14888640 1 -- 172.21.15.86:0/572477465 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fec100cca40 con 0x7febfc004d50 2024-04-25T12:21:22.228 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.220+0000 7fec14888640 1 -- 172.21.15.86:0/572477465 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fec100ccc90 con 0x7febfc0039c0 2024-04-25T12:21:22.228 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.220+0000 7fec14888640 1 -- 172.21.15.86:0/572477465 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7febfc00ba90 con 0x7fec1015b0b0 2024-04-25T12:21:22.228 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.220+0000 7fec1608b640 1 --2- 172.21.15.86:0/572477465 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7febfc004d50 0x7febfc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:22.228 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.220+0000 7fec1588a640 1 --2- 172.21.15.86:0/572477465 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7febfc0039c0 0x7febfc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:22.228 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.220+0000 7fec15089640 1 --2- 172.21.15.86:0/572477465 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fec1015b0b0 0x7febfc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:22.229 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.220+0000 7fec1608b640 1 -- 172.21.15.86:0/572477465 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fec1015b0b0 msgr2=0x7febfc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:22.229 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.220+0000 7fec1608b640 1 --2- 172.21.15.86:0/572477465 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fec1015b0b0 0x7febfc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:22.229 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.220+0000 7fec1608b640 1 -- 172.21.15.86:0/572477465 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7febfc0039c0 msgr2=0x7febfc003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:22.229 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.220+0000 7fec1608b640 1 --2- 172.21.15.86:0/572477465 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7febfc0039c0 0x7febfc003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:22.229 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.220+0000 7fec1608b640 1 -- 172.21.15.86:0/572477465 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febfc003530 con 0x7febfc004d50 2024-04-25T12:21:22.229 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.220+0000 7fec15089640 1 --2- 172.21.15.86:0/572477465 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fec1015b0b0 0x7febfc004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:21:22.232 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.224+0000 7fec1608b640 1 --2- 172.21.15.86:0/572477465 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7febfc004d50 0x7febfc0051d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fec08009fc0 tx=0x7fec0801cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e21a821aec5c974 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:22.232 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.224+0000 7fec14888640 1 -- 172.21.15.86:0/572477465 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec080b2070 con 0x7febfc004d50 2024-04-25T12:21:22.232 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.224+0000 7fec14888640 1 -- 172.21.15.86:0/572477465 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec080a5c90 con 0x7febfc004d50 2024-04-25T12:21:22.232 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.224+0000 7fec14888640 1 -- 172.21.15.86:0/572477465 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec08009c10 con 0x7febfc004d50 2024-04-25T12:21:22.233 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.224+0000 7fec17aee640 1 -- 172.21.15.86:0/572477465 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7febfc004d50 msgr2=0x7febfc0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:22.233 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.224+0000 7fec17aee640 1 --2- 172.21.15.86:0/572477465 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7febfc004d50 0x7febfc0051d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fec08009fc0 tx=0x7fec0801cc80 comp rx=0 tx=0).stop 2024-04-25T12:21:22.233 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.224+0000 7fec1608b640 1 -- 172.21.15.86:0/572477465 reap_dead start 2024-04-25T12:21:22.233 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.224+0000 7fec17aee640 1 -- 172.21.15.86:0/572477465 shutdown_connections 2024-04-25T12:21:22.233 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.224+0000 7fec17aee640 1 -- 172.21.15.86:0/572477465 >> 172.21.15.86:0/572477465 conn(0x7fec1006cc30 msgr2=0x7fec1006d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:22.233 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.224+0000 7fec17aee640 1 -- 172.21.15.86:0/572477465 shutdown_connections 2024-04-25T12:21:22.233 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.224+0000 7fec17aee640 1 -- 172.21.15.86:0/572477465 wait complete. 2024-04-25T12:21:22.233 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.224+0000 7fec17aee640 1 Processor -- start 2024-04-25T12:21:22.233 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.224+0000 7fec17aee640 1 -- start start 2024-04-25T12:21:22.233 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.228+0000 7fec17aee640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7febfc004d50 0x7fec1015e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:22.233 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.228+0000 7fec17aee640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fec10154440 0x7fec101f0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:22.233 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.228+0000 7fec17aee640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec101f1230 0x7fec101431f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:22.233 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.228+0000 7fec17aee640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fec10155730 con 0x7febfc004d50 2024-04-25T12:21:22.233 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.228+0000 7fec17aee640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fec100cd530 con 0x7fec101f1230 2024-04-25T12:21:22.233 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.228+0000 7fec17aee640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fec1015e860 con 0x7fec10154440 2024-04-25T12:21:22.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.228+0000 7fec1588a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7febfc004d50 0x7fec1015e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:22.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.228+0000 7fec1588a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7febfc004d50 0x7fec1015e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41780/0 (socket says 172.21.15.86:41780) 2024-04-25T12:21:22.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.228+0000 7fec1588a640 1 -- 172.21.15.86:0/1792435108 learned_addr learned my addr 172.21.15.86:0/1792435108 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:22.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.228+0000 7fec15089640 1 --2- 172.21.15.86:0/1792435108 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fec10154440 0x7fec101f0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:22.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.228+0000 7fec1608b640 1 --2- 172.21.15.86:0/1792435108 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec101f1230 0x7fec101431f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:22.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.228+0000 7fec1588a640 1 -- 172.21.15.86:0/1792435108 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fec10154440 msgr2=0x7fec101f0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:22.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.228+0000 7fec1588a640 1 --2- 172.21.15.86:0/1792435108 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fec10154440 0x7fec101f0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:22.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.228+0000 7fec1588a640 1 -- 172.21.15.86:0/1792435108 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec101f1230 msgr2=0x7fec101431f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:22.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.228+0000 7fec1588a640 1 --2- 172.21.15.86:0/1792435108 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec101f1230 0x7fec101431f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:22.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.228+0000 7fec1588a640 1 -- 172.21.15.86:0/1792435108 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec10158800 con 0x7febfc004d50 2024-04-25T12:21:22.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.228+0000 7fec1588a640 1 --2- 172.21.15.86:0/1792435108 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7febfc004d50 0x7fec1015e030 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fec0c00f5d0 tx=0x7fec0c00fa90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:22.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.228+0000 7fec067fc640 1 -- 172.21.15.86:0/1792435108 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec0c019020 con 0x7febfc004d50 2024-04-25T12:21:22.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.228+0000 7fec067fc640 1 -- 172.21.15.86:0/1792435108 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec0c014870 con 0x7febfc004d50 2024-04-25T12:21:22.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.228+0000 7fec17aee640 1 -- 172.21.15.86:0/1792435108 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec101f3f90 con 0x7febfc004d50 2024-04-25T12:21:22.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.228+0000 7fec067fc640 1 -- 172.21.15.86:0/1792435108 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec0c014c60 con 0x7febfc004d50 2024-04-25T12:21:22.235 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.228+0000 7fec17aee640 1 -- 172.21.15.86:0/1792435108 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec101f4550 con 0x7febfc004d50 2024-04-25T12:21:22.235 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.228+0000 7fec17aee640 1 -- 172.21.15.86:0/1792435108 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec10075df0 con 0x7febfc004d50 2024-04-25T12:21:22.235 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.228+0000 7fec067fc640 1 -- 172.21.15.86:0/1792435108 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fec0c01c020 con 0x7febfc004d50 2024-04-25T12:21:22.235 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.228+0000 7fec067fc640 1 --2- 172.21.15.86:0/1792435108 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7febf40683b0 0x7febf406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:22.236 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.228+0000 7fec067fc640 1 -- 172.21.15.86:0/1792435108 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 5227+0+0 (secure 0 0 0) 0x7fec0c086f60 con 0x7febfc004d50 2024-04-25T12:21:22.236 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.228+0000 7fec15089640 1 --2- 172.21.15.86:0/1792435108 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7febf40683b0 0x7febf406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:22.236 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.228+0000 7fec15089640 1 --2- 172.21.15.86:0/1792435108 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7febf40683b0 0x7febf406a870 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fec10152230 tx=0x7fec00009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:22.238 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.232+0000 7fec067fc640 1 -- 172.21.15.86:0/1792435108 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fec0c023020 con 0x7febfc004d50 2024-04-25T12:21:22.399 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:22.396+0000 7fec17aee640 1 -- 172.21.15.86:0/1792435108 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7fec101f1610 con 0x7febfc004d50 2024-04-25T12:21:22.674 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T12:21:22.677 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T12:21:23.084 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.080+0000 7fec067fc640 1 -- 172.21.15.86:0/1792435108 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) ==== 171+0+0 (secure 0 0 0) 0x7fec0c057700 con 0x7febfc004d50 2024-04-25T12:21:23.084 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_data' created 2024-04-25T12:21:23.087 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.084+0000 7fec17aee640 1 -- 172.21.15.86:0/1792435108 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7febf40683b0 msgr2=0x7febf406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:23.087 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.084+0000 7fec17aee640 1 --2- 172.21.15.86:0/1792435108 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7febf40683b0 0x7febf406a870 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fec10152230 tx=0x7fec00009040 comp rx=0 tx=0).stop 2024-04-25T12:21:23.087 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.084+0000 7fec17aee640 1 -- 172.21.15.86:0/1792435108 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7febfc004d50 msgr2=0x7fec1015e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:23.087 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.084+0000 7fec17aee640 1 --2- 172.21.15.86:0/1792435108 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7febfc004d50 0x7fec1015e030 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fec0c00f5d0 tx=0x7fec0c00fa90 comp rx=0 tx=0).stop 2024-04-25T12:21:23.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.084+0000 7fec17aee640 1 -- 172.21.15.86:0/1792435108 shutdown_connections 2024-04-25T12:21:23.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.084+0000 7fec17aee640 1 --2- 172.21.15.86:0/1792435108 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec101f1230 0x7fec101431f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:23.090 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.084+0000 7fec17aee640 1 --2- 172.21.15.86:0/1792435108 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fec10154440 0x7fec101f0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:23.090 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.084+0000 7fec17aee640 1 --2- 172.21.15.86:0/1792435108 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7febf40683b0 0x7febf406a870 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:23.090 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.084+0000 7fec17aee640 1 --2- 172.21.15.86:0/1792435108 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7febfc004d50 0x7fec1015e030 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:23.090 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.084+0000 7fec17aee640 1 -- 172.21.15.86:0/1792435108 >> 172.21.15.86:0/1792435108 conn(0x7fec1006cc30 msgr2=0x7fec10158d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:23.091 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.088+0000 7fec17aee640 1 -- 172.21.15.86:0/1792435108 shutdown_connections 2024-04-25T12:21:23.091 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.088+0000 7fec17aee640 1 -- 172.21.15.86:0/1792435108 wait complete. 2024-04-25T12:21:23.123 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T12:21:23.247 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.244+0000 7fdfab672640 1 Processor -- start 2024-04-25T12:21:23.247 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.244+0000 7fdfab672640 1 -- start start 2024-04-25T12:21:23.250 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.244+0000 7fdfab672640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfa415ee20 0x7fdfa40c3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:23.250 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.244+0000 7fdfab672640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfa40c4e80 con 0x7fdfa406f700 2024-04-25T12:21:23.250 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.244+0000 7fdfab672640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfa415f320 con 0x7fdfa4155300 2024-04-25T12:21:23.250 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.244+0000 7fdfab672640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fdfa40c4230 con 0x7fdfa415ee20 2024-04-25T12:21:23.250 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.244+0000 7fdfa9c0f640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fdfa406f700 0x7fdfa40c6f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:58866/0 (socket says 172.21.15.86:58866) 2024-04-25T12:21:23.251 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.244+0000 7fdfa9c0f640 1 -- 172.21.15.86:0/2448324193 learned_addr learned my addr 172.21.15.86:0/2448324193 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-04-25T12:21:23.251 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.244+0000 7fdfa8c0d640 1 --2- 172.21.15.86:0/2448324193 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfa415ee20 0x7fdfa40c3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:23.251 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.244+0000 7fdfa3fff640 1 -- 172.21.15.86:0/2448324193 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4160675535 0 0) 0x7fdfa40c4e80 con 0x7fdfa406f700 2024-04-25T12:21:23.251 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.244+0000 7fdfa3fff640 1 -- 172.21.15.86:0/2448324193 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdf8c003530 con 0x7fdfa406f700 2024-04-25T12:21:23.251 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.244+0000 7fdfa3fff640 1 -- 172.21.15.86:0/2448324193 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1727311397 0 0) 0x7fdf8c003530 con 0x7fdfa406f700 2024-04-25T12:21:23.251 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.244+0000 7fdfa3fff640 1 -- 172.21.15.86:0/2448324193 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfa415ee20 msgr2=0x7fdfa40c3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:23.251 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.244+0000 7fdfa3fff640 1 --2- 172.21.15.86:0/2448324193 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfa415ee20 0x7fdfa40c3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:23.251 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.244+0000 7fdfa3fff640 1 -- 172.21.15.86:0/2448324193 >> v1:172.21.15.134:6789/0 conn(0x7fdfa4155300 legacy=0x7fdfa415e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:23.251 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.244+0000 7fdfa3fff640 1 -- 172.21.15.86:0/2448324193 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfa40c5120 con 0x7fdfa406f700 2024-04-25T12:21:23.251 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.244+0000 7fdfa3fff640 1 -- 172.21.15.86:0/2448324193 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1387950573 0 0) 0x7fdf94001a00 con 0x7fdfa406f700 2024-04-25T12:21:23.251 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.244+0000 7fdfa3fff640 1 -- 172.21.15.86:0/2448324193 >> v1:172.21.15.86:6789/0 conn(0x7fdfa406f700 legacy=0x7fdfa40c6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:23.251 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.244+0000 7fdfa3fff640 1 --2- 172.21.15.86:0/2448324193 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfa415ee20 0x7fdf8c0039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:23.251 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.244+0000 7fdfa3fff640 1 --2- 172.21.15.86:0/2448324193 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf8c003f70 0x7fdf8c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:23.251 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.244+0000 7fdfa3fff640 1 --2- 172.21.15.86:0/2448324193 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdf8c004d50 0x7fdf8c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:23.251 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.244+0000 7fdfa3fff640 1 -- 172.21.15.86:0/2448324193 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fdfa40c4230 con 0x7fdf8c004d50 2024-04-25T12:21:23.252 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.244+0000 7fdfa3fff640 1 -- 172.21.15.86:0/2448324193 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdf8c00bab0 con 0x7fdf8c003f70 2024-04-25T12:21:23.252 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.244+0000 7fdfa3fff640 1 -- 172.21.15.86:0/2448324193 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fdf8c00bcb0 con 0x7fdfa415ee20 2024-04-25T12:21:23.252 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.244+0000 7fdfa9c0f640 1 --2- 172.21.15.86:0/2448324193 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdf8c004d50 0x7fdf8c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:23.252 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.244+0000 7fdfa940e640 1 --2- 172.21.15.86:0/2448324193 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfa415ee20 0x7fdf8c0039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:23.252 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.244+0000 7fdfa8c0d640 1 --2- 172.21.15.86:0/2448324193 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf8c003f70 0x7fdf8c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:23.252 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.244+0000 7fdfa9c0f640 1 -- 172.21.15.86:0/2448324193 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfa415ee20 msgr2=0x7fdf8c0039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:23.252 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.244+0000 7fdfa9c0f640 1 --2- 172.21.15.86:0/2448324193 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfa415ee20 0x7fdf8c0039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:23.252 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.244+0000 7fdfa9c0f640 1 -- 172.21.15.86:0/2448324193 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf8c003f70 msgr2=0x7fdf8c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:23.252 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.244+0000 7fdfa9c0f640 1 --2- 172.21.15.86:0/2448324193 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf8c003f70 0x7fdf8c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:23.252 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.244+0000 7fdfa9c0f640 1 -- 172.21.15.86:0/2448324193 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf8c003530 con 0x7fdf8c004d50 2024-04-25T12:21:23.253 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.248+0000 7fdfa9c0f640 1 --2- 172.21.15.86:0/2448324193 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdf8c004d50 0x7fdf8c0051d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdf9400a850 tx=0x7fdf9401d3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e9beeafa43bcc0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:23.253 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.248+0000 7fdfa3fff640 1 -- 172.21.15.86:0/2448324193 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf9400a4a0 con 0x7fdf8c004d50 2024-04-25T12:21:23.253 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.248+0000 7fdfa3fff640 1 -- 172.21.15.86:0/2448324193 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf940ad650 con 0x7fdf8c004d50 2024-04-25T12:21:23.253 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.248+0000 7fdfa3fff640 1 -- 172.21.15.86:0/2448324193 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf940ada80 con 0x7fdf8c004d50 2024-04-25T12:21:23.253 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.248+0000 7fdfab672640 1 -- 172.21.15.86:0/2448324193 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdf8c004d50 msgr2=0x7fdf8c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:23.253 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.248+0000 7fdfab672640 1 --2- 172.21.15.86:0/2448324193 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdf8c004d50 0x7fdf8c0051d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdf9400a850 tx=0x7fdf9401d3a0 comp rx=0 tx=0).stop 2024-04-25T12:21:23.254 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.248+0000 7fdfa9c0f640 1 -- 172.21.15.86:0/2448324193 reap_dead start 2024-04-25T12:21:23.254 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.248+0000 7fdfab672640 1 -- 172.21.15.86:0/2448324193 shutdown_connections 2024-04-25T12:21:23.254 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.248+0000 7fdfab672640 1 -- 172.21.15.86:0/2448324193 >> 172.21.15.86:0/2448324193 conn(0x7fdfa406b9d0 msgr2=0x7fdfa406bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:23.254 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.248+0000 7fdfab672640 1 -- 172.21.15.86:0/2448324193 shutdown_connections 2024-04-25T12:21:23.254 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.248+0000 7fdfab672640 1 -- 172.21.15.86:0/2448324193 wait complete. 2024-04-25T12:21:23.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.248+0000 7fdfab672640 1 Processor -- start 2024-04-25T12:21:23.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.248+0000 7fdfab672640 1 -- start start 2024-04-25T12:21:23.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.252+0000 7fdfab672640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfa414c1c0 0x7fdfa414c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:23.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.252+0000 7fdfab672640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfa414eeb0 0x7fdfa41f1030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:23.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.252+0000 7fdfab672640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdfa41f1570 0x7fdfa41f3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:23.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.252+0000 7fdfab672640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fdfa415f600 con 0x7fdfa41f1570 2024-04-25T12:21:23.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.252+0000 7fdfab672640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdfa40c5770 con 0x7fdfa414eeb0 2024-04-25T12:21:23.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.252+0000 7fdfab672640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fdfa40681d0 con 0x7fdfa414c1c0 2024-04-25T12:21:23.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.252+0000 7fdfa9c0f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdfa41f1570 0x7fdfa41f3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:23.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.252+0000 7fdfa9c0f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdfa41f1570 0x7fdfa41f3ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55130/0 (socket says 172.21.15.86:55130) 2024-04-25T12:21:23.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.252+0000 7fdfa9c0f640 1 -- 172.21.15.86:0/286917760 learned_addr learned my addr 172.21.15.86:0/286917760 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:23.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.252+0000 7fdfa940e640 1 --2- 172.21.15.86:0/286917760 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfa414c1c0 0x7fdfa414c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:23.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.252+0000 7fdfa8c0d640 1 --2- 172.21.15.86:0/286917760 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfa414eeb0 0x7fdfa41f1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:23.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.252+0000 7fdfa9c0f640 1 -- 172.21.15.86:0/286917760 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfa414c1c0 msgr2=0x7fdfa414c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:23.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.252+0000 7fdfa9c0f640 1 --2- 172.21.15.86:0/286917760 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfa414c1c0 0x7fdfa414c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:23.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.252+0000 7fdfa9c0f640 1 -- 172.21.15.86:0/286917760 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfa414eeb0 msgr2=0x7fdfa41f1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:23.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.252+0000 7fdfa9c0f640 1 --2- 172.21.15.86:0/286917760 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfa414eeb0 0x7fdfa41f1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:23.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.252+0000 7fdfa9c0f640 1 -- 172.21.15.86:0/286917760 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfa40734e0 con 0x7fdfa41f1570 2024-04-25T12:21:23.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.252+0000 7fdfa9c0f640 1 --2- 172.21.15.86:0/286917760 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdfa41f1570 0x7fdfa41f3ee0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fdf9401d1d0 tx=0x7fdf8c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:23.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.252+0000 7fdfa1ffb640 1 -- 172.21.15.86:0/286917760 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf94001ff0 con 0x7fdfa41f1570 2024-04-25T12:21:23.258 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.252+0000 7fdfa1ffb640 1 -- 172.21.15.86:0/286917760 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf940bb070 con 0x7fdfa41f1570 2024-04-25T12:21:23.258 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.252+0000 7fdfa1ffb640 1 -- 172.21.15.86:0/286917760 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf9400a480 con 0x7fdfa41f1570 2024-04-25T12:21:23.258 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.252+0000 7fdfab672640 1 -- 172.21.15.86:0/286917760 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfa40737a0 con 0x7fdfa41f1570 2024-04-25T12:21:23.258 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.252+0000 7fdfab672640 1 -- 172.21.15.86:0/286917760 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfa4073d60 con 0x7fdfa41f1570 2024-04-25T12:21:23.258 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.252+0000 7fdfab672640 1 -- 172.21.15.86:0/286917760 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfa4075df0 con 0x7fdfa41f1570 2024-04-25T12:21:23.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.252+0000 7fdfa1ffb640 1 -- 172.21.15.86:0/286917760 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fdf940b5070 con 0x7fdfa41f1570 2024-04-25T12:21:23.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.252+0000 7fdfa1ffb640 1 --2- 172.21.15.86:0/286917760 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fdf90068380 0x7fdf9006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:23.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.252+0000 7fdfa1ffb640 1 -- 172.21.15.86:0/286917760 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5609+0+0 (secure 0 0 0) 0x7fdf94120d30 con 0x7fdfa41f1570 2024-04-25T12:21:23.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.252+0000 7fdfa940e640 1 --2- 172.21.15.86:0/286917760 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fdf90068380 0x7fdf9006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:23.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.256+0000 7fdfa940e640 1 --2- 172.21.15.86:0/286917760 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fdf90068380 0x7fdf9006a840 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c007fd0 tx=0x7fdf9c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:23.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.260+0000 7fdfa1ffb640 1 -- 172.21.15.86:0/286917760 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fdf940170b0 con 0x7fdfa41f1570 2024-04-25T12:21:23.458 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:23.456+0000 7fdfab672640 1 -- 172.21.15.86:0/286917760 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fdfa41f0d50 con 0x7fdfa41f1570 2024-04-25T12:21:24.133 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.128+0000 7fdfa1ffb640 1 -- 172.21.15.86:0/286917760 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7fdfa41f0d50 con 0x7fdfa41f1570 2024-04-25T12:21:24.134 INFO:teuthology.orchestra.run.smithi086.stderr:new fs with metadata pool 2 and data pool 3 2024-04-25T12:21:24.142 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.136+0000 7fdfab672640 1 -- 172.21.15.86:0/286917760 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fdf90068380 msgr2=0x7fdf9006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:24.142 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.136+0000 7fdfab672640 1 --2- 172.21.15.86:0/286917760 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fdf90068380 0x7fdf9006a840 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c007fd0 tx=0x7fdf9c009040 comp rx=0 tx=0).stop 2024-04-25T12:21:24.142 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.136+0000 7fdfab672640 1 -- 172.21.15.86:0/286917760 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdfa41f1570 msgr2=0x7fdfa41f3ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:24.142 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.136+0000 7fdfab672640 1 --2- 172.21.15.86:0/286917760 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdfa41f1570 0x7fdfa41f3ee0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fdf9401d1d0 tx=0x7fdf8c005840 comp rx=0 tx=0).stop 2024-04-25T12:21:24.142 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.136+0000 7fdfab672640 1 -- 172.21.15.86:0/286917760 shutdown_connections 2024-04-25T12:21:24.142 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.136+0000 7fdfab672640 1 --2- 172.21.15.86:0/286917760 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fdf90068380 0x7fdf9006a840 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:24.142 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.136+0000 7fdfab672640 1 --2- 172.21.15.86:0/286917760 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdfa41f1570 0x7fdfa41f3ee0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:24.143 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.136+0000 7fdfab672640 1 --2- 172.21.15.86:0/286917760 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfa414eeb0 0x7fdfa41f1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:24.143 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.136+0000 7fdfab672640 1 --2- 172.21.15.86:0/286917760 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfa414c1c0 0x7fdfa414c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:24.143 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.136+0000 7fdfab672640 1 -- 172.21.15.86:0/286917760 >> 172.21.15.86:0/286917760 conn(0x7fdfa406b9d0 msgr2=0x7fdfa4152b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:24.143 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.136+0000 7fdfab672640 1 -- 172.21.15.86:0/286917760 shutdown_connections 2024-04-25T12:21:24.143 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.136+0000 7fdfab672640 1 -- 172.21.15.86:0/286917760 wait complete. 2024-04-25T12:21:24.163 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-04-25T12:21:24.163 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-04-25T12:21:24.291 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.287+0000 7fc95fe76640 1 Processor -- start 2024-04-25T12:21:24.291 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.287+0000 7fc95fe76640 1 -- start start 2024-04-25T12:21:24.294 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.287+0000 7fc95fe76640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc958073e00 0x7fc9580676a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:24.294 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.287+0000 7fc95fe76640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc9580c8910 0x7fc95806ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:24.294 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.287+0000 7fc95fe76640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc958067cc0 con 0x7fc9580741e0 2024-04-25T12:21:24.294 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.287+0000 7fc95fe76640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fc9580c7fe0 con 0x7fc9580c8910 2024-04-25T12:21:24.294 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.287+0000 7fc95fe76640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fc9580c82c0 con 0x7fc958073e00 2024-04-25T12:21:24.295 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.287+0000 7fc95d411640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fc9580741e0 0x7fc958159110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:58872/0 (socket says 172.21.15.86:58872) 2024-04-25T12:21:24.295 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.287+0000 7fc95d411640 1 -- 172.21.15.86:0/4153414205 learned_addr learned my addr 172.21.15.86:0/4153414205 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-04-25T12:21:24.295 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.287+0000 7fc95cc10640 1 -- 172.21.15.86:0/4153414205 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 868984951 0 0) 0x7fc958067cc0 con 0x7fc9580741e0 2024-04-25T12:21:24.295 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.287+0000 7fc95dc12640 1 --2- 172.21.15.86:0/4153414205 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc958073e00 0x7fc9580676a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:24.295 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.287+0000 7fc95e413640 1 --2- 172.21.15.86:0/4153414205 >> v2:172.21.15.134:3300/0 conn(0x7fc9580c8910 0x7fc95806ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:24.295 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.287+0000 7fc95cc10640 1 -- 172.21.15.86:0/4153414205 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc940003530 con 0x7fc9580741e0 2024-04-25T12:21:24.295 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.287+0000 7fc95cc10640 1 -- 172.21.15.86:0/4153414205 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 971345071 0 0) 0x7fc940003530 con 0x7fc9580741e0 2024-04-25T12:21:24.295 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.287+0000 7fc95cc10640 1 -- 172.21.15.86:0/4153414205 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc958073e00 msgr2=0x7fc9580676a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:24.295 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.287+0000 7fc95cc10640 1 --2- 172.21.15.86:0/4153414205 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc958073e00 0x7fc9580676a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:24.295 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.287+0000 7fc95cc10640 1 -- 172.21.15.86:0/4153414205 >> v2:172.21.15.134:3300/0 conn(0x7fc9580c8910 msgr2=0x7fc95806ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:24.295 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.287+0000 7fc95cc10640 1 --2- 172.21.15.86:0/4153414205 >> v2:172.21.15.134:3300/0 conn(0x7fc9580c8910 0x7fc95806ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:24.295 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.287+0000 7fc95cc10640 1 -- 172.21.15.86:0/4153414205 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9580c85a0 con 0x7fc9580741e0 2024-04-25T12:21:24.296 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.287+0000 7fc95cc10640 1 -- 172.21.15.86:0/4153414205 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1387950573 0 0) 0x7fc94c001680 con 0x7fc9580741e0 2024-04-25T12:21:24.296 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.287+0000 7fc95cc10640 1 -- 172.21.15.86:0/4153414205 >> v1:172.21.15.86:6789/0 conn(0x7fc9580741e0 legacy=0x7fc958159110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:24.296 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.287+0000 7fc95cc10640 1 --2- 172.21.15.86:0/4153414205 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9400039c0 0x7fc940003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:24.296 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.287+0000 7fc95cc10640 1 --2- 172.21.15.86:0/4153414205 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc940004810 0x7fc940004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:24.296 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.287+0000 7fc95cc10640 1 --2- 172.21.15.86:0/4153414205 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc958073e00 0x7fc9400051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:24.296 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.287+0000 7fc95cc10640 1 -- 172.21.15.86:0/4153414205 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc9580c7fe0 con 0x7fc9400039c0 2024-04-25T12:21:24.296 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.287+0000 7fc95cc10640 1 -- 172.21.15.86:0/4153414205 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc9580c82c0 con 0x7fc940004810 2024-04-25T12:21:24.296 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.287+0000 7fc95cc10640 1 -- 172.21.15.86:0/4153414205 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fc94000ba90 con 0x7fc958073e00 2024-04-25T12:21:24.296 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.287+0000 7fc95e413640 1 --2- 172.21.15.86:0/4153414205 >> v2:172.21.15.134:3300/0 conn(0x7fc9580c8910 0x7fc95806ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:21:24.296 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.287+0000 7fc95dc12640 1 --2- 172.21.15.86:0/4153414205 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9400039c0 0x7fc940003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:24.296 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.287+0000 7fc95d411640 1 --2- 172.21.15.86:0/4153414205 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc940004810 0x7fc940004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:24.296 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.287+0000 7fc95dc12640 1 -- 172.21.15.86:0/4153414205 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc958073e00 msgr2=0x7fc9400051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:24.296 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.287+0000 7fc95dc12640 1 --2- 172.21.15.86:0/4153414205 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc958073e00 0x7fc9400051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:24.297 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.287+0000 7fc95dc12640 1 -- 172.21.15.86:0/4153414205 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc940004810 msgr2=0x7fc940004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:24.297 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.287+0000 7fc95dc12640 1 --2- 172.21.15.86:0/4153414205 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc940004810 0x7fc940004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:24.297 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.287+0000 7fc95dc12640 1 -- 172.21.15.86:0/4153414205 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc940003530 con 0x7fc9400039c0 2024-04-25T12:21:24.297 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.287+0000 7fc95d411640 1 --2- 172.21.15.86:0/4153414205 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc940004810 0x7fc940004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:21:24.300 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.291+0000 7fc95dc12640 1 --2- 172.21.15.86:0/4153414205 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9400039c0 0x7fc940003de0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc950009ae0 tx=0x7fc95001cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fa2dbddbb96ecbf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:24.300 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.291+0000 7fc95cc10640 1 -- 172.21.15.86:0/4153414205 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9500b2070 con 0x7fc9400039c0 2024-04-25T12:21:24.300 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.291+0000 7fc95cc10640 1 -- 172.21.15.86:0/4153414205 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9500a55c0 con 0x7fc9400039c0 2024-04-25T12:21:24.300 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.291+0000 7fc95cc10640 1 -- 172.21.15.86:0/4153414205 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9500096b0 con 0x7fc9400039c0 2024-04-25T12:21:24.300 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.291+0000 7fc95fe76640 1 -- 172.21.15.86:0/4153414205 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9400039c0 msgr2=0x7fc940003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:24.300 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.291+0000 7fc95fe76640 1 --2- 172.21.15.86:0/4153414205 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9400039c0 0x7fc940003de0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc950009ae0 tx=0x7fc95001cab0 comp rx=0 tx=0).stop 2024-04-25T12:21:24.300 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.291+0000 7fc95e413640 1 -- 172.21.15.86:0/4153414205 reap_dead start 2024-04-25T12:21:24.300 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.291+0000 7fc95fe76640 1 -- 172.21.15.86:0/4153414205 shutdown_connections 2024-04-25T12:21:24.300 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.291+0000 7fc95fe76640 1 -- 172.21.15.86:0/4153414205 >> 172.21.15.86:0/4153414205 conn(0x7fc95806f430 msgr2=0x7fc95806f840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:24.300 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.291+0000 7fc95fe76640 1 -- 172.21.15.86:0/4153414205 shutdown_connections 2024-04-25T12:21:24.300 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.291+0000 7fc95fe76640 1 -- 172.21.15.86:0/4153414205 wait complete. 2024-04-25T12:21:24.300 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.291+0000 7fc95fe76640 1 Processor -- start 2024-04-25T12:21:24.301 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.291+0000 7fc95fe76640 1 -- start start 2024-04-25T12:21:24.301 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.295+0000 7fc95fe76640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9400039c0 0x7fc958158b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:24.301 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.295+0000 7fc95fe76640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc958157960 0x7fc9581512f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:24.301 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.295+0000 7fc95fe76640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9581f27e0 0x7fc9581f2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:24.301 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.295+0000 7fc95fe76640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc958159820 con 0x7fc9400039c0 2024-04-25T12:21:24.301 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.295+0000 7fc95fe76640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc9580c9400 con 0x7fc958157960 2024-04-25T12:21:24.301 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.295+0000 7fc95fe76640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fc9581599a0 con 0x7fc9581f27e0 2024-04-25T12:21:24.301 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.295+0000 7fc95dc12640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9400039c0 0x7fc958158b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:24.301 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.295+0000 7fc95dc12640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9400039c0 0x7fc958158b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55146/0 (socket says 172.21.15.86:55146) 2024-04-25T12:21:24.301 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.295+0000 7fc95dc12640 1 -- 172.21.15.86:0/1145919210 learned_addr learned my addr 172.21.15.86:0/1145919210 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:24.301 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.295+0000 7fc95e413640 1 --2- 172.21.15.86:0/1145919210 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9581f27e0 0x7fc9581f2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:24.301 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.295+0000 7fc95dc12640 1 -- 172.21.15.86:0/1145919210 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9581f27e0 msgr2=0x7fc9581f2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:24.301 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.295+0000 7fc95d411640 1 --2- 172.21.15.86:0/1145919210 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc958157960 0x7fc9581512f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:24.301 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.295+0000 7fc95dc12640 1 --2- 172.21.15.86:0/1145919210 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9581f27e0 0x7fc9581f2c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:24.302 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.295+0000 7fc95dc12640 1 -- 172.21.15.86:0/1145919210 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc958157960 msgr2=0x7fc9581512f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:24.302 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.295+0000 7fc95dc12640 1 --2- 172.21.15.86:0/1145919210 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc958157960 0x7fc9581512f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:24.302 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.295+0000 7fc95dc12640 1 -- 172.21.15.86:0/1145919210 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc95815d460 con 0x7fc9400039c0 2024-04-25T12:21:24.302 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.295+0000 7fc95dc12640 1 --2- 172.21.15.86:0/1145919210 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9400039c0 0x7fc958158b10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc95001c8e0 tx=0x7fc940005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:24.302 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.295+0000 7fc9567fc640 1 -- 172.21.15.86:0/1145919210 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9500bd020 con 0x7fc9400039c0 2024-04-25T12:21:24.302 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.295+0000 7fc9567fc640 1 -- 172.21.15.86:0/1145919210 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9500a5d10 con 0x7fc9400039c0 2024-04-25T12:21:24.302 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.295+0000 7fc95fe76640 1 -- 172.21.15.86:0/1145919210 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc958159420 con 0x7fc9400039c0 2024-04-25T12:21:24.302 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.295+0000 7fc9567fc640 1 -- 172.21.15.86:0/1145919210 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9500b2040 con 0x7fc9400039c0 2024-04-25T12:21:24.302 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.295+0000 7fc95fe76640 1 -- 172.21.15.86:0/1145919210 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9581528b0 con 0x7fc9400039c0 2024-04-25T12:21:24.303 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.295+0000 7fc95fe76640 1 -- 172.21.15.86:0/1145919210 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc958075e60 con 0x7fc9400039c0 2024-04-25T12:21:24.303 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.295+0000 7fc9567fc640 1 -- 172.21.15.86:0/1145919210 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc9500c0070 con 0x7fc9400039c0 2024-04-25T12:21:24.303 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.295+0000 7fc9567fc640 1 --2- 172.21.15.86:0/1145919210 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fc9440683b0 0x7fc94406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:24.303 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.295+0000 7fc95d411640 1 --2- 172.21.15.86:0/1145919210 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fc9440683b0 0x7fc94406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:24.303 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.295+0000 7fc9567fc640 1 -- 172.21.15.86:0/1145919210 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7fc950120250 con 0x7fc9400039c0 2024-04-25T12:21:24.303 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.295+0000 7fc95d411640 1 --2- 172.21.15.86:0/1145919210 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fc9440683b0 0x7fc94406a870 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc94c004880 tx=0x7fc94c000bd0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:24.306 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.299+0000 7fc9567fc640 1 -- 172.21.15.86:0/1145919210 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc9500167c0 con 0x7fc9400039c0 2024-04-25T12:21:24.476 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:24.471+0000 7fc95fe76640 1 -- 172.21.15.86:0/1145919210 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7fc9580c5300 con 0x7fc9400039c0 2024-04-25T12:21:25.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.083+0000 7fc9567fc640 1 -- 172.21.15.86:0/1145919210 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) ==== 157+0+0 (secure 0 0 0) 0x7fc9500f0780 con 0x7fc9400039c0 2024-04-25T12:21:25.092 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.087+0000 7fc95fe76640 1 -- 172.21.15.86:0/1145919210 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fc9440683b0 msgr2=0x7fc94406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:25.092 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.087+0000 7fc95fe76640 1 --2- 172.21.15.86:0/1145919210 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fc9440683b0 0x7fc94406a870 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc94c004880 tx=0x7fc94c000bd0 comp rx=0 tx=0).stop 2024-04-25T12:21:25.093 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.087+0000 7fc95fe76640 1 -- 172.21.15.86:0/1145919210 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9400039c0 msgr2=0x7fc958158b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:25.093 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.087+0000 7fc95fe76640 1 --2- 172.21.15.86:0/1145919210 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9400039c0 0x7fc958158b10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc95001c8e0 tx=0x7fc940005840 comp rx=0 tx=0).stop 2024-04-25T12:21:25.093 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.087+0000 7fc95fe76640 1 -- 172.21.15.86:0/1145919210 shutdown_connections 2024-04-25T12:21:25.093 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.087+0000 7fc95fe76640 1 --2- 172.21.15.86:0/1145919210 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9581f27e0 0x7fc9581f2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:25.093 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.087+0000 7fc95fe76640 1 --2- 172.21.15.86:0/1145919210 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc958157960 0x7fc9581512f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:25.093 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.087+0000 7fc95fe76640 1 --2- 172.21.15.86:0/1145919210 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fc9440683b0 0x7fc94406a870 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:25.093 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.087+0000 7fc95fe76640 1 --2- 172.21.15.86:0/1145919210 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9400039c0 0x7fc958158b10 secure :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc95001c8e0 tx=0x7fc940005840 comp rx=0 tx=0).stop 2024-04-25T12:21:25.093 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.087+0000 7fc95fe76640 1 -- 172.21.15.86:0/1145919210 >> 172.21.15.86:0/1145919210 conn(0x7fc95806f430 msgr2=0x7fc958154940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:25.094 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.087+0000 7fc95fe76640 1 -- 172.21.15.86:0/1145919210 shutdown_connections 2024-04-25T12:21:25.094 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.087+0000 7fc95fe76640 1 -- 172.21.15.86:0/1145919210 wait complete. 2024-04-25T12:21:25.112 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T12:21:25.245 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.239+0000 7feb2529b640 1 Processor -- start 2024-04-25T12:21:25.246 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.239+0000 7feb2529b640 1 -- start start 2024-04-25T12:21:25.247 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.243+0000 7feb2529b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7feb200c5ec0 0x7feb200c6e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:25.247 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.243+0000 7feb2529b640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7feb200c62a0 0x7feb200ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:25.247 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.243+0000 7feb2529b640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb200c8e70 con 0x7feb200cd110 2024-04-25T12:21:25.247 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.243+0000 7feb2529b640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7feb2015c5b0 con 0x7feb200c62a0 2024-04-25T12:21:25.248 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.243+0000 7feb2529b640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7feb200c2d00 con 0x7feb200c5ec0 2024-04-25T12:21:25.248 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.243+0000 7feb1e7fc640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7feb200c62a0 0x7feb200ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:25.248 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.243+0000 7feb1e7fc640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7feb200c62a0 0x7feb200ccbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55150/0 (socket says 172.21.15.86:55150) 2024-04-25T12:21:25.248 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.243+0000 7feb1e7fc640 1 -- 172.21.15.86:0/4128731891 learned_addr learned my addr 172.21.15.86:0/4128731891 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:25.248 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.243+0000 7feb1effd640 1 --2- 172.21.15.86:0/4128731891 >> v2:172.21.15.134:3300/0 conn(0x7feb200c5ec0 0x7feb200c6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:25.248 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.243+0000 7feb1e7fc640 1 -- 172.21.15.86:0/4128731891 >> v2:172.21.15.134:3300/0 conn(0x7feb200c5ec0 msgr2=0x7feb200c6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:25.248 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.243+0000 7feb1e7fc640 1 --2- 172.21.15.86:0/4128731891 >> v2:172.21.15.134:3300/0 conn(0x7feb200c5ec0 0x7feb200c6e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:25.248 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.243+0000 7feb1e7fc640 1 -- 172.21.15.86:0/4128731891 >> v1:172.21.15.134:6789/0 conn(0x7feb200cd110 legacy=0x7feb20152d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:25.248 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.243+0000 7feb1e7fc640 1 -- 172.21.15.86:0/4128731891 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb200c2fe0 con 0x7feb200c62a0 2024-04-25T12:21:25.249 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.243+0000 7feb1e7fc640 1 --2- 172.21.15.86:0/4128731891 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb200c62a0 0x7feb200ccbd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7feb2006fc70 tx=0x7feb0801c300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=771de546baf95df4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:25.249 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.243+0000 7feb1dffb640 1 -- 172.21.15.86:0/4128731891 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb080b0070 con 0x7feb200c62a0 2024-04-25T12:21:25.249 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.243+0000 7feb1dffb640 1 -- 172.21.15.86:0/4128731891 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb080ab600 con 0x7feb200c62a0 2024-04-25T12:21:25.249 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.243+0000 7feb1dffb640 1 -- 172.21.15.86:0/4128731891 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb080ab9d0 con 0x7feb200c62a0 2024-04-25T12:21:25.250 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.243+0000 7feb2529b640 1 -- 172.21.15.86:0/4128731891 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb200c62a0 msgr2=0x7feb200ccbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:25.250 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.243+0000 7feb2529b640 1 --2- 172.21.15.86:0/4128731891 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb200c62a0 0x7feb200ccbd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7feb2006fc70 tx=0x7feb0801c300 comp rx=0 tx=0).stop 2024-04-25T12:21:25.251 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.243+0000 7feb2529b640 1 -- 172.21.15.86:0/4128731891 shutdown_connections 2024-04-25T12:21:25.251 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.243+0000 7feb2529b640 1 --2- 172.21.15.86:0/4128731891 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb200c62a0 0x7feb200ccbd0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:25.251 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.243+0000 7feb2529b640 1 --2- 172.21.15.86:0/4128731891 >> v2:172.21.15.134:3300/0 conn(0x7feb200c5ec0 0x7feb200c6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:25.251 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.243+0000 7feb2529b640 1 -- 172.21.15.86:0/4128731891 >> 172.21.15.86:0/4128731891 conn(0x7feb2006ec90 msgr2=0x7feb2006f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:25.251 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.243+0000 7feb2529b640 1 -- 172.21.15.86:0/4128731891 shutdown_connections 2024-04-25T12:21:25.251 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.243+0000 7feb2529b640 1 -- 172.21.15.86:0/4128731891 wait complete. 2024-04-25T12:21:25.253 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.247+0000 7feb2529b640 1 Processor -- start 2024-04-25T12:21:25.254 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.247+0000 7feb2529b640 1 -- start start 2024-04-25T12:21:25.254 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.247+0000 7feb2529b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb200c5ec0 0x7feb20144e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:25.254 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.247+0000 7feb2529b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb200c62a0 0x7feb2014da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:25.254 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.247+0000 7feb2529b640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feb200cd110 0x7feb201469f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:25.254 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.247+0000 7feb2529b640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7feb200c7510 con 0x7feb200c62a0 2024-04-25T12:21:25.254 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.247+0000 7feb2529b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7feb200c7390 con 0x7feb200c5ec0 2024-04-25T12:21:25.254 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.247+0000 7feb2529b640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7feb20166160 con 0x7feb200cd110 2024-04-25T12:21:25.254 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.247+0000 7feb1e7fc640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb200c62a0 0x7feb2014da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:25.254 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.247+0000 7feb1e7fc640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb200c62a0 0x7feb2014da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55164/0 (socket says 172.21.15.86:55164) 2024-04-25T12:21:25.254 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.247+0000 7feb1e7fc640 1 -- 172.21.15.86:0/1430822515 learned_addr learned my addr 172.21.15.86:0/1430822515 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:25.254 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.247+0000 7feb1effd640 1 --2- 172.21.15.86:0/1430822515 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb200c5ec0 0x7feb20144e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:25.254 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.247+0000 7feb1e7fc640 1 -- 172.21.15.86:0/1430822515 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feb200cd110 msgr2=0x7feb201469f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:25.255 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.247+0000 7feb1f7fe640 1 --2- 172.21.15.86:0/1430822515 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feb200cd110 0x7feb201469f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:25.255 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.247+0000 7feb1e7fc640 1 --2- 172.21.15.86:0/1430822515 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feb200cd110 0x7feb201469f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:25.255 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.247+0000 7feb1e7fc640 1 -- 172.21.15.86:0/1430822515 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb200c5ec0 msgr2=0x7feb20144e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:25.255 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.247+0000 7feb1e7fc640 1 --2- 172.21.15.86:0/1430822515 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb200c5ec0 0x7feb20144e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:25.255 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.247+0000 7feb1e7fc640 1 -- 172.21.15.86:0/1430822515 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb2014d7b0 con 0x7feb200c62a0 2024-04-25T12:21:25.255 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.247+0000 7feb1e7fc640 1 --2- 172.21.15.86:0/1430822515 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb200c62a0 0x7feb2014da80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7feb0801a9b0 tx=0x7feb080190a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:25.255 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.247+0000 7feb177fe640 1 -- 172.21.15.86:0/1430822515 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb080b0040 con 0x7feb200c62a0 2024-04-25T12:21:25.255 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.247+0000 7feb177fe640 1 -- 172.21.15.86:0/1430822515 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb080b4640 con 0x7feb200c62a0 2024-04-25T12:21:25.255 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.247+0000 7feb2529b640 1 -- 172.21.15.86:0/1430822515 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb2014cd00 con 0x7feb200c62a0 2024-04-25T12:21:25.255 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.247+0000 7feb177fe640 1 -- 172.21.15.86:0/1430822515 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb080b4a30 con 0x7feb200c62a0 2024-04-25T12:21:25.255 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.247+0000 7feb2529b640 1 -- 172.21.15.86:0/1430822515 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb2014c210 con 0x7feb200c62a0 2024-04-25T12:21:25.255 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.247+0000 7feb2529b640 1 -- 172.21.15.86:0/1430822515 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb20075df0 con 0x7feb200c62a0 2024-04-25T12:21:25.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.251+0000 7feb177fe640 1 -- 172.21.15.86:0/1430822515 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7feb080ab4c0 con 0x7feb200c62a0 2024-04-25T12:21:25.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.251+0000 7feb177fe640 1 --2- 172.21.15.86:0/1430822515 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7feb00068380 0x7feb0006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:25.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.251+0000 7feb1effd640 1 --2- 172.21.15.86:0/1430822515 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7feb00068380 0x7feb0006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:25.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.251+0000 7feb177fe640 1 -- 172.21.15.86:0/1430822515 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 6007+0+0 (secure 0 0 0) 0x7feb08120800 con 0x7feb200c62a0 2024-04-25T12:21:25.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.251+0000 7feb1effd640 1 --2- 172.21.15.86:0/1430822515 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7feb00068380 0x7feb0006a840 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7feb100070b0 tx=0x7feb10007040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:25.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.255+0000 7feb177fe640 1 -- 172.21.15.86:0/1430822515 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7feb200c8e70 con 0x7feb200c62a0 2024-04-25T12:21:25.425 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:25.419+0000 7feb2529b640 1 -- 172.21.15.86:0/1430822515 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7feb2006bb00 con 0x7feb200c62a0 2024-04-25T12:21:27.147 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.143+0000 7feb177fe640 1 -- 172.21.15.86:0/1430822515 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) ==== 228+0+0 (secure 0 0 0) 0x7feb080f0d20 con 0x7feb200c62a0 2024-04-25T12:21:27.147 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_data_ec' created 2024-04-25T12:21:27.151 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.147+0000 7feb2529b640 1 -- 172.21.15.86:0/1430822515 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7feb00068380 msgr2=0x7feb0006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:27.151 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.147+0000 7feb2529b640 1 --2- 172.21.15.86:0/1430822515 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7feb00068380 0x7feb0006a840 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7feb100070b0 tx=0x7feb10007040 comp rx=0 tx=0).stop 2024-04-25T12:21:27.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.147+0000 7feb2529b640 1 -- 172.21.15.86:0/1430822515 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb200c62a0 msgr2=0x7feb2014da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:27.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.147+0000 7feb2529b640 1 --2- 172.21.15.86:0/1430822515 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb200c62a0 0x7feb2014da80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7feb0801a9b0 tx=0x7feb080190a0 comp rx=0 tx=0).stop 2024-04-25T12:21:27.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.147+0000 7feb2529b640 1 -- 172.21.15.86:0/1430822515 shutdown_connections 2024-04-25T12:21:27.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.147+0000 7feb2529b640 1 --2- 172.21.15.86:0/1430822515 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feb200cd110 0x7feb201469f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:27.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.147+0000 7feb2529b640 1 --2- 172.21.15.86:0/1430822515 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7feb00068380 0x7feb0006a840 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:27.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.147+0000 7feb2529b640 1 --2- 172.21.15.86:0/1430822515 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb200c62a0 0x7feb2014da80 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:27.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.147+0000 7feb2529b640 1 --2- 172.21.15.86:0/1430822515 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb200c5ec0 0x7feb20144e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:27.153 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.147+0000 7feb2529b640 1 -- 172.21.15.86:0/1430822515 >> 172.21.15.86:0/1430822515 conn(0x7feb2006ec90 msgr2=0x7feb200cbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:27.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.147+0000 7feb2529b640 1 -- 172.21.15.86:0/1430822515 shutdown_connections 2024-04-25T12:21:27.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.147+0000 7feb2529b640 1 -- 172.21.15.86:0/1430822515 wait complete. 2024-04-25T12:21:27.183 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-04-25T12:21:27.313 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.307+0000 7f263fe56640 1 Processor -- start 2024-04-25T12:21:27.313 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.307+0000 7f263fe56640 1 -- start start 2024-04-25T12:21:27.315 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.307+0000 7f263fe56640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f26380c5fa0 0x7f263815ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:27.315 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.307+0000 7f263fe56640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f26380c6380 0x7f2638163990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:27.315 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.307+0000 7f263fe56640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f263806ce60 con 0x7f263815d340 2024-04-25T12:21:27.315 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.307+0000 7f263fe56640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f26380c8890 con 0x7f26380c5fa0 2024-04-25T12:21:27.315 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.307+0000 7f263fe56640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f263815c970 con 0x7f26380c6380 2024-04-25T12:21:27.315 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.307+0000 7f263dbf2640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f26380c5fa0 0x7f263815ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:27.315 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.307+0000 7f263dbf2640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f26380c5fa0 0x7f263815ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55168/0 (socket says 172.21.15.86:55168) 2024-04-25T12:21:27.315 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.307+0000 7f263dbf2640 1 -- 172.21.15.86:0/3420715553 learned_addr learned my addr 172.21.15.86:0/3420715553 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:27.315 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.307+0000 7f263d3f1640 1 --1- 172.21.15.86:0/3420715553 >> v1:172.21.15.86:6789/0 conn(0x7f263815d340 0x7f2638152cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:58884/0 (socket says 172.21.15.86:58884) 2024-04-25T12:21:27.316 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.311+0000 7f263e3f3640 1 --2- 172.21.15.86:0/3420715553 >> v2:172.21.15.134:3300/0 conn(0x7f26380c6380 0x7f2638163990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:27.316 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.311+0000 7f263dbf2640 1 -- 172.21.15.86:0/3420715553 >> v2:172.21.15.134:3300/0 conn(0x7f26380c6380 msgr2=0x7f2638163990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:27.316 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.311+0000 7f263dbf2640 1 --2- 172.21.15.86:0/3420715553 >> v2:172.21.15.134:3300/0 conn(0x7f26380c6380 0x7f2638163990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:27.316 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.311+0000 7f263dbf2640 1 -- 172.21.15.86:0/3420715553 >> v1:172.21.15.86:6789/0 conn(0x7f263815d340 legacy=0x7f2638152cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:27.316 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.311+0000 7f263cbf0640 1 -- 172.21.15.86:0/3420715553 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2127511197 0 0) 0x7f263806ce60 con 0x7f263815d340 2024-04-25T12:21:27.316 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.311+0000 7f263dbf2640 1 -- 172.21.15.86:0/3420715553 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26380c8ae0 con 0x7f26380c5fa0 2024-04-25T12:21:27.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.311+0000 7f263dbf2640 1 --2- 172.21.15.86:0/3420715553 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26380c5fa0 0x7f263815ce00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2638156c00 tx=0x7f263401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10b87d303d645453 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:27.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.311+0000 7f263cbf0640 1 -- 172.21.15.86:0/3420715553 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26340b1070 con 0x7f26380c5fa0 2024-04-25T12:21:27.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.311+0000 7f263cbf0640 1 -- 172.21.15.86:0/3420715553 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26340ac630 con 0x7f26380c5fa0 2024-04-25T12:21:27.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.311+0000 7f263cbf0640 1 -- 172.21.15.86:0/3420715553 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26340a8050 con 0x7f26380c5fa0 2024-04-25T12:21:27.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.311+0000 7f263fe56640 1 -- 172.21.15.86:0/3420715553 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26380c5fa0 msgr2=0x7f263815ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:27.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.311+0000 7f263fe56640 1 --2- 172.21.15.86:0/3420715553 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26380c5fa0 0x7f263815ce00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2638156c00 tx=0x7f263401c3d0 comp rx=0 tx=0).stop 2024-04-25T12:21:27.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.311+0000 7f263fe56640 1 -- 172.21.15.86:0/3420715553 shutdown_connections 2024-04-25T12:21:27.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.311+0000 7f263fe56640 1 --2- 172.21.15.86:0/3420715553 >> v2:172.21.15.134:3300/0 conn(0x7f26380c6380 0x7f2638163990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:27.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.311+0000 7f263fe56640 1 --2- 172.21.15.86:0/3420715553 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26380c5fa0 0x7f263815ce00 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:27.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.311+0000 7f263fe56640 1 -- 172.21.15.86:0/3420715553 >> 172.21.15.86:0/3420715553 conn(0x7f26380c9130 msgr2=0x7f26380c9540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:27.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.311+0000 7f263fe56640 1 -- 172.21.15.86:0/3420715553 shutdown_connections 2024-04-25T12:21:27.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.311+0000 7f263fe56640 1 -- 172.21.15.86:0/3420715553 wait complete. 2024-04-25T12:21:27.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.315+0000 7f263fe56640 1 Processor -- start 2024-04-25T12:21:27.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.315+0000 7f263fe56640 1 -- start start 2024-04-25T12:21:27.321 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.315+0000 7f263fe56640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f26380c5fa0 0x7f26381f5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:27.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.315+0000 7f263fe56640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26380c6380 0x7f263815aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:27.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.315+0000 7f263fe56640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f263815d340 0x7f263814a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:27.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.315+0000 7f263fe56640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f263806cc10 con 0x7f263815d340 2024-04-25T12:21:27.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.315+0000 7f263fe56640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f263806ca90 con 0x7f26380c6380 2024-04-25T12:21:27.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.315+0000 7f263fe56640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f26380c6fa0 con 0x7f26380c5fa0 2024-04-25T12:21:27.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.315+0000 7f263e3f3640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f263815d340 0x7f263814a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:27.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.315+0000 7f263e3f3640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f263815d340 0x7f263814a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55180/0 (socket says 172.21.15.86:55180) 2024-04-25T12:21:27.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.315+0000 7f263e3f3640 1 -- 172.21.15.86:0/610338722 learned_addr learned my addr 172.21.15.86:0/610338722 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:27.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.315+0000 7f263dbf2640 1 --2- 172.21.15.86:0/610338722 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f26380c5fa0 0x7f26381f5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:27.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.315+0000 7f263e3f3640 1 -- 172.21.15.86:0/610338722 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f26380c5fa0 msgr2=0x7f26381f5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:27.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.315+0000 7f263d3f1640 1 --2- 172.21.15.86:0/610338722 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26380c6380 0x7f263815aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:27.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.315+0000 7f263e3f3640 1 --2- 172.21.15.86:0/610338722 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f26380c5fa0 0x7f26381f5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:27.323 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.315+0000 7f263e3f3640 1 -- 172.21.15.86:0/610338722 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26380c6380 msgr2=0x7f263815aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:27.323 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.315+0000 7f263e3f3640 1 --2- 172.21.15.86:0/610338722 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26380c6380 0x7f263815aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:27.323 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.315+0000 7f263e3f3640 1 -- 172.21.15.86:0/610338722 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f263814bee0 con 0x7f263815d340 2024-04-25T12:21:27.323 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.315+0000 7f263dbf2640 1 --2- 172.21.15.86:0/610338722 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f26380c5fa0 0x7f26381f5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:21:27.323 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.315+0000 7f263e3f3640 1 --2- 172.21.15.86:0/610338722 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f263815d340 0x7f263814a240 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2630007e40 tx=0x7f263000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:27.323 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.315+0000 7f262e7fc640 1 -- 172.21.15.86:0/610338722 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2630014620 con 0x7f263815d340 2024-04-25T12:21:27.323 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.315+0000 7f262e7fc640 1 -- 172.21.15.86:0/610338722 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2630019070 con 0x7f263815d340 2024-04-25T12:21:27.323 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.315+0000 7f262e7fc640 1 -- 172.21.15.86:0/610338722 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2630014a20 con 0x7f263815d340 2024-04-25T12:21:27.323 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.315+0000 7f263fe56640 1 -- 172.21.15.86:0/610338722 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f263814b640 con 0x7f263815d340 2024-04-25T12:21:27.323 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.315+0000 7f263fe56640 1 -- 172.21.15.86:0/610338722 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f263814bc00 con 0x7f263815d340 2024-04-25T12:21:27.324 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.315+0000 7f263fe56640 1 -- 172.21.15.86:0/610338722 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2638075e40 con 0x7f263815d340 2024-04-25T12:21:27.324 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.319+0000 7f262e7fc640 1 -- 172.21.15.86:0/610338722 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2630014bc0 con 0x7f263815d340 2024-04-25T12:21:27.324 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.319+0000 7f262e7fc640 1 --2- 172.21.15.86:0/610338722 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f261c068380 0x7f261c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:27.324 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.319+0000 7f262e7fc640 1 -- 172.21.15.86:0/610338722 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 6500+0+0 (secure 0 0 0) 0x7f2630087620 con 0x7f263815d340 2024-04-25T12:21:27.324 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.319+0000 7f263dbf2640 1 --2- 172.21.15.86:0/610338722 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f261c068380 0x7f261c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:27.324 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.319+0000 7f263dbf2640 1 --2- 172.21.15.86:0/610338722 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f261c068380 0x7f261c06a840 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f26340ae000 tx=0x7f2634008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:27.328 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.323+0000 7f262e7fc640 1 -- 172.21.15.86:0/610338722 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2630057830 con 0x7f263815d340 2024-04-25T12:21:27.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:27.483+0000 7f263fe56640 1 -- 172.21.15.86:0/610338722 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f26381595a0 con 0x7f263815d340 2024-04-25T12:21:28.158 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.151+0000 7f262e7fc640 1 -- 172.21.15.86:0/610338722 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) ==== 169+0+0 (secure 0 0 0) 0x7f2630057130 con 0x7f263815d340 2024-04-25T12:21:28.158 INFO:teuthology.orchestra.run.smithi086.stderr:set pool 4 allow_ec_overwrites to true 2024-04-25T12:21:28.163 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.155+0000 7f263fe56640 1 -- 172.21.15.86:0/610338722 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f261c068380 msgr2=0x7f261c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:28.163 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.155+0000 7f263fe56640 1 --2- 172.21.15.86:0/610338722 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f261c068380 0x7f261c06a840 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f26340ae000 tx=0x7f2634008040 comp rx=0 tx=0).stop 2024-04-25T12:21:28.163 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.155+0000 7f263fe56640 1 -- 172.21.15.86:0/610338722 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f263815d340 msgr2=0x7f263814a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:28.163 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.155+0000 7f263fe56640 1 --2- 172.21.15.86:0/610338722 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f263815d340 0x7f263814a240 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2630007e40 tx=0x7f263000e4b0 comp rx=0 tx=0).stop 2024-04-25T12:21:28.163 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.155+0000 7f263fe56640 1 -- 172.21.15.86:0/610338722 shutdown_connections 2024-04-25T12:21:28.163 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.155+0000 7f263fe56640 1 --2- 172.21.15.86:0/610338722 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f261c068380 0x7f261c06a840 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:28.163 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.155+0000 7f263fe56640 1 --2- 172.21.15.86:0/610338722 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f263815d340 0x7f263814a240 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:28.163 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.155+0000 7f263fe56640 1 --2- 172.21.15.86:0/610338722 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26380c6380 0x7f263815aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:28.163 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.155+0000 7f263fe56640 1 --2- 172.21.15.86:0/610338722 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f26380c5fa0 0x7f26381f5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:28.163 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.155+0000 7f263fe56640 1 -- 172.21.15.86:0/610338722 >> 172.21.15.86:0/610338722 conn(0x7f26380c9130 msgr2=0x7f263815a3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:28.163 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.155+0000 7f263fe56640 1 -- 172.21.15.86:0/610338722 shutdown_connections 2024-04-25T12:21:28.163 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.159+0000 7f263fe56640 1 -- 172.21.15.86:0/610338722 wait complete. 2024-04-25T12:21:28.197 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-04-25T12:21:28.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.311+0000 7fdfc02ff640 1 Processor -- start 2024-04-25T12:21:28.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.311+0000 7fdfc02ff640 1 -- start start 2024-04-25T12:21:28.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.311+0000 7fdfc02ff640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fdfb80c9c10 0x7fdfb80c91c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:28.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.311+0000 7fdfc02ff640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfb80c9700 0x7fdfb8152c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:28.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.311+0000 7fdfc02ff640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfb80ca960 con 0x7fdfb80c5f20 2024-04-25T12:21:28.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.311+0000 7fdfc02ff640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7fdfb80c7f30 con 0x7fdfb80c9c10 2024-04-25T12:21:28.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.311+0000 7fdfc02ff640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fdfb80ca0c0 con 0x7fdfb80c9700 2024-04-25T12:21:28.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.311+0000 7fdfbd89a640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fdfb80c9c10 0x7fdfb80c91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:28.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.315+0000 7fdfbd89a640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fdfb80c9c10 0x7fdfb80c91c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55182/0 (socket says 172.21.15.86:55182) 2024-04-25T12:21:28.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.315+0000 7fdfbd89a640 1 -- 172.21.15.86:0/584697903 learned_addr learned my addr 172.21.15.86:0/584697903 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:28.320 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.315+0000 7fdfbe09b640 1 --1- 172.21.15.86:0/584697903 >> v1:172.21.15.86:6789/0 conn(0x7fdfb80c5f20 0x7fdfb80c86f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:58898/0 (socket says 172.21.15.86:58898) 2024-04-25T12:21:28.320 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.315+0000 7fdfbe89c640 1 --2- 172.21.15.86:0/584697903 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfb80c9700 0x7fdfb8152c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:28.320 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.315+0000 7fdfbd89a640 1 -- 172.21.15.86:0/584697903 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfb80c9700 msgr2=0x7fdfb8152c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:28.320 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.315+0000 7fdfbd89a640 1 --2- 172.21.15.86:0/584697903 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfb80c9700 0x7fdfb8152c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:28.320 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.315+0000 7fdfbd89a640 1 -- 172.21.15.86:0/584697903 >> v1:172.21.15.86:6789/0 conn(0x7fdfb80c5f20 legacy=0x7fdfb80c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:28.320 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.315+0000 7fdfbd89a640 1 -- 172.21.15.86:0/584697903 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfb80ca3a0 con 0x7fdfb80c9c10 2024-04-25T12:21:28.320 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.315+0000 7fdfbd099640 1 -- 172.21.15.86:0/584697903 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1346026123 0 0) 0x7fdfb80ca960 con 0x7fdfb80c5f20 2024-04-25T12:21:28.320 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.315+0000 7fdfbe89c640 1 --2- 172.21.15.86:0/584697903 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfb80c9700 0x7fdfb8152c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:21:28.321 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.315+0000 7fdfbd89a640 1 --2- 172.21.15.86:0/584697903 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdfb80c9c10 0x7fdfb80c91c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8009870 tx=0x7fdfa801ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b54bd86237cb532 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:28.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.315+0000 7fdfbd099640 1 -- 172.21.15.86:0/584697903 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa80b5070 con 0x7fdfb80c9c10 2024-04-25T12:21:28.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.315+0000 7fdfbd099640 1 -- 172.21.15.86:0/584697903 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfa80a8a50 con 0x7fdfb80c9c10 2024-04-25T12:21:28.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.315+0000 7fdfbd099640 1 -- 172.21.15.86:0/584697903 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa80a8e20 con 0x7fdfb80c9c10 2024-04-25T12:21:28.323 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.315+0000 7fdfc02ff640 1 -- 172.21.15.86:0/584697903 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdfb80c9c10 msgr2=0x7fdfb80c91c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:28.323 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.315+0000 7fdfc02ff640 1 --2- 172.21.15.86:0/584697903 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdfb80c9c10 0x7fdfb80c91c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8009870 tx=0x7fdfa801ed50 comp rx=0 tx=0).stop 2024-04-25T12:21:28.323 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.315+0000 7fdfc02ff640 1 -- 172.21.15.86:0/584697903 shutdown_connections 2024-04-25T12:21:28.323 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.315+0000 7fdfc02ff640 1 --2- 172.21.15.86:0/584697903 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfb80c9700 0x7fdfb8152c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:28.323 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.315+0000 7fdfc02ff640 1 --2- 172.21.15.86:0/584697903 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdfb80c9c10 0x7fdfb80c91c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:28.323 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.315+0000 7fdfc02ff640 1 -- 172.21.15.86:0/584697903 >> 172.21.15.86:0/584697903 conn(0x7fdfb80676a0 msgr2=0x7fdfb8067ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:28.323 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.315+0000 7fdfc02ff640 1 -- 172.21.15.86:0/584697903 shutdown_connections 2024-04-25T12:21:28.323 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.315+0000 7fdfc02ff640 1 -- 172.21.15.86:0/584697903 wait complete. 2024-04-25T12:21:28.324 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.319+0000 7fdfc02ff640 1 Processor -- start 2024-04-25T12:21:28.324 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.319+0000 7fdfc02ff640 1 -- start start 2024-04-25T12:21:28.326 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.319+0000 7fdfc02ff640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfb80c5f20 0x7fdfb8146500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:28.326 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.319+0000 7fdfc02ff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfb80c9700 0x7fdfb81519b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:28.326 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.319+0000 7fdfc02ff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdfb80c9c10 0x7fdfb815a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:28.326 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.319+0000 7fdfc02ff640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fdfb80c5830 con 0x7fdfb80c9c10 2024-04-25T12:21:28.326 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.319+0000 7fdfc02ff640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdfb80c81d0 con 0x7fdfb80c9700 2024-04-25T12:21:28.326 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.319+0000 7fdfc02ff640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fdfb80c59b0 con 0x7fdfb80c5f20 2024-04-25T12:21:28.326 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.319+0000 7fdfbe89c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdfb80c9c10 0x7fdfb815a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:28.326 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.319+0000 7fdfbe89c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdfb80c9c10 0x7fdfb815a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55194/0 (socket says 172.21.15.86:55194) 2024-04-25T12:21:28.326 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.319+0000 7fdfbe89c640 1 -- 172.21.15.86:0/3494965142 learned_addr learned my addr 172.21.15.86:0/3494965142 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:28.327 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.319+0000 7fdfbe09b640 1 --2- 172.21.15.86:0/3494965142 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfb80c5f20 0x7fdfb8146500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:28.327 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.319+0000 7fdfbd89a640 1 --2- 172.21.15.86:0/3494965142 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfb80c9700 0x7fdfb81519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:28.327 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.319+0000 7fdfbe89c640 1 -- 172.21.15.86:0/3494965142 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfb80c5f20 msgr2=0x7fdfb8146500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:28.327 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.319+0000 7fdfbe89c640 1 --2- 172.21.15.86:0/3494965142 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfb80c5f20 0x7fdfb8146500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:28.327 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.319+0000 7fdfbe89c640 1 -- 172.21.15.86:0/3494965142 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfb80c9700 msgr2=0x7fdfb81519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:28.327 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.319+0000 7fdfbe89c640 1 --2- 172.21.15.86:0/3494965142 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfb80c9700 0x7fdfb81519b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:28.327 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.319+0000 7fdfbe89c640 1 -- 172.21.15.86:0/3494965142 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfb8148460 con 0x7fdfb80c9c10 2024-04-25T12:21:28.327 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.319+0000 7fdfbe89c640 1 --2- 172.21.15.86:0/3494965142 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdfb80c9c10 0x7fdfb815a8c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdfb000cf20 tx=0x7fdfb000a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:28.327 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.319+0000 7fdfaeffd640 1 -- 172.21.15.86:0/3494965142 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb001a070 con 0x7fdfb80c9c10 2024-04-25T12:21:28.327 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.319+0000 7fdfaeffd640 1 -- 172.21.15.86:0/3494965142 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfb000d840 con 0x7fdfb80c9c10 2024-04-25T12:21:28.327 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.319+0000 7fdfc02ff640 1 -- 172.21.15.86:0/3494965142 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfb8148740 con 0x7fdfb80c9c10 2024-04-25T12:21:28.327 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.319+0000 7fdfaeffd640 1 -- 172.21.15.86:0/3494965142 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb000dc30 con 0x7fdfb80c9c10 2024-04-25T12:21:28.327 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.319+0000 7fdfc02ff640 1 -- 172.21.15.86:0/3494965142 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfb815a0c0 con 0x7fdfb80c9c10 2024-04-25T12:21:28.327 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.319+0000 7fdfc02ff640 1 -- 172.21.15.86:0/3494965142 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfb8075df0 con 0x7fdfb80c9c10 2024-04-25T12:21:28.328 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.323+0000 7fdfaeffd640 1 -- 172.21.15.86:0/3494965142 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fdfb001d070 con 0x7fdfb80c9c10 2024-04-25T12:21:28.328 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.323+0000 7fdfaeffd640 1 --2- 172.21.15.86:0/3494965142 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fdf9c068380 0x7fdf9c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:28.328 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.323+0000 7fdfbe09b640 1 --2- 172.21.15.86:0/3494965142 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fdf9c068380 0x7fdf9c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:28.328 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.323+0000 7fdfaeffd640 1 -- 172.21.15.86:0/3494965142 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6500+0+0 (secure 0 0 0) 0x7fdfb00874e0 con 0x7fdfb80c9c10 2024-04-25T12:21:28.329 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.323+0000 7fdfbe09b640 1 --2- 172.21.15.86:0/3494965142 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fdf9c068380 0x7fdf9c06a840 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdfb4000f70 tx=0x7fdfb4007b60 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:28.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.327+0000 7fdfaeffd640 1 -- 172.21.15.86:0/3494965142 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fdfb0057780 con 0x7fdfb80c9c10 2024-04-25T12:21:28.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:28.535+0000 7fdfc02ff640 1 -- 172.21.15.86:0/3494965142 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7fdfb80c63a0 con 0x7fdfb80c9c10 2024-04-25T12:21:29.161 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.155+0000 7fdfaeffd640 1 -- 172.21.15.86:0/3494965142 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v5) ==== 137+0+0 (secure 0 0 0) 0x7fdfb0057080 con 0x7fdfb80c9c10 2024-04-25T12:21:29.161 INFO:teuthology.orchestra.run.smithi086.stderr:added data pool 4 to fsmap 2024-04-25T12:21:29.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.159+0000 7fdfc02ff640 1 -- 172.21.15.86:0/3494965142 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fdf9c068380 msgr2=0x7fdf9c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:29.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.159+0000 7fdfc02ff640 1 --2- 172.21.15.86:0/3494965142 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fdf9c068380 0x7fdf9c06a840 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdfb4000f70 tx=0x7fdfb4007b60 comp rx=0 tx=0).stop 2024-04-25T12:21:29.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.159+0000 7fdfc02ff640 1 -- 172.21.15.86:0/3494965142 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdfb80c9c10 msgr2=0x7fdfb815a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:29.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.159+0000 7fdfc02ff640 1 --2- 172.21.15.86:0/3494965142 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdfb80c9c10 0x7fdfb815a8c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdfb000cf20 tx=0x7fdfb000a7d0 comp rx=0 tx=0).stop 2024-04-25T12:21:29.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.159+0000 7fdfc02ff640 1 -- 172.21.15.86:0/3494965142 shutdown_connections 2024-04-25T12:21:29.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.159+0000 7fdfc02ff640 1 --2- 172.21.15.86:0/3494965142 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fdf9c068380 0x7fdf9c06a840 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:29.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.159+0000 7fdfc02ff640 1 --2- 172.21.15.86:0/3494965142 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdfb80c9c10 0x7fdfb815a8c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:29.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.159+0000 7fdfc02ff640 1 --2- 172.21.15.86:0/3494965142 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfb80c9700 0x7fdfb81519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:29.166 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.159+0000 7fdfc02ff640 1 --2- 172.21.15.86:0/3494965142 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfb80c5f20 0x7fdfb8146500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:29.166 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.159+0000 7fdfc02ff640 1 -- 172.21.15.86:0/3494965142 >> 172.21.15.86:0/3494965142 conn(0x7fdfb80676a0 msgr2=0x7fdfb8067a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:29.166 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.159+0000 7fdfc02ff640 1 -- 172.21.15.86:0/3494965142 shutdown_connections 2024-04-25T12:21:29.166 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.159+0000 7fdfc02ff640 1 -- 172.21.15.86:0/3494965142 wait complete. 2024-04-25T12:21:29.185 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T12:21:29.309 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.303+0000 7f35a53b3640 1 Processor -- start 2024-04-25T12:21:29.309 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.303+0000 7f35a53b3640 1 -- start start 2024-04-25T12:21:29.309 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.303+0000 7f35a53b3640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f35a014fbc0 0x7f35a006f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:29.310 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.303+0000 7f35a53b3640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f35a014ffa0 0x7f35a00c8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:29.310 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.303+0000 7f35a53b3640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35a00c5d70 con 0x7f35a0074100 2024-04-25T12:21:29.310 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.303+0000 7f35a53b3640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f35a00c6050 con 0x7f35a014ffa0 2024-04-25T12:21:29.310 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.303+0000 7f35a53b3640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f35a00c6330 con 0x7f35a014fbc0 2024-04-25T12:21:29.310 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.303+0000 7f359f7fe640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f35a0074100 0x7f35a00c7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:58904/0 (socket says 172.21.15.86:58904) 2024-04-25T12:21:29.310 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.303+0000 7f359f7fe640 1 -- 172.21.15.86:0/584918538 learned_addr learned my addr 172.21.15.86:0/584918538 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-04-25T12:21:29.312 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.303+0000 7f359effd640 1 --2- 172.21.15.86:0/584918538 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f35a014fbc0 0x7f35a006f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:29.312 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.303+0000 7f35967fc640 1 --2- 172.21.15.86:0/584918538 >> v2:172.21.15.134:3300/0 conn(0x7f35a014ffa0 0x7f35a00c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:29.312 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.303+0000 7f359e7fc640 1 -- 172.21.15.86:0/584918538 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1613471810 0 0) 0x7f35a00c5d70 con 0x7f35a0074100 2024-04-25T12:21:29.312 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.303+0000 7f359e7fc640 1 -- 172.21.15.86:0/584918538 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f358c003530 con 0x7f35a0074100 2024-04-25T12:21:29.312 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.307+0000 7f359e7fc640 1 -- 172.21.15.86:0/584918538 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2754338298 0 0) 0x7f358c003530 con 0x7f35a0074100 2024-04-25T12:21:29.312 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.307+0000 7f359e7fc640 1 -- 172.21.15.86:0/584918538 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f35a014fbc0 msgr2=0x7f35a006f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:29.313 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.307+0000 7f359e7fc640 1 --2- 172.21.15.86:0/584918538 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f35a014fbc0 0x7f35a006f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:29.313 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.307+0000 7f359e7fc640 1 -- 172.21.15.86:0/584918538 >> v2:172.21.15.134:3300/0 conn(0x7f35a014ffa0 msgr2=0x7f35a00c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:29.313 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.307+0000 7f359e7fc640 1 --2- 172.21.15.86:0/584918538 >> v2:172.21.15.134:3300/0 conn(0x7f35a014ffa0 0x7f35a00c8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:29.313 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.307+0000 7f359e7fc640 1 -- 172.21.15.86:0/584918538 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35a00c6610 con 0x7f35a0074100 2024-04-25T12:21:29.313 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.307+0000 7f359e7fc640 1 -- 172.21.15.86:0/584918538 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1387950573 0 0) 0x7f3598001a00 con 0x7f35a0074100 2024-04-25T12:21:29.313 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.307+0000 7f359e7fc640 1 -- 172.21.15.86:0/584918538 >> v1:172.21.15.86:6789/0 conn(0x7f35a0074100 legacy=0x7f35a00c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:29.313 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.307+0000 7f359e7fc640 1 --2- 172.21.15.86:0/584918538 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f358c0039c0 0x7f358c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:29.313 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.307+0000 7f359e7fc640 1 --2- 172.21.15.86:0/584918538 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f35a014fbc0 0x7f358c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:29.313 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.307+0000 7f359e7fc640 1 --2- 172.21.15.86:0/584918538 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f358c004d50 0x7f358c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:29.313 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.307+0000 7f359e7fc640 1 -- 172.21.15.86:0/584918538 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f35a00c6050 con 0x7f358c004d50 2024-04-25T12:21:29.313 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.307+0000 7f359e7fc640 1 -- 172.21.15.86:0/584918538 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f35a00c6330 con 0x7f358c0039c0 2024-04-25T12:21:29.313 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.307+0000 7f359e7fc640 1 -- 172.21.15.86:0/584918538 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f358c00b9d0 con 0x7f35a014fbc0 2024-04-25T12:21:29.313 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.307+0000 7f359f7fe640 1 --2- 172.21.15.86:0/584918538 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f358c004d50 0x7f358c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:29.313 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.307+0000 7f359effd640 1 --2- 172.21.15.86:0/584918538 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f358c0039c0 0x7f358c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:29.314 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.307+0000 7f35967fc640 1 --2- 172.21.15.86:0/584918538 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f35a014fbc0 0x7f358c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:29.314 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.307+0000 7f359f7fe640 1 -- 172.21.15.86:0/584918538 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f35a014fbc0 msgr2=0x7f358c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:29.314 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.307+0000 7f359f7fe640 1 --2- 172.21.15.86:0/584918538 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f35a014fbc0 0x7f358c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:29.314 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.307+0000 7f359f7fe640 1 -- 172.21.15.86:0/584918538 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f358c0039c0 msgr2=0x7f358c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:29.314 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.307+0000 7f359f7fe640 1 --2- 172.21.15.86:0/584918538 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f358c0039c0 0x7f358c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:29.314 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.307+0000 7f359f7fe640 1 -- 172.21.15.86:0/584918538 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f358c003530 con 0x7f358c004d50 2024-04-25T12:21:29.315 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.307+0000 7f359f7fe640 1 --2- 172.21.15.86:0/584918538 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f358c004d50 0x7f358c0051d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f359800a850 tx=0x7f359801d380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41fbdd66f51abd68 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:29.315 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.307+0000 7f359e7fc640 1 -- 172.21.15.86:0/584918538 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f359800a4a0 con 0x7f358c004d50 2024-04-25T12:21:29.315 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.307+0000 7f359e7fc640 1 -- 172.21.15.86:0/584918538 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35980ad650 con 0x7f358c004d50 2024-04-25T12:21:29.316 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.307+0000 7f359e7fc640 1 -- 172.21.15.86:0/584918538 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35980ada40 con 0x7f358c004d50 2024-04-25T12:21:29.316 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.307+0000 7f35a53b3640 1 -- 172.21.15.86:0/584918538 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f358c004d50 msgr2=0x7f358c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:29.316 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.307+0000 7f35a53b3640 1 --2- 172.21.15.86:0/584918538 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f358c004d50 0x7f358c0051d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f359800a850 tx=0x7f359801d380 comp rx=0 tx=0).stop 2024-04-25T12:21:29.316 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.307+0000 7f359f7fe640 1 -- 172.21.15.86:0/584918538 reap_dead start 2024-04-25T12:21:29.316 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.307+0000 7f35a53b3640 1 -- 172.21.15.86:0/584918538 shutdown_connections 2024-04-25T12:21:29.316 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.307+0000 7f35a53b3640 1 -- 172.21.15.86:0/584918538 >> 172.21.15.86:0/584918538 conn(0x7f35a006b9d0 msgr2=0x7f35a006bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:29.316 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.307+0000 7f35a53b3640 1 -- 172.21.15.86:0/584918538 shutdown_connections 2024-04-25T12:21:29.316 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.307+0000 7f35a53b3640 1 -- 172.21.15.86:0/584918538 wait complete. 2024-04-25T12:21:29.316 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.311+0000 7f35a53b3640 1 Processor -- start 2024-04-25T12:21:29.316 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.311+0000 7f35a53b3640 1 -- start start 2024-04-25T12:21:29.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.311+0000 7f35a53b3640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f35a015c530 0x7f35a01f1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:29.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.311+0000 7f35a53b3640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35a015c910 0x7f35a01f2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:29.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.311+0000 7f35a53b3640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35a0159af0 0x7f35a0152570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:29.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.311+0000 7f35a53b3640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f35a0068350 con 0x7f35a0159af0 2024-04-25T12:21:29.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.311+0000 7f35a53b3640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f35a00681d0 con 0x7f35a015c910 2024-04-25T12:21:29.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.311+0000 7f35a53b3640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f35a00c7960 con 0x7f35a015c530 2024-04-25T12:21:29.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.311+0000 7f359f7fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35a0159af0 0x7f35a0152570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:29.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.311+0000 7f359f7fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35a0159af0 0x7f35a0152570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55204/0 (socket says 172.21.15.86:55204) 2024-04-25T12:21:29.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.311+0000 7f359f7fe640 1 -- 172.21.15.86:0/1733630403 learned_addr learned my addr 172.21.15.86:0/1733630403 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:29.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.311+0000 7f359effd640 1 --2- 172.21.15.86:0/1733630403 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f35a015c530 0x7f35a01f1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:29.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.311+0000 7f35967fc640 1 --2- 172.21.15.86:0/1733630403 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35a015c910 0x7f35a01f2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:29.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.311+0000 7f359f7fe640 1 -- 172.21.15.86:0/1733630403 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f35a015c530 msgr2=0x7f35a01f1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:29.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.311+0000 7f359f7fe640 1 --2- 172.21.15.86:0/1733630403 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f35a015c530 0x7f35a01f1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:29.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.311+0000 7f359f7fe640 1 -- 172.21.15.86:0/1733630403 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35a015c910 msgr2=0x7f35a01f2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:29.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.311+0000 7f359f7fe640 1 --2- 172.21.15.86:0/1733630403 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35a015c910 0x7f35a01f2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:29.320 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.311+0000 7f359f7fe640 1 -- 172.21.15.86:0/1733630403 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35a01e2790 con 0x7f35a0159af0 2024-04-25T12:21:29.320 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.311+0000 7f359f7fe640 1 --2- 172.21.15.86:0/1733630403 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35a0159af0 0x7f35a0152570 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f359801d860 tx=0x7f358c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:29.320 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.311+0000 7f3597fff640 1 -- 172.21.15.86:0/1733630403 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35980ba070 con 0x7f35a0159af0 2024-04-25T12:21:29.320 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.311+0000 7f3597fff640 1 -- 172.21.15.86:0/1733630403 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35980017c0 con 0x7f35a0159af0 2024-04-25T12:21:29.320 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.311+0000 7f35a53b3640 1 -- 172.21.15.86:0/1733630403 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35a0158190 con 0x7f35a0159af0 2024-04-25T12:21:29.320 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.311+0000 7f3597fff640 1 -- 172.21.15.86:0/1733630403 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f359800a4a0 con 0x7f35a0159af0 2024-04-25T12:21:29.320 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.311+0000 7f35a53b3640 1 -- 172.21.15.86:0/1733630403 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35a0158710 con 0x7f35a0159af0 2024-04-25T12:21:29.320 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.311+0000 7f35a53b3640 1 -- 172.21.15.86:0/1733630403 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35a0075df0 con 0x7f35a0159af0 2024-04-25T12:21:29.320 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.315+0000 7f3597fff640 1 -- 172.21.15.86:0/1733630403 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f35980bd070 con 0x7f35a0159af0 2024-04-25T12:21:29.321 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.315+0000 7f3597fff640 1 --2- 172.21.15.86:0/1733630403 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f3580068380 0x7f358006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:29.321 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.315+0000 7f3597fff640 1 -- 172.21.15.86:0/1733630403 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f3598120890 con 0x7f35a0159af0 2024-04-25T12:21:29.321 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.315+0000 7f359effd640 1 --2- 172.21.15.86:0/1733630403 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f3580068380 0x7f358006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:29.321 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.315+0000 7f359effd640 1 --2- 172.21.15.86:0/1733630403 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f3580068380 0x7f358006a840 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f35900099b0 tx=0x7f3590008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:29.323 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.319+0000 7f3597fff640 1 -- 172.21.15.86:0/1733630403 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f35a01e2790 con 0x7f35a0159af0 2024-04-25T12:21:29.519 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.515+0000 7f35a53b3640 1 -- 172.21.15.86:0/1733630403 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f35a00c7df0 con 0x7f35a0159af0 2024-04-25T12:21:29.521 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.515+0000 7f3597fff640 1 -- 172.21.15.86:0/1733630403 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+6829 (secure 0 0 0) 0x7f3598017090 con 0x7f35a0159af0 2024-04-25T12:21:29.521 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:21:29.521 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/1969068022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1969068022},{"type":"v1","addr":"172.21.15.86:6835","nonce":1969068022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6838/3213562806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":3213562806},{"type":"v1","addr":"172.21.15.86:6838","nonce":3213562806}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6839/4002713597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6837","nonce":4002713597},{"type":"v1","addr":"172.21.15.86:6839","nonce":4002713597}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4245,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/3114005030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3114005030},{"type":"v1","addr":"172.21.15.134:6833","nonce":3114005030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/1079608447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":1079608447},{"type":"v1","addr":"172.21.15.134:6837","nonce":1079608447}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T12:21:23.459093+0000","modified":"2024-04-25T12:21:28.541449+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"f","rank":0,"incarnation":4,"state":"up:creating","state_seq":1,"addr":"172.21.15.134:6836/3044511437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3044511437},{"type":"v1","addr":"172.21.15.134:6836","nonce":3044511437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-25T12:21:29.521 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 5 2024-04-25T12:21:29.523 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.519+0000 7f35a53b3640 1 -- 172.21.15.86:0/1733630403 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f3580068380 msgr2=0x7f358006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:29.523 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.519+0000 7f35a53b3640 1 --2- 172.21.15.86:0/1733630403 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f3580068380 0x7f358006a840 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f35900099b0 tx=0x7f3590008040 comp rx=0 tx=0).stop 2024-04-25T12:21:29.523 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.519+0000 7f35a53b3640 1 -- 172.21.15.86:0/1733630403 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35a0159af0 msgr2=0x7f35a0152570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:29.523 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.519+0000 7f35a53b3640 1 --2- 172.21.15.86:0/1733630403 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35a0159af0 0x7f35a0152570 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f359801d860 tx=0x7f358c005840 comp rx=0 tx=0).stop 2024-04-25T12:21:29.523 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.519+0000 7f35a53b3640 1 -- 172.21.15.86:0/1733630403 shutdown_connections 2024-04-25T12:21:29.523 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.519+0000 7f35a53b3640 1 --2- 172.21.15.86:0/1733630403 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f3580068380 0x7f358006a840 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:29.524 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.519+0000 7f35a53b3640 1 --2- 172.21.15.86:0/1733630403 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35a0159af0 0x7f35a0152570 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:29.524 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.519+0000 7f35a53b3640 1 --2- 172.21.15.86:0/1733630403 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35a015c910 0x7f35a01f2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:29.524 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.519+0000 7f35a53b3640 1 --2- 172.21.15.86:0/1733630403 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f35a015c530 0x7f35a01f1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:29.524 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.519+0000 7f35a53b3640 1 -- 172.21.15.86:0/1733630403 >> 172.21.15.86:0/1733630403 conn(0x7f35a006b9d0 msgr2=0x7f35a00cad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:29.524 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.519+0000 7f35a53b3640 1 -- 172.21.15.86:0/1733630403 shutdown_connections 2024-04-25T12:21:29.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.519+0000 7f35a53b3640 1 -- 172.21.15.86:0/1733630403 wait complete. 2024-04-25T12:21:29.540 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T12:21:29.655 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.651+0000 7f79a5ed8640 1 Processor -- start 2024-04-25T12:21:29.655 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.651+0000 7f79a5ed8640 1 -- start start 2024-04-25T12:21:29.656 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.651+0000 7f79a5ed8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79a014fbc0 0x7f79a006f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:29.657 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.651+0000 7f79a5ed8640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f79a014ffa0 0x7f79a00c8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:29.657 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.651+0000 7f79a5ed8640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f79a0074100 0x7f79a00c8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:29.657 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.651+0000 7f79a5ed8640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f79a00c5d70 con 0x7f79a0074100 2024-04-25T12:21:29.657 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.651+0000 7f79a5ed8640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f79a00c6050 con 0x7f79a014ffa0 2024-04-25T12:21:29.657 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.651+0000 7f79a5ed8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f79a00c6330 con 0x7f79a014fbc0 2024-04-25T12:21:29.657 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.651+0000 7f799ffff640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f79a0074100 0x7f79a00c8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:29.657 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.651+0000 7f799ffff640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f79a0074100 0x7f79a00c8760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55206/0 (socket says 172.21.15.86:55206) 2024-04-25T12:21:29.657 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.651+0000 7f799ffff640 1 -- 172.21.15.86:0/539381762 learned_addr learned my addr 172.21.15.86:0/539381762 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:29.657 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.651+0000 7f799f7fe640 1 --2- 172.21.15.86:0/539381762 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79a014fbc0 0x7f79a006f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:29.657 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.651+0000 7f7997fff640 1 --2- 172.21.15.86:0/539381762 >> v2:172.21.15.134:3300/0 conn(0x7f79a014ffa0 0x7f79a00c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:29.657 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.651+0000 7f799ffff640 1 -- 172.21.15.86:0/539381762 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79a014fbc0 msgr2=0x7f79a006f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:29.657 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.651+0000 7f799ffff640 1 --2- 172.21.15.86:0/539381762 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79a014fbc0 0x7f79a006f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:29.657 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.651+0000 7f799ffff640 1 -- 172.21.15.86:0/539381762 >> v2:172.21.15.134:3300/0 conn(0x7f79a014ffa0 msgr2=0x7f79a00c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:29.657 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.651+0000 7f799ffff640 1 --2- 172.21.15.86:0/539381762 >> v2:172.21.15.134:3300/0 conn(0x7f79a014ffa0 0x7f79a00c8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:29.657 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.651+0000 7f799ffff640 1 -- 172.21.15.86:0/539381762 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79a00c6610 con 0x7f79a0074100 2024-04-25T12:21:29.658 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.651+0000 7f7997fff640 1 --2- 172.21.15.86:0/539381762 >> v2:172.21.15.134:3300/0 conn(0x7f79a014ffa0 0x7f79a00c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:21:29.659 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.655+0000 7f799ffff640 1 --2- 172.21.15.86:0/539381762 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79a0074100 0x7f79a00c8760 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f79a006a030 tx=0x7f799801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ec502cdd563f36a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:29.659 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.655+0000 7f799effd640 1 -- 172.21.15.86:0/539381762 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79980a5890 con 0x7f79a0074100 2024-04-25T12:21:29.659 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.655+0000 7f799effd640 1 -- 172.21.15.86:0/539381762 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79980a5a30 con 0x7f79a0074100 2024-04-25T12:21:29.660 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.655+0000 7f799effd640 1 -- 172.21.15.86:0/539381762 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79980a5e00 con 0x7f79a0074100 2024-04-25T12:21:29.660 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.655+0000 7f79a5ed8640 1 -- 172.21.15.86:0/539381762 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79a0074100 msgr2=0x7f79a00c8760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:29.660 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.655+0000 7f79a5ed8640 1 --2- 172.21.15.86:0/539381762 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79a0074100 0x7f79a00c8760 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f79a006a030 tx=0x7f799801c9f0 comp rx=0 tx=0).stop 2024-04-25T12:21:29.661 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.655+0000 7f79a5ed8640 1 -- 172.21.15.86:0/539381762 shutdown_connections 2024-04-25T12:21:29.661 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.655+0000 7f79a5ed8640 1 --2- 172.21.15.86:0/539381762 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79a0074100 0x7f79a00c8760 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:29.661 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.655+0000 7f79a5ed8640 1 --2- 172.21.15.86:0/539381762 >> v2:172.21.15.134:3300/0 conn(0x7f79a014ffa0 0x7f79a00c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:29.661 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.655+0000 7f79a5ed8640 1 --2- 172.21.15.86:0/539381762 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79a014fbc0 0x7f79a006f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:29.661 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.655+0000 7f79a5ed8640 1 -- 172.21.15.86:0/539381762 >> 172.21.15.86:0/539381762 conn(0x7f79a006b9d0 msgr2=0x7f79a006bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:29.661 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.655+0000 7f79a5ed8640 1 -- 172.21.15.86:0/539381762 shutdown_connections 2024-04-25T12:21:29.661 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.655+0000 7f79a5ed8640 1 -- 172.21.15.86:0/539381762 wait complete. 2024-04-25T12:21:29.661 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.655+0000 7f79a5ed8640 1 Processor -- start 2024-04-25T12:21:29.662 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.655+0000 7f79a5ed8640 1 -- start start 2024-04-25T12:21:29.663 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.655+0000 7f79a5ed8640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79a0074100 0x7f79a01523f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:29.664 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.655+0000 7f79a5ed8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79a014fbc0 0x7f79a0151570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:29.664 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.655+0000 7f79a5ed8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79a014ffa0 0x7f79a01f4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:29.664 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.655+0000 7f79a5ed8640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f79a01592e0 con 0x7f79a0074100 2024-04-25T12:21:29.664 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.655+0000 7f79a5ed8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f79a0159160 con 0x7f79a014fbc0 2024-04-25T12:21:29.664 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.655+0000 7f79a5ed8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f79a0159460 con 0x7f79a014ffa0 2024-04-25T12:21:29.664 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.655+0000 7f799f7fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79a0074100 0x7f79a01523f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:29.664 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.655+0000 7f799f7fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79a0074100 0x7f79a01523f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55222/0 (socket says 172.21.15.86:55222) 2024-04-25T12:21:29.664 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.655+0000 7f799f7fe640 1 -- 172.21.15.86:0/561968191 learned_addr learned my addr 172.21.15.86:0/561968191 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:29.664 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.659+0000 7f799ffff640 1 --2- 172.21.15.86:0/561968191 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79a014ffa0 0x7f79a01f4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:29.664 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.659+0000 7f7997fff640 1 --2- 172.21.15.86:0/561968191 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79a014fbc0 0x7f79a0151570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:29.664 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.659+0000 7f799f7fe640 1 -- 172.21.15.86:0/561968191 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79a014ffa0 msgr2=0x7f79a01f4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:29.664 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.659+0000 7f799f7fe640 1 --2- 172.21.15.86:0/561968191 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79a014ffa0 0x7f79a01f4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:29.664 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.659+0000 7f799f7fe640 1 -- 172.21.15.86:0/561968191 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79a014fbc0 msgr2=0x7f79a0151570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:29.664 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.659+0000 7f799f7fe640 1 --2- 172.21.15.86:0/561968191 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79a014fbc0 0x7f79a0151570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:29.665 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.659+0000 7f799f7fe640 1 -- 172.21.15.86:0/561968191 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79a01531a0 con 0x7f79a0074100 2024-04-25T12:21:29.665 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.659+0000 7f799ffff640 1 --2- 172.21.15.86:0/561968191 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79a014ffa0 0x7f79a01f4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:21:29.665 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.659+0000 7f7997fff640 1 --2- 172.21.15.86:0/561968191 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79a014fbc0 0x7f79a0151570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:21:29.665 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.659+0000 7f799f7fe640 1 --2- 172.21.15.86:0/561968191 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79a0074100 0x7f79a01523f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f799000d830 tx=0x7f799000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:29.665 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.659+0000 7f799cff9640 1 -- 172.21.15.86:0/561968191 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7990018020 con 0x7f79a0074100 2024-04-25T12:21:29.665 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.659+0000 7f799cff9640 1 -- 172.21.15.86:0/561968191 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79900096c0 con 0x7f79a0074100 2024-04-25T12:21:29.665 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.659+0000 7f79a5ed8640 1 -- 172.21.15.86:0/561968191 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79a0153460 con 0x7f79a0074100 2024-04-25T12:21:29.665 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.659+0000 7f799cff9640 1 -- 172.21.15.86:0/561968191 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7990009ab0 con 0x7f79a0074100 2024-04-25T12:21:29.665 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.659+0000 7f79a5ed8640 1 -- 172.21.15.86:0/561968191 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79a0150d70 con 0x7f79a0074100 2024-04-25T12:21:29.665 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.659+0000 7f79a5ed8640 1 -- 172.21.15.86:0/561968191 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79a0075df0 con 0x7f79a0074100 2024-04-25T12:21:29.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.659+0000 7f799cff9640 1 -- 172.21.15.86:0/561968191 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f799001b020 con 0x7f79a0074100 2024-04-25T12:21:29.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.659+0000 7f799cff9640 1 --2- 172.21.15.86:0/561968191 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f79800683b0 0x7f798006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:29.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.659+0000 7f799cff9640 1 -- 172.21.15.86:0/561968191 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f7990087230 con 0x7f79a0074100 2024-04-25T12:21:29.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.659+0000 7f7997fff640 1 --2- 172.21.15.86:0/561968191 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f79800683b0 0x7f798006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:29.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.659+0000 7f7997fff640 1 --2- 172.21.15.86:0/561968191 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f79800683b0 0x7f798006a870 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f79a015c550 tx=0x7f7988008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:29.669 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.663+0000 7f799cff9640 1 -- 172.21.15.86:0/561968191 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7990022020 con 0x7f79a0074100 2024-04-25T12:21:29.827 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.823+0000 7f79a5ed8640 1 -- 172.21.15.86:0/561968191 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f79a00c7df0 con 0x7f79a0074100 2024-04-25T12:21:29.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.823+0000 7f799cff9640 1 -- 172.21.15.86:0/561968191 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18514 (secure 0 0 0) 0x7f79900574b0 con 0x7f79a0074100 2024-04-25T12:21:29.829 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:21:29.829 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":24,"fsid":"f2ef5c0c-9576-4650-b4f7-6cb14247f62a","created":"2024-04-25T12:20:59.241733+0000","modified":"2024-04-25T12:21:28.541128+0000","last_up_change":"2024-04-25T12:21:10.939617+0000","last_in_change":"2024-04-25T12:21:01.534145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T12:21:11.839922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T12:21:21.854040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T12:21:22.406060+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T12:21:26.152386+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1f713f00-ef9f-4a6f-a620-38a8a1f8a822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6801","nonce":2812764579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6803","nonce":2812764579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6807","nonce":2812764579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6805","nonce":2812764579}]},"public_addr":"172.21.15.86:6801/2812764579","cluster_addr":"172.21.15.86:6803/2812764579","heartbeat_back_addr":"172.21.15.86:6807/2812764579","heartbeat_front_addr":"172.21.15.86:6805/2812764579","state":["exists","up"]},{"osd":1,"uuid":"baf6606d-a556-4fbe-a930-855e04ff1534","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6809","nonce":467966038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6811","nonce":467966038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6815","nonce":467966038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6813","nonce":467966038}]},"public_addr":"172.21.15.86:6809/467966038","cluster_addr":"172.21.15.86:6811/467966038","heartbeat_back_addr":"172.21.15.86:6815/467966038","heartbeat_front_addr":"172.21.15.86:6813/467966038","state":["exists","up"]},{"osd":2,"uuid":"c983d68e-6d60-434f-aed6-108420c5dd09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6817","nonce":3279762843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6820","nonce":3279762843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6825","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6827","nonce":3279762843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6824","nonce":3279762843}]},"public_addr":"172.21.15.86:6817/3279762843","cluster_addr":"172.21.15.86:6820/3279762843","heartbeat_back_addr":"172.21.15.86:6827/3279762843","heartbeat_front_addr":"172.21.15.86:6824/3279762843","state":["exists","up"]},{"osd":3,"uuid":"e77657bb-45aa-43bf-ab41-c7377eb495ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6821","nonce":2861354413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6826","nonce":2861354413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6831","nonce":2861354413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6829","nonce":2861354413}]},"public_addr":"172.21.15.86:6821/2861354413","cluster_addr":"172.21.15.86:6826/2861354413","heartbeat_back_addr":"172.21.15.86:6831/2861354413","heartbeat_front_addr":"172.21.15.86:6829/2861354413","state":["exists","up"]},{"osd":4,"uuid":"252bd300-d75a-4b00-be4b-27e6b51de4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6802","nonce":1872913602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6805","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6808","nonce":1872913602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6815","nonce":1872913602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6813","nonce":1872913602}]},"public_addr":"172.21.15.134:6802/1872913602","cluster_addr":"172.21.15.134:6808/1872913602","heartbeat_back_addr":"172.21.15.134:6815/1872913602","heartbeat_front_addr":"172.21.15.134:6813/1872913602","state":["exists","up"]},{"osd":5,"uuid":"4135da3f-7427-4409-a48e-78bd8a7b46ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6801","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6803","nonce":2261413981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6806","nonce":2261413981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6812","nonce":2261413981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6809","nonce":2261413981}]},"public_addr":"172.21.15.134:6803/2261413981","cluster_addr":"172.21.15.134:6806/2261413981","heartbeat_back_addr":"172.21.15.134:6812/2261413981","heartbeat_front_addr":"172.21.15.134:6809/2261413981","state":["exists","up"]},{"osd":6,"uuid":"b6e7a5f1-fa7e-497d-abac-a19994d26820","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6825","nonce":2841082767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6827","nonce":2841082767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6831","nonce":2841082767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6829","nonce":2841082767}]},"public_addr":"172.21.15.134:6825/2841082767","cluster_addr":"172.21.15.134:6827/2841082767","heartbeat_back_addr":"172.21.15.134:6831/2841082767","heartbeat_front_addr":"172.21.15.134:6829/2841082767","state":["exists","up"]},{"osd":7,"uuid":"c5597e50-1962-4103-9124-dd7bceb8ac97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6817","nonce":1277404274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6819","nonce":1277404274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6823","nonce":1277404274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6821","nonce":1277404274}]},"public_addr":"172.21.15.134:6817/1277404274","cluster_addr":"172.21.15.134:6819/1277404274","heartbeat_back_addr":"172.21.15.134:6823/1277404274","heartbeat_front_addr":"172.21.15.134:6821/1277404274","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.018125+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.157958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.113619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.136904+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.844514+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.872629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.775339+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.822867+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T12:21:29.831 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.827+0000 7f79a5ed8640 1 -- 172.21.15.86:0/561968191 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f79800683b0 msgr2=0x7f798006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:29.831 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.827+0000 7f79a5ed8640 1 --2- 172.21.15.86:0/561968191 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f79800683b0 0x7f798006a870 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f79a015c550 tx=0x7f7988008040 comp rx=0 tx=0).stop 2024-04-25T12:21:29.831 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.827+0000 7f79a5ed8640 1 -- 172.21.15.86:0/561968191 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79a0074100 msgr2=0x7f79a01523f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:29.831 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.827+0000 7f79a5ed8640 1 --2- 172.21.15.86:0/561968191 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79a0074100 0x7f79a01523f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f799000d830 tx=0x7f799000dcf0 comp rx=0 tx=0).stop 2024-04-25T12:21:29.831 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.827+0000 7f79a5ed8640 1 -- 172.21.15.86:0/561968191 shutdown_connections 2024-04-25T12:21:29.831 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.827+0000 7f79a5ed8640 1 --2- 172.21.15.86:0/561968191 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79a014ffa0 0x7f79a01f4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:29.831 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.827+0000 7f79a5ed8640 1 --2- 172.21.15.86:0/561968191 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79a014fbc0 0x7f79a0151570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:29.831 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.827+0000 7f79a5ed8640 1 --2- 172.21.15.86:0/561968191 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f79800683b0 0x7f798006a870 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:29.832 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.827+0000 7f79a5ed8640 1 --2- 172.21.15.86:0/561968191 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79a0074100 0x7f79a01523f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:29.832 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.827+0000 7f79a5ed8640 1 -- 172.21.15.86:0/561968191 >> 172.21.15.86:0/561968191 conn(0x7f79a006b9d0 msgr2=0x7f79a006bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:29.832 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.827+0000 7f79a5ed8640 1 -- 172.21.15.86:0/561968191 shutdown_connections 2024-04-25T12:21:29.832 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.827+0000 7f79a5ed8640 1 -- 172.21.15.86:0/561968191 wait complete. 2024-04-25T12:21:29.847 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T12:21:29.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.951+0000 7f1835ae8640 1 Processor -- start 2024-04-25T12:21:29.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.951+0000 7f1835ae8640 1 -- start start 2024-04-25T12:21:29.958 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.951+0000 7f1835ae8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f183014fbc0 0x7f183006f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:29.958 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.951+0000 7f1835ae8640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18300c5d70 con 0x7f183014ffa0 2024-04-25T12:21:29.958 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.951+0000 7f1835ae8640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18300c6050 con 0x7f1830074100 2024-04-25T12:21:29.959 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.951+0000 7f1835ae8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f18300c6330 con 0x7f183014fbc0 2024-04-25T12:21:29.959 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.951+0000 7f182effd640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f183014ffa0 0x7f18300c8220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:58918/0 (socket says 172.21.15.86:58918) 2024-04-25T12:21:29.959 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.951+0000 7f182effd640 1 -- 172.21.15.86:0/4097955160 learned_addr learned my addr 172.21.15.86:0/4097955160 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-04-25T12:21:29.959 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.951+0000 7f182f7fe640 1 --2- 172.21.15.86:0/4097955160 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f183014fbc0 0x7f183006f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:29.959 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.951+0000 7f182e7fc640 1 -- 172.21.15.86:0/4097955160 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2752991803 0 0) 0x7f18300c5d70 con 0x7f183014ffa0 2024-04-25T12:21:29.959 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.951+0000 7f182e7fc640 1 -- 172.21.15.86:0/4097955160 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1818003530 con 0x7f183014ffa0 2024-04-25T12:21:29.959 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.951+0000 7f182e7fc640 1 -- 172.21.15.86:0/4097955160 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 698704209 0 0) 0x7f1818003530 con 0x7f183014ffa0 2024-04-25T12:21:29.959 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.951+0000 7f182e7fc640 1 -- 172.21.15.86:0/4097955160 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f183014fbc0 msgr2=0x7f183006f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:29.959 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.951+0000 7f182e7fc640 1 --2- 172.21.15.86:0/4097955160 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f183014fbc0 0x7f183006f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:29.959 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.951+0000 7f182e7fc640 1 -- 172.21.15.86:0/4097955160 >> v1:172.21.15.134:6789/0 conn(0x7f1830074100 legacy=0x7f18300c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:29.959 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.951+0000 7f182e7fc640 1 -- 172.21.15.86:0/4097955160 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18300c6610 con 0x7f183014ffa0 2024-04-25T12:21:29.959 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.951+0000 7f182e7fc640 1 -- 172.21.15.86:0/4097955160 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1387950573 0 0) 0x7f1824001680 con 0x7f183014ffa0 2024-04-25T12:21:29.959 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.951+0000 7f182e7fc640 1 -- 172.21.15.86:0/4097955160 >> v1:172.21.15.86:6789/0 conn(0x7f183014ffa0 legacy=0x7f18300c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:29.959 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.951+0000 7f182e7fc640 1 --2- 172.21.15.86:0/4097955160 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f183014fbc0 0x7f18180039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:29.960 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.951+0000 7f182e7fc640 1 --2- 172.21.15.86:0/4097955160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1818003f70 0x7f1818004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:29.960 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.951+0000 7f182e7fc640 1 --2- 172.21.15.86:0/4097955160 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1818004d50 0x7f18180051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:29.960 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.951+0000 7f182e7fc640 1 -- 172.21.15.86:0/4097955160 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f18300c6330 con 0x7f1818004d50 2024-04-25T12:21:29.960 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.951+0000 7f182e7fc640 1 -- 172.21.15.86:0/4097955160 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f181800bab0 con 0x7f1818003f70 2024-04-25T12:21:29.960 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.951+0000 7f182e7fc640 1 -- 172.21.15.86:0/4097955160 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f181800bcb0 con 0x7f183014fbc0 2024-04-25T12:21:29.960 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.951+0000 7f182ffff640 1 --2- 172.21.15.86:0/4097955160 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1818004d50 0x7f18180051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:29.960 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.951+0000 7f182effd640 1 --2- 172.21.15.86:0/4097955160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1818003f70 0x7f1818004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:29.960 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.951+0000 7f182f7fe640 1 --2- 172.21.15.86:0/4097955160 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f183014fbc0 0x7f18180039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:29.960 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.951+0000 7f182ffff640 1 -- 172.21.15.86:0/4097955160 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f183014fbc0 msgr2=0x7f18180039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:29.960 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.951+0000 7f182ffff640 1 --2- 172.21.15.86:0/4097955160 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f183014fbc0 0x7f18180039f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:29.960 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.955+0000 7f182ffff640 1 -- 172.21.15.86:0/4097955160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1818003f70 msgr2=0x7f1818004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:29.960 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.955+0000 7f182ffff640 1 --2- 172.21.15.86:0/4097955160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1818003f70 0x7f1818004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:29.960 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.955+0000 7f182ffff640 1 -- 172.21.15.86:0/4097955160 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1818003530 con 0x7f1818004d50 2024-04-25T12:21:29.961 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.955+0000 7f182ffff640 1 --2- 172.21.15.86:0/4097955160 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1818004d50 0x7f18180051d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1828001e40 tx=0x7f182801c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8bcfc4a3bbe29c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:29.962 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.955+0000 7f182e7fc640 1 -- 172.21.15.86:0/4097955160 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1828001a90 con 0x7f1818004d50 2024-04-25T12:21:29.962 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.955+0000 7f182e7fc640 1 -- 172.21.15.86:0/4097955160 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1828003b80 con 0x7f1818004d50 2024-04-25T12:21:29.962 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.955+0000 7f182e7fc640 1 -- 172.21.15.86:0/4097955160 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1828005080 con 0x7f1818004d50 2024-04-25T12:21:29.962 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.955+0000 7f1835ae8640 1 -- 172.21.15.86:0/4097955160 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1818004d50 msgr2=0x7f18180051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:29.962 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.955+0000 7f1835ae8640 1 --2- 172.21.15.86:0/4097955160 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1818004d50 0x7f18180051d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1828001e40 tx=0x7f182801c760 comp rx=0 tx=0).stop 2024-04-25T12:21:29.962 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.955+0000 7f182ffff640 1 -- 172.21.15.86:0/4097955160 reap_dead start 2024-04-25T12:21:29.962 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.955+0000 7f1835ae8640 1 -- 172.21.15.86:0/4097955160 shutdown_connections 2024-04-25T12:21:29.962 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.955+0000 7f1835ae8640 1 -- 172.21.15.86:0/4097955160 >> 172.21.15.86:0/4097955160 conn(0x7f183006b9d0 msgr2=0x7f183006bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:29.962 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.955+0000 7f1835ae8640 1 -- 172.21.15.86:0/4097955160 shutdown_connections 2024-04-25T12:21:29.962 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.955+0000 7f1835ae8640 1 -- 172.21.15.86:0/4097955160 wait complete. 2024-04-25T12:21:29.965 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.955+0000 7f1835ae8640 1 Processor -- start 2024-04-25T12:21:29.965 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.955+0000 7f1835ae8640 1 -- start start 2024-04-25T12:21:29.965 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.959+0000 7f1835ae8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1818004d50 0x7f1830146860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:29.965 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.959+0000 7f1835ae8640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18300c76e0 0x7f1830146da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:29.965 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.959+0000 7f1835ae8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1830149ce0 0x7f183014a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:29.965 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.959+0000 7f1835ae8640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1830068350 con 0x7f18300c76e0 2024-04-25T12:21:29.965 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.959+0000 7f1835ae8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f18300681d0 con 0x7f1818004d50 2024-04-25T12:21:29.965 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.959+0000 7f1835ae8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f18300c8930 con 0x7f1830149ce0 2024-04-25T12:21:29.966 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.959+0000 7f182effd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18300c76e0 0x7f1830146da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:29.966 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.959+0000 7f182effd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18300c76e0 0x7f1830146da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55244/0 (socket says 172.21.15.86:55244) 2024-04-25T12:21:29.966 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.959+0000 7f182effd640 1 -- 172.21.15.86:0/1505258044 learned_addr learned my addr 172.21.15.86:0/1505258044 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:29.966 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.959+0000 7f182ffff640 1 --2- 172.21.15.86:0/1505258044 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1830149ce0 0x7f183014a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:29.966 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.959+0000 7f182f7fe640 1 --2- 172.21.15.86:0/1505258044 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1818004d50 0x7f1830146860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:29.966 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.959+0000 7f182effd640 1 -- 172.21.15.86:0/1505258044 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1830149ce0 msgr2=0x7f183014a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:29.966 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.959+0000 7f182effd640 1 --2- 172.21.15.86:0/1505258044 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1830149ce0 0x7f183014a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:29.966 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.959+0000 7f182effd640 1 -- 172.21.15.86:0/1505258044 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1818004d50 msgr2=0x7f1830146860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:29.966 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.959+0000 7f182effd640 1 --2- 172.21.15.86:0/1505258044 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1818004d50 0x7f1830146860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:29.966 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.959+0000 7f182effd640 1 -- 172.21.15.86:0/1505258044 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f183006fa30 con 0x7f18300c76e0 2024-04-25T12:21:29.966 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.959+0000 7f182ffff640 1 --2- 172.21.15.86:0/1505258044 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1830149ce0 0x7f183014a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:21:29.966 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.959+0000 7f182f7fe640 1 --2- 172.21.15.86:0/1505258044 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1818004d50 0x7f1830146860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:21:29.966 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.959+0000 7f182effd640 1 --2- 172.21.15.86:0/1505258044 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18300c76e0 0x7f1830146da0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f182400e8c0 tx=0x7f182400ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:29.967 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.959+0000 7f1817fff640 1 -- 172.21.15.86:0/1505258044 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f182400c8d0 con 0x7f18300c76e0 2024-04-25T12:21:29.967 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.959+0000 7f1817fff640 1 -- 172.21.15.86:0/1505258044 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1824018070 con 0x7f18300c76e0 2024-04-25T12:21:29.967 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.959+0000 7f1835ae8640 1 -- 172.21.15.86:0/1505258044 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f183014c340 con 0x7f18300c76e0 2024-04-25T12:21:29.967 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.959+0000 7f1817fff640 1 -- 172.21.15.86:0/1505258044 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f182400ccd0 con 0x7f18300c76e0 2024-04-25T12:21:29.967 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.959+0000 7f1835ae8640 1 -- 172.21.15.86:0/1505258044 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18301f1bb0 con 0x7f18300c76e0 2024-04-25T12:21:29.967 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.959+0000 7f1835ae8640 1 -- 172.21.15.86:0/1505258044 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1830075df0 con 0x7f18300c76e0 2024-04-25T12:21:29.967 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.959+0000 7f1817fff640 1 -- 172.21.15.86:0/1505258044 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1824013420 con 0x7f18300c76e0 2024-04-25T12:21:29.968 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.959+0000 7f1817fff640 1 --2- 172.21.15.86:0/1505258044 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f181c0683b0 0x7f181c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:29.968 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.959+0000 7f182f7fe640 1 --2- 172.21.15.86:0/1505258044 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f181c0683b0 0x7f181c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:29.968 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.959+0000 7f1817fff640 1 -- 172.21.15.86:0/1505258044 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f1824086a30 con 0x7f18300c76e0 2024-04-25T12:21:29.968 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.959+0000 7f182f7fe640 1 --2- 172.21.15.86:0/1505258044 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f181c0683b0 0x7f181c06a870 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1820009a00 tx=0x7f1820008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:29.970 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:29.963+0000 7f1817fff640 1 -- 172.21.15.86:0/1505258044 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1824056c20 con 0x7f18300c76e0 2024-04-25T12:21:30.125 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.119+0000 7f1835ae8640 1 -- 172.21.15.86:0/1505258044 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f18300c7df0 con 0x7f18300c76e0 2024-04-25T12:21:30.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.123+0000 7f1817fff640 1 -- 172.21.15.86:0/1505258044 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18514 (secure 0 0 0) 0x7f1824056520 con 0x7f18300c76e0 2024-04-25T12:21:30.127 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:21:30.127 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":24,"fsid":"f2ef5c0c-9576-4650-b4f7-6cb14247f62a","created":"2024-04-25T12:20:59.241733+0000","modified":"2024-04-25T12:21:28.541128+0000","last_up_change":"2024-04-25T12:21:10.939617+0000","last_in_change":"2024-04-25T12:21:01.534145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T12:21:11.839922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T12:21:21.854040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T12:21:22.406060+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T12:21:26.152386+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1f713f00-ef9f-4a6f-a620-38a8a1f8a822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6801","nonce":2812764579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6803","nonce":2812764579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6807","nonce":2812764579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6805","nonce":2812764579}]},"public_addr":"172.21.15.86:6801/2812764579","cluster_addr":"172.21.15.86:6803/2812764579","heartbeat_back_addr":"172.21.15.86:6807/2812764579","heartbeat_front_addr":"172.21.15.86:6805/2812764579","state":["exists","up"]},{"osd":1,"uuid":"baf6606d-a556-4fbe-a930-855e04ff1534","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6809","nonce":467966038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6811","nonce":467966038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6815","nonce":467966038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6813","nonce":467966038}]},"public_addr":"172.21.15.86:6809/467966038","cluster_addr":"172.21.15.86:6811/467966038","heartbeat_back_addr":"172.21.15.86:6815/467966038","heartbeat_front_addr":"172.21.15.86:6813/467966038","state":["exists","up"]},{"osd":2,"uuid":"c983d68e-6d60-434f-aed6-108420c5dd09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6817","nonce":3279762843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6820","nonce":3279762843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6825","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6827","nonce":3279762843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6824","nonce":3279762843}]},"public_addr":"172.21.15.86:6817/3279762843","cluster_addr":"172.21.15.86:6820/3279762843","heartbeat_back_addr":"172.21.15.86:6827/3279762843","heartbeat_front_addr":"172.21.15.86:6824/3279762843","state":["exists","up"]},{"osd":3,"uuid":"e77657bb-45aa-43bf-ab41-c7377eb495ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6821","nonce":2861354413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6826","nonce":2861354413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6831","nonce":2861354413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6829","nonce":2861354413}]},"public_addr":"172.21.15.86:6821/2861354413","cluster_addr":"172.21.15.86:6826/2861354413","heartbeat_back_addr":"172.21.15.86:6831/2861354413","heartbeat_front_addr":"172.21.15.86:6829/2861354413","state":["exists","up"]},{"osd":4,"uuid":"252bd300-d75a-4b00-be4b-27e6b51de4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6802","nonce":1872913602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6805","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6808","nonce":1872913602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6815","nonce":1872913602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6813","nonce":1872913602}]},"public_addr":"172.21.15.134:6802/1872913602","cluster_addr":"172.21.15.134:6808/1872913602","heartbeat_back_addr":"172.21.15.134:6815/1872913602","heartbeat_front_addr":"172.21.15.134:6813/1872913602","state":["exists","up"]},{"osd":5,"uuid":"4135da3f-7427-4409-a48e-78bd8a7b46ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6801","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6803","nonce":2261413981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6806","nonce":2261413981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6812","nonce":2261413981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6809","nonce":2261413981}]},"public_addr":"172.21.15.134:6803/2261413981","cluster_addr":"172.21.15.134:6806/2261413981","heartbeat_back_addr":"172.21.15.134:6812/2261413981","heartbeat_front_addr":"172.21.15.134:6809/2261413981","state":["exists","up"]},{"osd":6,"uuid":"b6e7a5f1-fa7e-497d-abac-a19994d26820","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6825","nonce":2841082767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6827","nonce":2841082767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6831","nonce":2841082767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6829","nonce":2841082767}]},"public_addr":"172.21.15.134:6825/2841082767","cluster_addr":"172.21.15.134:6827/2841082767","heartbeat_back_addr":"172.21.15.134:6831/2841082767","heartbeat_front_addr":"172.21.15.134:6829/2841082767","state":["exists","up"]},{"osd":7,"uuid":"c5597e50-1962-4103-9124-dd7bceb8ac97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6817","nonce":1277404274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6819","nonce":1277404274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6823","nonce":1277404274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6821","nonce":1277404274}]},"public_addr":"172.21.15.134:6817/1277404274","cluster_addr":"172.21.15.134:6819/1277404274","heartbeat_back_addr":"172.21.15.134:6823/1277404274","heartbeat_front_addr":"172.21.15.134:6821/1277404274","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.018125+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.157958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.113619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.136904+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.844514+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.872629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.775339+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.822867+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T12:21:30.129 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.123+0000 7f1835ae8640 1 -- 172.21.15.86:0/1505258044 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f181c0683b0 msgr2=0x7f181c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:30.129 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.123+0000 7f1835ae8640 1 --2- 172.21.15.86:0/1505258044 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f181c0683b0 0x7f181c06a870 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1820009a00 tx=0x7f1820008040 comp rx=0 tx=0).stop 2024-04-25T12:21:30.129 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.123+0000 7f1835ae8640 1 -- 172.21.15.86:0/1505258044 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18300c76e0 msgr2=0x7f1830146da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:30.129 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.123+0000 7f1835ae8640 1 --2- 172.21.15.86:0/1505258044 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18300c76e0 0x7f1830146da0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f182400e8c0 tx=0x7f182400ed80 comp rx=0 tx=0).stop 2024-04-25T12:21:30.129 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.123+0000 7f1835ae8640 1 -- 172.21.15.86:0/1505258044 shutdown_connections 2024-04-25T12:21:30.129 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.123+0000 7f1835ae8640 1 --2- 172.21.15.86:0/1505258044 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1830149ce0 0x7f183014a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:30.129 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.123+0000 7f1835ae8640 1 --2- 172.21.15.86:0/1505258044 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f181c0683b0 0x7f181c06a870 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:30.130 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.123+0000 7f1835ae8640 1 --2- 172.21.15.86:0/1505258044 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18300c76e0 0x7f1830146da0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:30.130 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.123+0000 7f1835ae8640 1 --2- 172.21.15.86:0/1505258044 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1818004d50 0x7f1830146860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:30.130 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.123+0000 7f1835ae8640 1 -- 172.21.15.86:0/1505258044 >> 172.21.15.86:0/1505258044 conn(0x7f183006b9d0 msgr2=0x7f18300cad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:30.130 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.123+0000 7f1835ae8640 1 -- 172.21.15.86:0/1505258044 shutdown_connections 2024-04-25T12:21:30.130 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.123+0000 7f1835ae8640 1 -- 172.21.15.86:0/1505258044 wait complete. 2024-04-25T12:21:30.160 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T12:21:30.278 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.271+0000 7f154b2e5640 1 Processor -- start 2024-04-25T12:21:30.278 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.275+0000 7f154b2e5640 1 -- start start 2024-04-25T12:21:30.280 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.275+0000 7f154b2e5640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f15440c8250 0x7f15440c39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:30.280 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.275+0000 7f154b2e5640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f15440c8630 0x7f1544151b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:30.280 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.275+0000 7f154b2e5640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f154415b740 con 0x7f15440c8a70 2024-04-25T12:21:30.280 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.275+0000 7f154b2e5640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f15440c6490 con 0x7f15440c8630 2024-04-25T12:21:30.280 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.275+0000 7f154b2e5640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f15440c58c0 con 0x7f15440c8250 2024-04-25T12:21:30.280 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.275+0000 7f1548880640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f15440c8630 0x7f1544151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:30.280 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.275+0000 7f1548880640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f15440c8630 0x7f1544151b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55260/0 (socket says 172.21.15.86:55260) 2024-04-25T12:21:30.280 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.275+0000 7f1549882640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f15440c8a70 0x7f1544152080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:58928/0 (socket says 172.21.15.86:58928) 2024-04-25T12:21:30.281 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.275+0000 7f1548880640 1 -- 172.21.15.86:0/1864943723 learned_addr learned my addr 172.21.15.86:0/1864943723 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:30.281 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.275+0000 7f1549081640 1 --2- 172.21.15.86:0/1864943723 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f15440c8250 0x7f15440c39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:30.281 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.275+0000 7f1548880640 1 -- 172.21.15.86:0/1864943723 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f15440c8250 msgr2=0x7f15440c39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:30.281 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.275+0000 7f1548880640 1 --2- 172.21.15.86:0/1864943723 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f15440c8250 0x7f15440c39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:30.281 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.275+0000 7f1548880640 1 -- 172.21.15.86:0/1864943723 >> v1:172.21.15.86:6789/0 conn(0x7f15440c8a70 legacy=0x7f1544152080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:30.281 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.275+0000 7f1548880640 1 -- 172.21.15.86:0/1864943723 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15440c5b60 con 0x7f15440c8630 2024-04-25T12:21:30.281 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.275+0000 7f1543fff640 1 -- 172.21.15.86:0/1864943723 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3160821339 0 0) 0x7f154415b740 con 0x7f15440c8a70 2024-04-25T12:21:30.282 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.275+0000 7f1548880640 1 --2- 172.21.15.86:0/1864943723 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15440c8630 0x7f1544151b40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f15380098a0 tx=0x7f153801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=463bb9905d39a243 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:30.282 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.275+0000 7f1543fff640 1 -- 172.21.15.86:0/1864943723 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15380b1070 con 0x7f15440c8630 2024-04-25T12:21:30.282 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.275+0000 7f1543fff640 1 -- 172.21.15.86:0/1864943723 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15380ac600 con 0x7f15440c8630 2024-04-25T12:21:30.282 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.275+0000 7f1543fff640 1 -- 172.21.15.86:0/1864943723 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15380ac9d0 con 0x7f15440c8630 2024-04-25T12:21:30.283 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.279+0000 7f154b2e5640 1 -- 172.21.15.86:0/1864943723 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15440c8630 msgr2=0x7f1544151b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:30.283 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.279+0000 7f154b2e5640 1 --2- 172.21.15.86:0/1864943723 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15440c8630 0x7f1544151b40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f15380098a0 tx=0x7f153801c4b0 comp rx=0 tx=0).stop 2024-04-25T12:21:30.283 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.279+0000 7f154b2e5640 1 -- 172.21.15.86:0/1864943723 shutdown_connections 2024-04-25T12:21:30.283 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.279+0000 7f154b2e5640 1 --2- 172.21.15.86:0/1864943723 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15440c8630 0x7f1544151b40 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:30.283 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.279+0000 7f154b2e5640 1 --2- 172.21.15.86:0/1864943723 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f15440c8250 0x7f15440c39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:30.283 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.279+0000 7f154b2e5640 1 -- 172.21.15.86:0/1864943723 >> 172.21.15.86:0/1864943723 conn(0x7f154406b9d0 msgr2=0x7f154406bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:30.284 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.279+0000 7f154b2e5640 1 -- 172.21.15.86:0/1864943723 shutdown_connections 2024-04-25T12:21:30.284 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.279+0000 7f154b2e5640 1 -- 172.21.15.86:0/1864943723 wait complete. 2024-04-25T12:21:30.284 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.279+0000 7f154b2e5640 1 Processor -- start 2024-04-25T12:21:30.284 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.279+0000 7f154b2e5640 1 -- start start 2024-04-25T12:21:30.286 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.279+0000 7f154b2e5640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15440c8250 0x7f154415a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:30.287 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.279+0000 7f154b2e5640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f15440c8630 0x7f15440ca2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:30.287 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.279+0000 7f154b2e5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15440c8a70 0x7f15440ca820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:30.287 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.279+0000 7f154b2e5640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f15440c6900 con 0x7f15440c8250 2024-04-25T12:21:30.287 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.279+0000 7f154b2e5640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f154415b400 con 0x7f15440c8a70 2024-04-25T12:21:30.287 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.279+0000 7f154b2e5640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f15440681d0 con 0x7f15440c8630 2024-04-25T12:21:30.287 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.279+0000 7f1549081640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15440c8250 0x7f154415a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:30.287 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.279+0000 7f1549081640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15440c8250 0x7f154415a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55274/0 (socket says 172.21.15.86:55274) 2024-04-25T12:21:30.287 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.279+0000 7f1549081640 1 -- 172.21.15.86:0/770817716 learned_addr learned my addr 172.21.15.86:0/770817716 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:30.287 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.279+0000 7f1548880640 1 --2- 172.21.15.86:0/770817716 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f15440c8630 0x7f15440ca2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:30.287 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.279+0000 7f1549081640 1 -- 172.21.15.86:0/770817716 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f15440c8630 msgr2=0x7f15440ca2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:30.287 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.279+0000 7f1549081640 1 --2- 172.21.15.86:0/770817716 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f15440c8630 0x7f15440ca2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:30.287 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.279+0000 7f1549081640 1 -- 172.21.15.86:0/770817716 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15440c8a70 msgr2=0x7f15440ca820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:30.287 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.279+0000 7f1549882640 1 --2- 172.21.15.86:0/770817716 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15440c8a70 0x7f15440ca820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:30.287 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.279+0000 7f1549081640 1 --2- 172.21.15.86:0/770817716 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15440c8a70 0x7f15440ca820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:30.288 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.279+0000 7f1549081640 1 -- 172.21.15.86:0/770817716 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1544141f70 con 0x7f15440c8250 2024-04-25T12:21:30.288 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.279+0000 7f1548880640 1 --2- 172.21.15.86:0/770817716 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f15440c8630 0x7f15440ca2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:21:30.288 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.279+0000 7f1549081640 1 --2- 172.21.15.86:0/770817716 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15440c8250 0x7f154415a310 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f153c00d800 tx=0x7f153c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:30.288 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.279+0000 7f1541ffb640 1 -- 172.21.15.86:0/770817716 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f153c00b6c0 con 0x7f15440c8250 2024-04-25T12:21:30.288 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.279+0000 7f1541ffb640 1 -- 172.21.15.86:0/770817716 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f153c019070 con 0x7f15440c8250 2024-04-25T12:21:30.288 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.279+0000 7f154b2e5640 1 -- 172.21.15.86:0/770817716 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15441544d0 con 0x7f15440c8250 2024-04-25T12:21:30.288 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.279+0000 7f1541ffb640 1 -- 172.21.15.86:0/770817716 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f153c00ba60 con 0x7f15440c8250 2024-04-25T12:21:30.288 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.279+0000 7f154b2e5640 1 -- 172.21.15.86:0/770817716 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1544154770 con 0x7f15440c8250 2024-04-25T12:21:30.288 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.283+0000 7f154b2e5640 1 -- 172.21.15.86:0/770817716 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1544075df0 con 0x7f15440c8250 2024-04-25T12:21:30.289 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.283+0000 7f1541ffb640 1 -- 172.21.15.86:0/770817716 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f153c00bc00 con 0x7f15440c8250 2024-04-25T12:21:30.289 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.283+0000 7f1541ffb640 1 --2- 172.21.15.86:0/770817716 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f1530068380 0x7f153006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:30.289 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.283+0000 7f1541ffb640 1 -- 172.21.15.86:0/770817716 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f153c087160 con 0x7f15440c8250 2024-04-25T12:21:30.289 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.283+0000 7f1548880640 1 --2- 172.21.15.86:0/770817716 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f1530068380 0x7f153006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:30.289 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.283+0000 7f1548880640 1 --2- 172.21.15.86:0/770817716 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f1530068380 0x7f153006a840 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f15380ae000 tx=0x7f1538008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:30.292 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.287+0000 7f1541ffb640 1 -- 172.21.15.86:0/770817716 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1544141f70 con 0x7f15440c8250 2024-04-25T12:21:30.493 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.487+0000 7f154b2e5640 1 -- 172.21.15.86:0/770817716 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1544071e50 con 0x7f15440c8250 2024-04-25T12:21:30.494 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.491+0000 7f1541ffb640 1 -- 172.21.15.86:0/770817716 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+6834 (secure 0 0 0) 0x7f153c057470 con 0x7f15440c8250 2024-04-25T12:21:30.495 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:21:30.495 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/1969068022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1969068022},{"type":"v1","addr":"172.21.15.86:6835","nonce":1969068022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6838/3213562806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":3213562806},{"type":"v1","addr":"172.21.15.86:6838","nonce":3213562806}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6839/4002713597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6837","nonce":4002713597},{"type":"v1","addr":"172.21.15.86:6839","nonce":4002713597}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4245,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/3114005030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3114005030},{"type":"v1","addr":"172.21.15.134:6833","nonce":3114005030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/1079608447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":1079608447},{"type":"v1","addr":"172.21.15.134:6837","nonce":1079608447}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T12:21:23.459093+0000","modified":"2024-04-25T12:21:30.171156+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6836/3044511437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3044511437},{"type":"v1","addr":"172.21.15.134:6836","nonce":3044511437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4294,"qdb_cluster":[4294]},"id":1}]} 2024-04-25T12:21:30.495 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 7 2024-04-25T12:21:30.497 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.491+0000 7f154b2e5640 1 -- 172.21.15.86:0/770817716 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f1530068380 msgr2=0x7f153006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:30.497 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.491+0000 7f154b2e5640 1 --2- 172.21.15.86:0/770817716 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f1530068380 0x7f153006a840 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f15380ae000 tx=0x7f1538008040 comp rx=0 tx=0).stop 2024-04-25T12:21:30.497 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.491+0000 7f154b2e5640 1 -- 172.21.15.86:0/770817716 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15440c8250 msgr2=0x7f154415a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:30.497 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.491+0000 7f154b2e5640 1 --2- 172.21.15.86:0/770817716 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15440c8250 0x7f154415a310 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f153c00d800 tx=0x7f153c00dcc0 comp rx=0 tx=0).stop 2024-04-25T12:21:30.497 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.491+0000 7f154b2e5640 1 -- 172.21.15.86:0/770817716 shutdown_connections 2024-04-25T12:21:30.497 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.491+0000 7f154b2e5640 1 --2- 172.21.15.86:0/770817716 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15440c8a70 0x7f15440ca820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:30.497 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.491+0000 7f154b2e5640 1 --2- 172.21.15.86:0/770817716 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f15440c8630 0x7f15440ca2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:30.497 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.491+0000 7f154b2e5640 1 --2- 172.21.15.86:0/770817716 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f1530068380 0x7f153006a840 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:30.497 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.491+0000 7f154b2e5640 1 --2- 172.21.15.86:0/770817716 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15440c8250 0x7f154415a310 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:30.497 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.491+0000 7f154b2e5640 1 -- 172.21.15.86:0/770817716 >> 172.21.15.86:0/770817716 conn(0x7f154406b9d0 msgr2=0x7f1544150960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:30.497 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.491+0000 7f154b2e5640 1 -- 172.21.15.86:0/770817716 shutdown_connections 2024-04-25T12:21:30.498 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.491+0000 7f154b2e5640 1 -- 172.21.15.86:0/770817716 wait complete. 2024-04-25T12:21:30.513 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T12:21:30.626 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.623+0000 7f2245c67640 1 Processor -- start 2024-04-25T12:21:30.627 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.623+0000 7f2245c67640 1 -- start start 2024-04-25T12:21:30.628 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.623+0000 7f2245c67640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f224014fbc0 0x7f224006f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:30.628 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.623+0000 7f2245c67640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f224014ffa0 0x7f22400c8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:30.628 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.623+0000 7f2245c67640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22400c5d70 con 0x7f2240074100 2024-04-25T12:21:30.628 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.623+0000 7f2245c67640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f22400c6050 con 0x7f224014ffa0 2024-04-25T12:21:30.628 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.623+0000 7f2245c67640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f22400c6330 con 0x7f224014fbc0 2024-04-25T12:21:30.628 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.623+0000 7f223effd640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f224014ffa0 0x7f22400c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:30.628 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.623+0000 7f223effd640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f224014ffa0 0x7f22400c8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55280/0 (socket says 172.21.15.86:55280) 2024-04-25T12:21:30.628 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.623+0000 7f223effd640 1 -- 172.21.15.86:0/4184398325 learned_addr learned my addr 172.21.15.86:0/4184398325 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:30.629 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.623+0000 7f223f7fe640 1 --2- 172.21.15.86:0/4184398325 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f224014fbc0 0x7f224006f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:30.629 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.623+0000 7f223effd640 1 -- 172.21.15.86:0/4184398325 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f224014fbc0 msgr2=0x7f224006f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:30.629 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.623+0000 7f223effd640 1 --2- 172.21.15.86:0/4184398325 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f224014fbc0 0x7f224006f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:30.629 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.623+0000 7f223effd640 1 -- 172.21.15.86:0/4184398325 >> v1:172.21.15.134:6789/0 conn(0x7f2240074100 legacy=0x7f22400c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:30.629 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.623+0000 7f223effd640 1 -- 172.21.15.86:0/4184398325 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22400c6610 con 0x7f224014ffa0 2024-04-25T12:21:30.629 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.623+0000 7f223f7fe640 1 --2- 172.21.15.86:0/4184398325 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f224014fbc0 0x7f224006f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:21:30.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.623+0000 7f223effd640 1 --2- 172.21.15.86:0/4184398325 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f224014ffa0 0x7f22400c8220 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2230009e50 tx=0x7f223001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ca9045f661cac0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:30.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.623+0000 7f223e7fc640 1 -- 172.21.15.86:0/4184398325 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22300a5890 con 0x7f224014ffa0 2024-04-25T12:21:30.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.623+0000 7f223e7fc640 1 -- 172.21.15.86:0/4184398325 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22300a5a30 con 0x7f224014ffa0 2024-04-25T12:21:30.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.627+0000 7f223e7fc640 1 -- 172.21.15.86:0/4184398325 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22300a5e00 con 0x7f224014ffa0 2024-04-25T12:21:30.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.627+0000 7f2245c67640 1 -- 172.21.15.86:0/4184398325 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f224014ffa0 msgr2=0x7f22400c8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:30.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.627+0000 7f2245c67640 1 --2- 172.21.15.86:0/4184398325 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f224014ffa0 0x7f22400c8220 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2230009e50 tx=0x7f223001c9f0 comp rx=0 tx=0).stop 2024-04-25T12:21:30.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.627+0000 7f2245c67640 1 -- 172.21.15.86:0/4184398325 shutdown_connections 2024-04-25T12:21:30.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.627+0000 7f2245c67640 1 --2- 172.21.15.86:0/4184398325 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f224014ffa0 0x7f22400c8220 secure :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2230009e50 tx=0x7f223001c9f0 comp rx=0 tx=0).stop 2024-04-25T12:21:30.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.627+0000 7f2245c67640 1 --2- 172.21.15.86:0/4184398325 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f224014fbc0 0x7f224006f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:30.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.627+0000 7f2245c67640 1 -- 172.21.15.86:0/4184398325 >> 172.21.15.86:0/4184398325 conn(0x7f224006b9d0 msgr2=0x7f224006bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:30.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.627+0000 7f2245c67640 1 -- 172.21.15.86:0/4184398325 shutdown_connections 2024-04-25T12:21:30.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.627+0000 7f2245c67640 1 -- 172.21.15.86:0/4184398325 wait complete. 2024-04-25T12:21:30.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.627+0000 7f2245c67640 1 Processor -- start 2024-04-25T12:21:30.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.627+0000 7f2245c67640 1 -- start start 2024-04-25T12:21:30.634 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.627+0000 7f2245c67640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2240074100 0x7f22401527f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:30.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.627+0000 7f2245c67640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f224014fbc0 0x7f22401f37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:30.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.627+0000 7f2245c67640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2240153060 0x7f22401f3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:30.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.627+0000 7f2245c67640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f2240166420 con 0x7f224014fbc0 2024-04-25T12:21:30.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.627+0000 7f2245c67640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f22401662a0 con 0x7f2240153060 2024-04-25T12:21:30.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.627+0000 7f2245c67640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f22401665a0 con 0x7f2240074100 2024-04-25T12:21:30.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.627+0000 7f223effd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f224014fbc0 0x7f22401f37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:30.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.627+0000 7f223effd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f224014fbc0 0x7f22401f37c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55292/0 (socket says 172.21.15.86:55292) 2024-04-25T12:21:30.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.627+0000 7f223effd640 1 -- 172.21.15.86:0/3289002363 learned_addr learned my addr 172.21.15.86:0/3289002363 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:30.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.627+0000 7f223f7fe640 1 --2- 172.21.15.86:0/3289002363 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2240074100 0x7f22401527f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:30.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.627+0000 7f223effd640 1 -- 172.21.15.86:0/3289002363 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2240074100 msgr2=0x7f22401527f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:30.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.627+0000 7f223effd640 1 --2- 172.21.15.86:0/3289002363 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2240074100 0x7f22401527f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:30.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.627+0000 7f223effd640 1 -- 172.21.15.86:0/3289002363 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2240153060 msgr2=0x7f22401f3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:30.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.627+0000 7f223ffff640 1 --2- 172.21.15.86:0/3289002363 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2240153060 0x7f22401f3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:30.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.627+0000 7f223effd640 1 --2- 172.21.15.86:0/3289002363 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2240153060 0x7f22401f3d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:30.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.627+0000 7f223effd640 1 -- 172.21.15.86:0/3289002363 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f224014d340 con 0x7f224014fbc0 2024-04-25T12:21:30.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.627+0000 7f223f7fe640 1 --2- 172.21.15.86:0/3289002363 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2240074100 0x7f22401527f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:21:30.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.627+0000 7f223effd640 1 --2- 172.21.15.86:0/3289002363 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f224014fbc0 0x7f22401f37c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f223001d290 tx=0x7f2230019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:30.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.627+0000 7f2227fff640 1 -- 172.21.15.86:0/3289002363 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22300b8680 con 0x7f224014fbc0 2024-04-25T12:21:30.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.627+0000 7f2227fff640 1 -- 172.21.15.86:0/3289002363 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22300b8840 con 0x7f224014fbc0 2024-04-25T12:21:30.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.627+0000 7f2245c67640 1 -- 172.21.15.86:0/3289002363 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22401f5b10 con 0x7f224014fbc0 2024-04-25T12:21:30.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.627+0000 7f2227fff640 1 -- 172.21.15.86:0/3289002363 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22300b8c30 con 0x7f224014fbc0 2024-04-25T12:21:30.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.627+0000 7f2245c67640 1 -- 172.21.15.86:0/3289002363 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22401f60d0 con 0x7f224014fbc0 2024-04-25T12:21:30.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.631+0000 7f2245c67640 1 -- 172.21.15.86:0/3289002363 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2240075df0 con 0x7f224014fbc0 2024-04-25T12:21:30.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.631+0000 7f2227fff640 1 -- 172.21.15.86:0/3289002363 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f22300c0020 con 0x7f224014fbc0 2024-04-25T12:21:30.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.631+0000 7f2227fff640 1 --2- 172.21.15.86:0/3289002363 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f222c068380 0x7f222c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:30.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.631+0000 7f2227fff640 1 -- 172.21.15.86:0/3289002363 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f2230121800 con 0x7f224014fbc0 2024-04-25T12:21:30.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.631+0000 7f223f7fe640 1 --2- 172.21.15.86:0/3289002363 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f222c068380 0x7f222c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:30.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.631+0000 7f223f7fe640 1 --2- 172.21.15.86:0/3289002363 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f222c068380 0x7f222c06a840 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2234008890 tx=0x7f2234008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:30.640 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.635+0000 7f2227fff640 1 -- 172.21.15.86:0/3289002363 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f22300c7020 con 0x7f224014fbc0 2024-04-25T12:21:30.796 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.791+0000 7f2245c67640 1 -- 172.21.15.86:0/3289002363 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f224014eff0 con 0x7f224014fbc0 2024-04-25T12:21:30.798 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.791+0000 7f2227fff640 1 -- 172.21.15.86:0/3289002363 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18514 (secure 0 0 0) 0x7f22300165e0 con 0x7f224014fbc0 2024-04-25T12:21:30.798 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:21:30.799 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":24,"fsid":"f2ef5c0c-9576-4650-b4f7-6cb14247f62a","created":"2024-04-25T12:20:59.241733+0000","modified":"2024-04-25T12:21:28.541128+0000","last_up_change":"2024-04-25T12:21:10.939617+0000","last_in_change":"2024-04-25T12:21:01.534145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T12:21:11.839922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T12:21:21.854040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T12:21:22.406060+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T12:21:26.152386+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1f713f00-ef9f-4a6f-a620-38a8a1f8a822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6801","nonce":2812764579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6803","nonce":2812764579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6807","nonce":2812764579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6805","nonce":2812764579}]},"public_addr":"172.21.15.86:6801/2812764579","cluster_addr":"172.21.15.86:6803/2812764579","heartbeat_back_addr":"172.21.15.86:6807/2812764579","heartbeat_front_addr":"172.21.15.86:6805/2812764579","state":["exists","up"]},{"osd":1,"uuid":"baf6606d-a556-4fbe-a930-855e04ff1534","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6809","nonce":467966038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6811","nonce":467966038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6815","nonce":467966038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6813","nonce":467966038}]},"public_addr":"172.21.15.86:6809/467966038","cluster_addr":"172.21.15.86:6811/467966038","heartbeat_back_addr":"172.21.15.86:6815/467966038","heartbeat_front_addr":"172.21.15.86:6813/467966038","state":["exists","up"]},{"osd":2,"uuid":"c983d68e-6d60-434f-aed6-108420c5dd09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6817","nonce":3279762843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6820","nonce":3279762843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6825","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6827","nonce":3279762843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6824","nonce":3279762843}]},"public_addr":"172.21.15.86:6817/3279762843","cluster_addr":"172.21.15.86:6820/3279762843","heartbeat_back_addr":"172.21.15.86:6827/3279762843","heartbeat_front_addr":"172.21.15.86:6824/3279762843","state":["exists","up"]},{"osd":3,"uuid":"e77657bb-45aa-43bf-ab41-c7377eb495ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6821","nonce":2861354413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6826","nonce":2861354413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6831","nonce":2861354413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6829","nonce":2861354413}]},"public_addr":"172.21.15.86:6821/2861354413","cluster_addr":"172.21.15.86:6826/2861354413","heartbeat_back_addr":"172.21.15.86:6831/2861354413","heartbeat_front_addr":"172.21.15.86:6829/2861354413","state":["exists","up"]},{"osd":4,"uuid":"252bd300-d75a-4b00-be4b-27e6b51de4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6802","nonce":1872913602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6805","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6808","nonce":1872913602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6815","nonce":1872913602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6813","nonce":1872913602}]},"public_addr":"172.21.15.134:6802/1872913602","cluster_addr":"172.21.15.134:6808/1872913602","heartbeat_back_addr":"172.21.15.134:6815/1872913602","heartbeat_front_addr":"172.21.15.134:6813/1872913602","state":["exists","up"]},{"osd":5,"uuid":"4135da3f-7427-4409-a48e-78bd8a7b46ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6801","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6803","nonce":2261413981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6806","nonce":2261413981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6812","nonce":2261413981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6809","nonce":2261413981}]},"public_addr":"172.21.15.134:6803/2261413981","cluster_addr":"172.21.15.134:6806/2261413981","heartbeat_back_addr":"172.21.15.134:6812/2261413981","heartbeat_front_addr":"172.21.15.134:6809/2261413981","state":["exists","up"]},{"osd":6,"uuid":"b6e7a5f1-fa7e-497d-abac-a19994d26820","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6825","nonce":2841082767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6827","nonce":2841082767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6831","nonce":2841082767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6829","nonce":2841082767}]},"public_addr":"172.21.15.134:6825/2841082767","cluster_addr":"172.21.15.134:6827/2841082767","heartbeat_back_addr":"172.21.15.134:6831/2841082767","heartbeat_front_addr":"172.21.15.134:6829/2841082767","state":["exists","up"]},{"osd":7,"uuid":"c5597e50-1962-4103-9124-dd7bceb8ac97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6817","nonce":1277404274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6819","nonce":1277404274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6823","nonce":1277404274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6821","nonce":1277404274}]},"public_addr":"172.21.15.134:6817/1277404274","cluster_addr":"172.21.15.134:6819/1277404274","heartbeat_back_addr":"172.21.15.134:6823/1277404274","heartbeat_front_addr":"172.21.15.134:6821/1277404274","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.018125+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.157958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.113619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.136904+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.844514+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.872629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.775339+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.822867+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T12:21:30.800 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.795+0000 7f2245c67640 1 -- 172.21.15.86:0/3289002363 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f222c068380 msgr2=0x7f222c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:30.800 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.795+0000 7f2245c67640 1 --2- 172.21.15.86:0/3289002363 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f222c068380 0x7f222c06a840 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2234008890 tx=0x7f2234008040 comp rx=0 tx=0).stop 2024-04-25T12:21:30.800 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.795+0000 7f2245c67640 1 -- 172.21.15.86:0/3289002363 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f224014fbc0 msgr2=0x7f22401f37c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:30.800 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.795+0000 7f2245c67640 1 --2- 172.21.15.86:0/3289002363 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f224014fbc0 0x7f22401f37c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f223001d290 tx=0x7f2230019790 comp rx=0 tx=0).stop 2024-04-25T12:21:30.800 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.795+0000 7f2245c67640 1 -- 172.21.15.86:0/3289002363 shutdown_connections 2024-04-25T12:21:30.801 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.795+0000 7f2245c67640 1 --2- 172.21.15.86:0/3289002363 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2240153060 0x7f22401f3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:30.801 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.795+0000 7f2245c67640 1 --2- 172.21.15.86:0/3289002363 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f222c068380 0x7f222c06a840 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:30.801 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.795+0000 7f2245c67640 1 --2- 172.21.15.86:0/3289002363 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f224014fbc0 0x7f22401f37c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:30.801 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.795+0000 7f2245c67640 1 --2- 172.21.15.86:0/3289002363 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2240074100 0x7f22401527f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:30.801 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.795+0000 7f2245c67640 1 -- 172.21.15.86:0/3289002363 >> 172.21.15.86:0/3289002363 conn(0x7f224006b9d0 msgr2=0x7f224006c410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:30.801 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.795+0000 7f2245c67640 1 -- 172.21.15.86:0/3289002363 shutdown_connections 2024-04-25T12:21:30.801 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:30.795+0000 7f2245c67640 1 -- 172.21.15.86:0/3289002363 wait complete. 2024-04-25T12:21:31.419 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T12:21:23.459093+0000', 'modified': '2024-04-25T12:21:30.171156+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4294}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4294': {'gid': 4294, 'name': 'f', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.134:6836/3044511437', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6834', 'nonce': 3044511437}, {'type': 'v1', 'addr': '172.21.15.134:6836', 'nonce': 3044511437}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4294, 'qdb_cluster': [4294]} 2024-04-25T12:21:31.420 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T12:21:31.420 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-04-25T12:21:31.548 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.543+0000 7f5233c68640 1 Processor -- start 2024-04-25T12:21:31.548 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.543+0000 7f5233c68640 1 -- start start 2024-04-25T12:21:31.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.543+0000 7f5233c68640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f522c14fbc0 0x7f522c06f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:31.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.543+0000 7f5233c68640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f522c074100 0x7f522c0c7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:31.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.543+0000 7f5233c68640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f522c0c5d70 con 0x7f522c14ffa0 2024-04-25T12:21:31.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.543+0000 7f5233c68640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f522c0c6050 con 0x7f522c074100 2024-04-25T12:21:31.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.543+0000 7f5233c68640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f522c0c6330 con 0x7f522c14fbc0 2024-04-25T12:21:31.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.543+0000 7f5232205640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f522c074100 0x7f522c0c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:31.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.543+0000 7f5232205640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f522c074100 0x7f522c0c7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55306/0 (socket says 172.21.15.86:55306) 2024-04-25T12:21:31.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.543+0000 7f5232205640 1 -- 172.21.15.86:0/786504028 learned_addr learned my addr 172.21.15.86:0/786504028 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:31.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.543+0000 7f5231a04640 1 --2- 172.21.15.86:0/786504028 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f522c14fbc0 0x7f522c06f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:31.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.543+0000 7f5232205640 1 -- 172.21.15.86:0/786504028 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f522c14fbc0 msgr2=0x7f522c06f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:31.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.543+0000 7f5232205640 1 --2- 172.21.15.86:0/786504028 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f522c14fbc0 0x7f522c06f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:31.551 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.543+0000 7f5232205640 1 -- 172.21.15.86:0/786504028 >> v1:172.21.15.86:6789/0 conn(0x7f522c14ffa0 legacy=0x7f522c0c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:31.551 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.543+0000 7f5230a02640 1 -- 172.21.15.86:0/786504028 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1932641701 0 0) 0x7f522c0c5d70 con 0x7f522c14ffa0 2024-04-25T12:21:31.551 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.543+0000 7f5232205640 1 -- 172.21.15.86:0/786504028 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f522c0c6610 con 0x7f522c074100 2024-04-25T12:21:31.552 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.547+0000 7f5232205640 1 --2- 172.21.15.86:0/786504028 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f522c074100 0x7f522c0c7250 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5224009e50 tx=0x7f522401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25bf2a61bbf2ceb3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:31.552 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.547+0000 7f5230a02640 1 -- 172.21.15.86:0/786504028 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52240a5920 con 0x7f522c074100 2024-04-25T12:21:31.552 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.547+0000 7f5230a02640 1 -- 172.21.15.86:0/786504028 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52240a5ac0 con 0x7f522c074100 2024-04-25T12:21:31.552 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.547+0000 7f5230a02640 1 -- 172.21.15.86:0/786504028 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52240ad3f0 con 0x7f522c074100 2024-04-25T12:21:31.553 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.547+0000 7f5233c68640 1 -- 172.21.15.86:0/786504028 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f522c074100 msgr2=0x7f522c0c7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:31.553 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.547+0000 7f5233c68640 1 --2- 172.21.15.86:0/786504028 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f522c074100 0x7f522c0c7250 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5224009e50 tx=0x7f522401ca30 comp rx=0 tx=0).stop 2024-04-25T12:21:31.553 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.547+0000 7f5233c68640 1 -- 172.21.15.86:0/786504028 shutdown_connections 2024-04-25T12:21:31.553 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.547+0000 7f5233c68640 1 --2- 172.21.15.86:0/786504028 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f522c074100 0x7f522c0c7250 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:31.554 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.547+0000 7f5233c68640 1 --2- 172.21.15.86:0/786504028 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f522c14fbc0 0x7f522c06f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:31.554 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.547+0000 7f5233c68640 1 -- 172.21.15.86:0/786504028 >> 172.21.15.86:0/786504028 conn(0x7f522c06b9d0 msgr2=0x7f522c06bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:31.554 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.547+0000 7f5233c68640 1 -- 172.21.15.86:0/786504028 shutdown_connections 2024-04-25T12:21:31.554 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.547+0000 7f5233c68640 1 -- 172.21.15.86:0/786504028 wait complete. 2024-04-25T12:21:31.556 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.547+0000 7f5233c68640 1 Processor -- start 2024-04-25T12:21:31.556 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.547+0000 7f5233c68640 1 -- start start 2024-04-25T12:21:31.556 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.551+0000 7f5233c68640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f522c074100 0x7f522c141190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:31.556 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.551+0000 7f5233c68640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f522c14fbc0 0x7f522c13fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:31.556 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.551+0000 7f5233c68640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f522c14ffa0 0x7f522c1403b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:31.556 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.551+0000 7f5233c68640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f522c0c8ab0 con 0x7f522c14ffa0 2024-04-25T12:21:31.556 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.551+0000 7f5233c68640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f522c0c8930 con 0x7f522c14fbc0 2024-04-25T12:21:31.556 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.551+0000 7f5233c68640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f522c166090 con 0x7f522c074100 2024-04-25T12:21:31.557 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.551+0000 7f5232205640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f522c14ffa0 0x7f522c1403b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:31.557 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.551+0000 7f5232205640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f522c14ffa0 0x7f522c1403b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55314/0 (socket says 172.21.15.86:55314) 2024-04-25T12:21:31.557 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.551+0000 7f5232205640 1 -- 172.21.15.86:0/4093440831 learned_addr learned my addr 172.21.15.86:0/4093440831 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:31.557 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.551+0000 7f5231a04640 1 --2- 172.21.15.86:0/4093440831 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f522c074100 0x7f522c141190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:31.557 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.551+0000 7f5232205640 1 -- 172.21.15.86:0/4093440831 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f522c074100 msgr2=0x7f522c141190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:31.557 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.551+0000 7f5232205640 1 --2- 172.21.15.86:0/4093440831 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f522c074100 0x7f522c141190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:31.557 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.551+0000 7f5232205640 1 -- 172.21.15.86:0/4093440831 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f522c14fbc0 msgr2=0x7f522c13fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:31.557 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.551+0000 7f5232205640 1 --2- 172.21.15.86:0/4093440831 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f522c14fbc0 0x7f522c13fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:31.557 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.551+0000 7f5232205640 1 -- 172.21.15.86:0/4093440831 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f522c15a3f0 con 0x7f522c14ffa0 2024-04-25T12:21:31.557 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.551+0000 7f5232205640 1 --2- 172.21.15.86:0/4093440831 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f522c14ffa0 0x7f522c1403b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5224009e50 tx=0x7f52240197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:31.557 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.551+0000 7f52227fc640 1 -- 172.21.15.86:0/4093440831 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52240a5920 con 0x7f522c14ffa0 2024-04-25T12:21:31.557 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.551+0000 7f52227fc640 1 -- 172.21.15.86:0/4093440831 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52240090d0 con 0x7f522c14ffa0 2024-04-25T12:21:31.557 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.551+0000 7f52227fc640 1 -- 172.21.15.86:0/4093440831 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5224009510 con 0x7f522c14ffa0 2024-04-25T12:21:31.557 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.551+0000 7f5233c68640 1 -- 172.21.15.86:0/4093440831 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f522c15bc40 con 0x7f522c14ffa0 2024-04-25T12:21:31.557 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.551+0000 7f5233c68640 1 -- 172.21.15.86:0/4093440831 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f522c15bec0 con 0x7f522c14ffa0 2024-04-25T12:21:31.558 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.551+0000 7f52227fc640 1 -- 172.21.15.86:0/4093440831 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f52240c0020 con 0x7f522c14ffa0 2024-04-25T12:21:31.559 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.551+0000 7f52227fc640 1 --2- 172.21.15.86:0/4093440831 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f5210068380 0x7f521006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:31.559 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.551+0000 7f52227fc640 1 -- 172.21.15.86:0/4093440831 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f52241218e0 con 0x7f522c14ffa0 2024-04-25T12:21:31.559 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.551+0000 7f5231a04640 1 --2- 172.21.15.86:0/4093440831 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f5210068380 0x7f521006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:31.559 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.551+0000 7f5231a04640 1 --2- 172.21.15.86:0/4093440831 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f5210068380 0x7f521006a840 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5228009790 tx=0x7f5228008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:31.559 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.555+0000 7f5236dea000 1 Processor -- start 2024-04-25T12:21:31.559 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.555+0000 7f5236dea000 1 -- start start 2024-04-25T12:21:31.561 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.555+0000 7f5236dea000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d49fd9fd0 0x562d49fda3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:31.561 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.555+0000 7f5236dea000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562d49fde080 0x562d49fde460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:31.561 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.555+0000 7f5236dea000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562d49fde9a0 0x562d49fded80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:31.561 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.555+0000 7f5236dea000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x562d49dec420 con 0x562d49fd9fd0 2024-04-25T12:21:31.562 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.555+0000 7f5236dea000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x562d49d86bf0 con 0x562d49fde080 2024-04-25T12:21:31.562 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.555+0000 7f5236dea000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x562d49de83e0 con 0x562d49fde9a0 2024-04-25T12:21:31.562 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.555+0000 7f5231a04640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d49fd9fd0 0x562d49fda3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:31.562 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.555+0000 7f5231a04640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d49fd9fd0 0x562d49fda3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55318/0 (socket says 172.21.15.86:55318) 2024-04-25T12:21:31.562 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.555+0000 7f5231a04640 1 -- 172.21.15.86:0/2091305581 learned_addr learned my addr 172.21.15.86:0/2091305581 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:31.562 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.555+0000 7f5232205640 1 --2- 172.21.15.86:0/2091305581 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562d49fde9a0 0x562d49fded80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:31.562 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.555+0000 7f5231a04640 1 -- 172.21.15.86:0/2091305581 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562d49fde9a0 msgr2=0x562d49fded80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:31.562 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.555+0000 7f5231a04640 1 --2- 172.21.15.86:0/2091305581 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562d49fde9a0 0x562d49fded80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:31.562 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.555+0000 7f5231a04640 1 -- 172.21.15.86:0/2091305581 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562d49fde080 msgr2=0x562d49fde460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:31.562 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.555+0000 7f5231203640 1 --2- 172.21.15.86:0/2091305581 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562d49fde080 0x562d49fde460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:31.562 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.555+0000 7f5231a04640 1 --2- 172.21.15.86:0/2091305581 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562d49fde080 0x562d49fde460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:31.562 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.555+0000 7f5231a04640 1 -- 172.21.15.86:0/2091305581 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d49e94450 con 0x562d49fd9fd0 2024-04-25T12:21:31.562 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.555+0000 7f5231a04640 1 --2- 172.21.15.86:0/2091305581 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d49fd9fd0 0x562d49fda3b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f522800e920 tx=0x7f5228011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b246b990b9699af9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:31.562 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.555+0000 7f520f7fe640 1 -- 172.21.15.86:0/2091305581 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5228025070 con 0x562d49fd9fd0 2024-04-25T12:21:31.563 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.555+0000 7f520f7fe640 1 -- 172.21.15.86:0/2091305581 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5228015700 con 0x562d49fd9fd0 2024-04-25T12:21:31.563 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.555+0000 7f520f7fe640 1 -- 172.21.15.86:0/2091305581 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f522800f040 con 0x562d49fd9fd0 2024-04-25T12:21:31.563 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.555+0000 7f5236dea000 1 -- 172.21.15.86:0/2091305581 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d49fd9fd0 msgr2=0x562d49fda3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:31.563 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.555+0000 7f5236dea000 1 --2- 172.21.15.86:0/2091305581 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d49fd9fd0 0x562d49fda3b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f522800e920 tx=0x7f5228011000 comp rx=0 tx=0).stop 2024-04-25T12:21:31.563 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.555+0000 7f5236dea000 1 -- 172.21.15.86:0/2091305581 shutdown_connections 2024-04-25T12:21:31.563 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.555+0000 7f5236dea000 1 --2- 172.21.15.86:0/2091305581 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562d49fde9a0 0x562d49fded80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:31.563 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.555+0000 7f5236dea000 1 --2- 172.21.15.86:0/2091305581 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562d49fde080 0x562d49fde460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:31.563 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.555+0000 7f5236dea000 1 --2- 172.21.15.86:0/2091305581 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d49fd9fd0 0x562d49fda3b0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:31.563 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.555+0000 7f5236dea000 1 -- 172.21.15.86:0/2091305581 >> 172.21.15.86:0/2091305581 conn(0x562d49fdae40 msgr2=0x562d49fdd260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:31.563 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.555+0000 7f5236dea000 1 -- 172.21.15.86:0/2091305581 shutdown_connections 2024-04-25T12:21:31.563 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.555+0000 7f5236dea000 1 -- 172.21.15.86:0/2091305581 wait complete. 2024-04-25T12:21:31.563 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.555+0000 7f5236dea000 1 -- start start 2024-04-25T12:21:31.563 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.555+0000 7f5236dea000 1 Processor -- start 2024-04-25T12:21:31.566 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.555+0000 7f5236dea000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562d49fd9fd0 0x562d49fe12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:31.566 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.555+0000 7f5236dea000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d49fde080 0x562d49fe17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:31.566 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.555+0000 7f5236dea000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562d49fde9a0 0x562d49fe1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:31.566 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.555+0000 7f5236dea000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x562d49d8cec0 con 0x562d49fde080 2024-04-25T12:21:31.566 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.555+0000 7f5236dea000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x562d49e6d120 con 0x562d49fde9a0 2024-04-25T12:21:31.566 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.555+0000 7f5236dea000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x562d49df7350 con 0x562d49fd9fd0 2024-04-25T12:21:31.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.555+0000 7f5236dea000 10 client.0 _ll_register_callbacks cb 0x562d49dc94d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T12:21:31.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.555+0000 7f5231203640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d49fde080 0x562d49fe17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:31.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.555+0000 7f5231203640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d49fde080 0x562d49fe17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55324/0 (socket says 172.21.15.86:55324) 2024-04-25T12:21:31.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.555+0000 7f5231203640 1 -- 172.21.15.86:0/1731181556 learned_addr learned my addr 172.21.15.86:0/1731181556 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:31.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.559+0000 7f5231a04640 1 --2- 172.21.15.86:0/1731181556 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562d49fd9fd0 0x562d49fe12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:31.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.559+0000 7f5232205640 1 --2- 172.21.15.86:0/1731181556 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562d49fde9a0 0x562d49fe1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:31.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.559+0000 7f5231203640 1 -- 172.21.15.86:0/1731181556 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562d49fd9fd0 msgr2=0x562d49fe12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:31.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.559+0000 7f5231203640 1 --2- 172.21.15.86:0/1731181556 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562d49fd9fd0 0x562d49fe12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:31.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.559+0000 7f5231203640 1 -- 172.21.15.86:0/1731181556 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562d49fde9a0 msgr2=0x562d49fe1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:31.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.559+0000 7f5231203640 1 --2- 172.21.15.86:0/1731181556 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562d49fde9a0 0x562d49fe1d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:31.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.559+0000 7f5231203640 1 -- 172.21.15.86:0/1731181556 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d49e31f80 con 0x562d49fde080 2024-04-25T12:21:31.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.559+0000 7f5231a04640 1 --2- 172.21.15.86:0/1731181556 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562d49fd9fd0 0x562d49fe12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:21:31.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.559+0000 7f5231203640 1 --2- 172.21.15.86:0/1731181556 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d49fde080 0x562d49fe17e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f521c001d10 tx=0x7f521c00d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=330ed355d86ed088 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:31.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.559+0000 7f520cff9640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-04-25T12:21:31.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.559+0000 7f520cff9640 1 -- 172.21.15.86:0/1731181556 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f521c018060 con 0x562d49fde080 2024-04-25T12:21:31.568 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.559+0000 7f520cff9640 1 -- 172.21.15.86:0/1731181556 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f521c0052d0 con 0x562d49fde080 2024-04-25T12:21:31.568 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.559+0000 7f5236dea000 1 -- 172.21.15.86:0/1731181556 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5228015700 con 0x562d49fde080 2024-04-25T12:21:31.568 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.559+0000 7f520cff9640 1 -- 172.21.15.86:0/1731181556 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f521c01e050 con 0x562d49fde080 2024-04-25T12:21:31.568 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.559+0000 7f5236dea000 10 client.4401 fetch_fsmap learned FSMap version 7 2024-04-25T12:21:31.568 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.559+0000 7f5236dea000 1 -- 172.21.15.86:0/1731181556 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x562d49dc5f00 con 0x562d49fde080 2024-04-25T12:21:31.568 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.559+0000 7f520cff9640 1 -- 172.21.15.86:0/1731181556 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5228015700 con 0x562d49fde080 2024-04-25T12:21:31.568 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.559+0000 7f520cff9640 1 -- 172.21.15.86:0/1731181556 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 7) ==== 4712+0+0 (secure 0 0 0) 0x7f521c021020 con 0x562d49fde080 2024-04-25T12:21:31.568 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.559+0000 7f5236dea000 10 client.4401 fetch_fsmap finished waiting for FSMap version 7 2024-04-25T12:21:31.568 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.559+0000 7f5236dea000 10 client.4401 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-25T12:21:31.568 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.559+0000 7f5236dea000 20 client.4401 populate_metadata read hostname 'smithi086' 2024-04-25T12:21:31.568 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.559+0000 7f5236dea000 1 --2- 172.21.15.86:0/1731181556 >> [v2:172.21.15.134:6834/3044511437,v1:172.21.15.134:6836/3044511437] conn(0x562d49fe2730 0x562d49ff95e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:31.568 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.559+0000 7f5236dea000 4 client.4401 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T12:21:31.568 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.559+0000 7f5236dea000 1 -- 172.21.15.86:0/1731181556 --> [v2:172.21.15.134:6834/3044511437,v1:172.21.15.134:6836/3044511437] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562d49d85bc0 con 0x562d49fe2730 2024-04-25T12:21:31.568 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.559+0000 7f5231a04640 1 --2- 172.21.15.86:0/1731181556 >> [v2:172.21.15.134:6834/3044511437,v1:172.21.15.134:6836/3044511437] conn(0x562d49fe2730 0x562d49ff95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:31.568 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.559+0000 7f520cff9640 10 client.4401 ms_handle_connect on v2:172.21.15.134:6834/3044511437 2024-04-25T12:21:31.568 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:31.559+0000 7f5231a04640 1 --2- 172.21.15.86:0/1731181556 >> [v2:172.21.15.134:6834/3044511437,v1:172.21.15.134:6836/3044511437] conn(0x562d49fe2730 0x562d49ff95e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2db4852e96825a5 server_cookie=c0003bb71ea33d55 in_seq=0 out_seq=0 2024-04-25T12:21:35.178 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.175+0000 7f520cff9640 1 -- 172.21.15.86:0/1731181556 <== mds.0 v2:172.21.15.134:6834/3044511437 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x562d49d85bc0 con 0x562d49fe2730 2024-04-25T12:21:35.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.175+0000 7f520cff9640 10 client.4401 handle_command_reply: tid=0 2024-04-25T12:21:35.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.175+0000 7f5236dea000 1 client.4401 shutdown 2024-04-25T12:21:35.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.175+0000 7f5236dea000 1 -- 172.21.15.86:0/1731181556 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d49fde080 msgr2=0x562d49fe17e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:35.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.175+0000 7f5236dea000 1 --2- 172.21.15.86:0/1731181556 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d49fde080 0x562d49fe17e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f521c001d10 tx=0x7f521c00d520 comp rx=0 tx=0).stop 2024-04-25T12:21:35.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.175+0000 7f5236dea000 1 -- 172.21.15.86:0/1731181556 shutdown_connections 2024-04-25T12:21:35.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.175+0000 7f5236dea000 1 --2- 172.21.15.86:0/1731181556 >> [v2:172.21.15.134:6834/3044511437,v1:172.21.15.134:6836/3044511437] conn(0x562d49fe2730 0x562d49ff95e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:35.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.175+0000 7f5236dea000 1 --2- 172.21.15.86:0/1731181556 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562d49fde9a0 0x562d49fe1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:35.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.175+0000 7f520cff9640 0 client.4401 ms_handle_reset on v2:172.21.15.134:6834/3044511437 2024-04-25T12:21:35.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.175+0000 7f5236dea000 1 --2- 172.21.15.86:0/1731181556 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d49fde080 0x562d49fe17e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:35.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.175+0000 7f5236dea000 1 --2- 172.21.15.86:0/1731181556 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562d49fd9fd0 0x562d49fe12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:35.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.175+0000 7f5236dea000 1 -- 172.21.15.86:0/1731181556 >> 172.21.15.86:0/1731181556 conn(0x562d49fdae40 msgr2=0x562d49fdd230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:35.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.175+0000 7f5236dea000 1 -- 172.21.15.86:0/1731181556 shutdown_connections 2024-04-25T12:21:35.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.175+0000 7f5236dea000 1 -- 172.21.15.86:0/1731181556 wait complete. 2024-04-25T12:21:35.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.175+0000 7f5236dea000 20 client.4401 trim_cache size 0 max 16384 2024-04-25T12:21:35.201 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.195+0000 7f5236dea000 1 Processor -- start 2024-04-25T12:21:35.201 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.195+0000 7f5236dea000 1 -- start start 2024-04-25T12:21:35.203 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.195+0000 7f5236dea000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562d49fd9fd0 0x562d49fd9390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:35.204 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.195+0000 7f5236dea000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d49fde9a0 0x562d49fd98d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:35.204 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.199+0000 7f5236dea000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562d49fe0250 0x562d49fe0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:35.204 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.199+0000 7f5236dea000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f522c1fca20 con 0x562d49fde9a0 2024-04-25T12:21:35.204 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.199+0000 7f5236dea000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f522c0cbe80 con 0x562d49fe0250 2024-04-25T12:21:35.204 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.199+0000 7f5236dea000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f522c1fc3d0 con 0x562d49fd9fd0 2024-04-25T12:21:35.204 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.199+0000 7f5231203640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d49fde9a0 0x562d49fd98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:35.204 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.199+0000 7f5231203640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d49fde9a0 0x562d49fd98d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:45858/0 (socket says 172.21.15.86:45858) 2024-04-25T12:21:35.204 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.199+0000 7f5231203640 1 -- 172.21.15.86:0/140443554 learned_addr learned my addr 172.21.15.86:0/140443554 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:35.204 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.199+0000 7f5231a04640 1 --2- 172.21.15.86:0/140443554 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562d49fd9fd0 0x562d49fd9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:35.204 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.199+0000 7f5232205640 1 --2- 172.21.15.86:0/140443554 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562d49fe0250 0x562d49fe0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:35.204 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.199+0000 7f5231203640 1 -- 172.21.15.86:0/140443554 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562d49fd9fd0 msgr2=0x562d49fd9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:35.204 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.199+0000 7f5231203640 1 --2- 172.21.15.86:0/140443554 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562d49fd9fd0 0x562d49fd9390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:35.204 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.199+0000 7f5231203640 1 -- 172.21.15.86:0/140443554 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562d49fe0250 msgr2=0x562d49fe0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:35.204 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.199+0000 7f5231203640 1 --2- 172.21.15.86:0/140443554 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562d49fe0250 0x562d49fe0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:35.205 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.199+0000 7f5231203640 1 -- 172.21.15.86:0/140443554 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d49d72e80 con 0x562d49fde9a0 2024-04-25T12:21:35.205 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.199+0000 7f5231203640 1 --2- 172.21.15.86:0/140443554 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d49fde9a0 0x562d49fd98d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f521c001620 tx=0x7f521c00b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6c52c23da984923 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:35.205 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.199+0000 7f520effd640 1 -- 172.21.15.86:0/140443554 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f521c018070 con 0x562d49fde9a0 2024-04-25T12:21:35.205 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.199+0000 7f520effd640 1 -- 172.21.15.86:0/140443554 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f521c026030 con 0x562d49fde9a0 2024-04-25T12:21:35.205 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.199+0000 7f520effd640 1 -- 172.21.15.86:0/140443554 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f521c0052d0 con 0x562d49fde9a0 2024-04-25T12:21:35.208 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.199+0000 7f5236dea000 1 -- 172.21.15.86:0/140443554 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d49fde9a0 msgr2=0x562d49fd98d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:35.208 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.199+0000 7f5236dea000 1 --2- 172.21.15.86:0/140443554 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d49fde9a0 0x562d49fd98d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f521c001620 tx=0x7f521c00b000 comp rx=0 tx=0).stop 2024-04-25T12:21:35.208 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.199+0000 7f5236dea000 1 -- 172.21.15.86:0/140443554 shutdown_connections 2024-04-25T12:21:35.208 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.199+0000 7f5236dea000 1 --2- 172.21.15.86:0/140443554 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562d49fe0250 0x562d49fe0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:35.208 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.199+0000 7f5236dea000 1 --2- 172.21.15.86:0/140443554 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d49fde9a0 0x562d49fd98d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:35.209 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.199+0000 7f5236dea000 1 --2- 172.21.15.86:0/140443554 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562d49fd9fd0 0x562d49fd9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:35.209 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.199+0000 7f5236dea000 1 -- 172.21.15.86:0/140443554 >> 172.21.15.86:0/140443554 conn(0x562d49fdae40 msgr2=0x562d49fe1890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:35.209 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.199+0000 7f5236dea000 1 -- 172.21.15.86:0/140443554 shutdown_connections 2024-04-25T12:21:35.209 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.199+0000 7f5236dea000 1 -- 172.21.15.86:0/140443554 wait complete. 2024-04-25T12:21:35.209 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.199+0000 7f5236dea000 1 -- start start 2024-04-25T12:21:35.209 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.199+0000 7f5236dea000 1 Processor -- start 2024-04-25T12:21:35.209 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.199+0000 7f5236dea000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d49fd9fd0 0x562d4a051520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:35.209 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.199+0000 7f5236dea000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562d49fde9a0 0x562d4a051a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:35.209 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.199+0000 7f5236dea000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562d49fe0250 0x562d4a051fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:35.209 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.199+0000 7f5236dea000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x562d49deb730 con 0x562d49fd9fd0 2024-04-25T12:21:35.209 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.199+0000 7f5236dea000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x562d49db89e0 con 0x562d49fde9a0 2024-04-25T12:21:35.209 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.199+0000 7f5236dea000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x562d49df0a50 con 0x562d49fe0250 2024-04-25T12:21:35.209 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.203+0000 7f5236dea000 10 client.0 _ll_register_callbacks cb 0x7f521c007b80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T12:21:35.209 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.203+0000 7f5231a04640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d49fd9fd0 0x562d4a051520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:35.210 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.203+0000 7f5231a04640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d49fd9fd0 0x562d4a051520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:45866/0 (socket says 172.21.15.86:45866) 2024-04-25T12:21:35.210 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.203+0000 7f5231a04640 1 -- 172.21.15.86:0/3443639455 learned_addr learned my addr 172.21.15.86:0/3443639455 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:35.210 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.203+0000 7f5231203640 1 --2- 172.21.15.86:0/3443639455 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562d49fde9a0 0x562d4a051a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:35.210 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.203+0000 7f5232205640 1 --2- 172.21.15.86:0/3443639455 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562d49fe0250 0x562d4a051fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:35.210 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.203+0000 7f5231a04640 1 -- 172.21.15.86:0/3443639455 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562d49fe0250 msgr2=0x562d4a051fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:35.210 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.203+0000 7f5231a04640 1 --2- 172.21.15.86:0/3443639455 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562d49fe0250 0x562d4a051fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:35.210 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.203+0000 7f5231a04640 1 -- 172.21.15.86:0/3443639455 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562d49fde9a0 msgr2=0x562d4a051a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:35.210 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.203+0000 7f5231a04640 1 --2- 172.21.15.86:0/3443639455 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562d49fde9a0 0x562d4a051a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:35.210 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.203+0000 7f5231a04640 1 -- 172.21.15.86:0/3443639455 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d49db4b30 con 0x562d49fd9fd0 2024-04-25T12:21:35.210 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.203+0000 7f5232205640 1 --2- 172.21.15.86:0/3443639455 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562d49fe0250 0x562d4a051fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:21:35.210 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.203+0000 7f5231203640 1 --2- 172.21.15.86:0/3443639455 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562d49fde9a0 0x562d4a051a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:21:35.210 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.203+0000 7f5231a04640 1 --2- 172.21.15.86:0/3443639455 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d49fd9fd0 0x562d4a051520 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5228023040 tx=0x7f5228015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fc00ab292fe29f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:35.210 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.203+0000 7f520cff9640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-04-25T12:21:35.211 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.203+0000 7f520cff9640 1 -- 172.21.15.86:0/3443639455 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5228025040 con 0x562d49fd9fd0 2024-04-25T12:21:35.211 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.203+0000 7f520cff9640 1 -- 172.21.15.86:0/3443639455 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f52280156a0 con 0x562d49fd9fd0 2024-04-25T12:21:35.211 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.203+0000 7f5236dea000 1 -- 172.21.15.86:0/3443639455 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f521c026030 con 0x562d49fd9fd0 2024-04-25T12:21:35.211 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.203+0000 7f520cff9640 1 -- 172.21.15.86:0/3443639455 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f5228040050 con 0x562d49fd9fd0 2024-04-25T12:21:35.211 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.203+0000 7f5236dea000 10 client.4407 fetch_fsmap learned FSMap version 7 2024-04-25T12:21:35.211 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.203+0000 7f5236dea000 1 -- 172.21.15.86:0/3443639455 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x562d49e6d5b0 con 0x562d49fd9fd0 2024-04-25T12:21:35.211 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.203+0000 7f520cff9640 1 -- 172.21.15.86:0/3443639455 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f521c026030 con 0x562d49fd9fd0 2024-04-25T12:21:35.211 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.203+0000 7f520cff9640 1 -- 172.21.15.86:0/3443639455 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 7) ==== 4712+0+0 (secure 0 0 0) 0x7f5228043020 con 0x562d49fd9fd0 2024-04-25T12:21:35.211 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.203+0000 7f5236dea000 10 client.4407 fetch_fsmap finished waiting for FSMap version 7 2024-04-25T12:21:35.211 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.203+0000 7f5236dea000 10 client.4407 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-25T12:21:35.211 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.203+0000 7f5236dea000 20 client.4407 populate_metadata read hostname 'smithi086' 2024-04-25T12:21:35.211 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.203+0000 7f5236dea000 1 --2- 172.21.15.86:0/3443639455 >> [v2:172.21.15.134:6834/3044511437,v1:172.21.15.134:6836/3044511437] conn(0x562d49ffaa80 0x562d49ffae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:35.211 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.203+0000 7f5236dea000 4 client.4407 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T12:21:35.211 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.203+0000 7f5236dea000 1 -- 172.21.15.86:0/3443639455 --> [v2:172.21.15.134:6834/3044511437,v1:172.21.15.134:6836/3044511437] -- command(tid 0: {"prefix": "status"}) -- 0x562d49df9e40 con 0x562d49ffaa80 2024-04-25T12:21:35.212 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.203+0000 7f5231203640 1 --2- 172.21.15.86:0/3443639455 >> [v2:172.21.15.134:6834/3044511437,v1:172.21.15.134:6836/3044511437] conn(0x562d49ffaa80 0x562d49ffae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:35.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.203+0000 7f520cff9640 10 client.4407 ms_handle_connect on v2:172.21.15.134:6834/3044511437 2024-04-25T12:21:35.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.203+0000 7f5231203640 1 --2- 172.21.15.86:0/3443639455 >> [v2:172.21.15.134:6834/3044511437,v1:172.21.15.134:6836/3044511437] conn(0x562d49ffaa80 0x562d49ffae60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4df23fc07ea745b2 server_cookie=6ccca2c22a7209ec in_seq=0 out_seq=0 2024-04-25T12:21:35.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.203+0000 7f520cff9640 1 -- 172.21.15.86:0/3443639455 <== mds.0 v2:172.21.15.134:6834/3044511437 1 ==== command_reply(tid 0: 0 ) ==== 8+0+318 (crc 0 0 0) 0x562d49df9e40 con 0x562d49ffaa80 2024-04-25T12:21:35.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.203+0000 7f520cff9640 10 client.4407 handle_command_reply: tid=0 2024-04-25T12:21:35.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.203+0000 7f5236dea000 1 client.4407 shutdown 2024-04-25T12:21:35.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.203+0000 7f5236dea000 1 -- 172.21.15.86:0/3443639455 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d49fd9fd0 msgr2=0x562d4a051520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:35.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.203+0000 7f5236dea000 1 --2- 172.21.15.86:0/3443639455 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d49fd9fd0 0x562d4a051520 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5228023040 tx=0x7f5228015000 comp rx=0 tx=0).stop 2024-04-25T12:21:35.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.203+0000 7f5236dea000 1 -- 172.21.15.86:0/3443639455 shutdown_connections 2024-04-25T12:21:35.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.203+0000 7f5236dea000 1 --2- 172.21.15.86:0/3443639455 >> [v2:172.21.15.134:6834/3044511437,v1:172.21.15.134:6836/3044511437] conn(0x562d49ffaa80 0x562d49ffae60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:35.214 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.203+0000 7f5236dea000 1 --2- 172.21.15.86:0/3443639455 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562d49fe0250 0x562d4a051fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:35.214 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.203+0000 7f5236dea000 1 --2- 172.21.15.86:0/3443639455 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562d49fde9a0 0x562d4a051a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:35.214 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.203+0000 7f5236dea000 1 --2- 172.21.15.86:0/3443639455 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d49fd9fd0 0x562d4a051520 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:35.214 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.203+0000 7f520cff9640 0 client.4407 ms_handle_reset on v2:172.21.15.134:6834/3044511437 2024-04-25T12:21:35.214 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.203+0000 7f5236dea000 1 -- 172.21.15.86:0/3443639455 >> 172.21.15.86:0/3443639455 conn(0x562d49fdae40 msgr2=0x562d49fd8b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:35.214 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.203+0000 7f5236dea000 1 -- 172.21.15.86:0/3443639455 shutdown_connections 2024-04-25T12:21:35.214 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.203+0000 7f5236dea000 1 -- 172.21.15.86:0/3443639455 wait complete. 2024-04-25T12:21:35.214 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.203+0000 7f5236dea000 20 client.4407 trim_cache size 0 max 16384 2024-04-25T12:21:35.214 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-25T12:21:35.214 INFO:teuthology.orchestra.run.smithi086.stdout: "cluster_fsid": "f2ef5c0c-9576-4650-b4f7-6cb14247f62a", 2024-04-25T12:21:35.215 INFO:teuthology.orchestra.run.smithi086.stdout: "whoami": 0, 2024-04-25T12:21:35.215 INFO:teuthology.orchestra.run.smithi086.stdout: "id": 4294, 2024-04-25T12:21:35.215 INFO:teuthology.orchestra.run.smithi086.stdout: "want_state": "up:active", 2024-04-25T12:21:35.215 INFO:teuthology.orchestra.run.smithi086.stdout: "state": "up:active", 2024-04-25T12:21:35.215 INFO:teuthology.orchestra.run.smithi086.stdout: "fs_name": "cephfs", 2024-04-25T12:21:35.215 INFO:teuthology.orchestra.run.smithi086.stdout: "rank_uptime": 11.073153157, 2024-04-25T12:21:35.215 INFO:teuthology.orchestra.run.smithi086.stdout: "mdsmap_epoch": 6, 2024-04-25T12:21:35.215 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch": 24, 2024-04-25T12:21:35.215 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch_barrier": 24, 2024-04-25T12:21:35.215 INFO:teuthology.orchestra.run.smithi086.stdout: "uptime": 17.804062367 2024-04-25T12:21:35.215 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-25T12:21:35.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.207+0000 7f5233c68640 1 -- 172.21.15.86:0/4093440831 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f5210068380 msgr2=0x7f521006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:35.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.207+0000 7f5233c68640 1 --2- 172.21.15.86:0/4093440831 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f5210068380 0x7f521006a840 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5228009790 tx=0x7f5228008040 comp rx=0 tx=0).stop 2024-04-25T12:21:35.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.207+0000 7f5233c68640 1 -- 172.21.15.86:0/4093440831 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f522c14ffa0 msgr2=0x7f522c1403b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:35.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.207+0000 7f5233c68640 1 --2- 172.21.15.86:0/4093440831 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f522c14ffa0 0x7f522c1403b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5224009e50 tx=0x7f52240197d0 comp rx=0 tx=0).stop 2024-04-25T12:21:35.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.207+0000 7f5233c68640 1 -- 172.21.15.86:0/4093440831 shutdown_connections 2024-04-25T12:21:35.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.207+0000 7f5233c68640 1 --2- 172.21.15.86:0/4093440831 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f5210068380 0x7f521006a840 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:35.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.207+0000 7f5233c68640 1 --2- 172.21.15.86:0/4093440831 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f522c14ffa0 0x7f522c1403b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:35.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.207+0000 7f5233c68640 1 --2- 172.21.15.86:0/4093440831 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f522c14fbc0 0x7f522c13fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:35.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.207+0000 7f5233c68640 1 --2- 172.21.15.86:0/4093440831 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f522c074100 0x7f522c141190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:35.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.207+0000 7f5233c68640 1 -- 172.21.15.86:0/4093440831 >> 172.21.15.86:0/4093440831 conn(0x7f522c06b9d0 msgr2=0x7f522c06e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:35.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.207+0000 7f5233c68640 1 -- 172.21.15.86:0/4093440831 shutdown_connections 2024-04-25T12:21:35.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.207+0000 7f5233c68640 1 -- 172.21.15.86:0/4093440831 wait complete. 2024-04-25T12:21:35.230 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T12:21:35.230 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-25T12:21:35.230 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T12:21:35.354 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.347+0000 7fe412c00640 1 Processor -- start 2024-04-25T12:21:35.354 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.347+0000 7fe412c00640 1 -- start start 2024-04-25T12:21:35.357 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.351+0000 7fe412c00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe40c067b00 0x7fe40c152ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:35.357 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.351+0000 7fe412c00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe40c153220 0x7fe40c06ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:35.357 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.351+0000 7fe412c00640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe40c0742d0 con 0x7fe40c0723d0 2024-04-25T12:21:35.357 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.351+0000 7fe412c00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fe40c153660 con 0x7fe40c067b00 2024-04-25T12:21:35.357 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.351+0000 7fe412c00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fe40c074550 con 0x7fe40c153220 2024-04-25T12:21:35.357 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.351+0000 7fe41099c640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fe40c0723d0 0x7fe40c0727b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:53066/0 (socket says 172.21.15.86:53066) 2024-04-25T12:21:35.357 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.351+0000 7fe41099c640 1 -- 172.21.15.86:0/2955921533 learned_addr learned my addr 172.21.15.86:0/2955921533 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-04-25T12:21:35.357 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.351+0000 7fe41119d640 1 --2- 172.21.15.86:0/2955921533 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe40c153220 0x7fe40c06ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:35.357 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.351+0000 7fe40bfff640 1 --2- 172.21.15.86:0/2955921533 >> v2:172.21.15.134:3300/0 conn(0x7fe40c067b00 0x7fe40c152ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:35.357 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.351+0000 7fe40b7fe640 1 -- 172.21.15.86:0/2955921533 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 892698013 0 0) 0x7fe3fc001120 con 0x7fe40c0723d0 2024-04-25T12:21:35.357 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.351+0000 7fe40b7fe640 1 -- 172.21.15.86:0/2955921533 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3f4003530 con 0x7fe40c0723d0 2024-04-25T12:21:35.357 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.351+0000 7fe40b7fe640 1 -- 172.21.15.86:0/2955921533 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2815081823 0 0) 0x7fe3f4003530 con 0x7fe40c0723d0 2024-04-25T12:21:35.357 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.351+0000 7fe40b7fe640 1 -- 172.21.15.86:0/2955921533 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe40c153220 msgr2=0x7fe40c06ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:35.358 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.351+0000 7fe40b7fe640 1 --2- 172.21.15.86:0/2955921533 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe40c153220 0x7fe40c06ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:35.358 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.351+0000 7fe40b7fe640 1 -- 172.21.15.86:0/2955921533 >> v2:172.21.15.134:3300/0 conn(0x7fe40c067b00 msgr2=0x7fe40c152ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:35.358 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.351+0000 7fe40b7fe640 1 --2- 172.21.15.86:0/2955921533 >> v2:172.21.15.134:3300/0 conn(0x7fe40c067b00 0x7fe40c152ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:35.358 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.351+0000 7fe40b7fe640 1 -- 172.21.15.86:0/2955921533 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe40c159a60 con 0x7fe40c0723d0 2024-04-25T12:21:35.358 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.351+0000 7fe40b7fe640 1 -- 172.21.15.86:0/2955921533 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1387950573 0 0) 0x7fe3fc001850 con 0x7fe40c0723d0 2024-04-25T12:21:35.358 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.351+0000 7fe40b7fe640 1 -- 172.21.15.86:0/2955921533 >> v1:172.21.15.86:6789/0 conn(0x7fe40c0723d0 legacy=0x7fe40c0727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:35.358 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.351+0000 7fe40b7fe640 1 --2- 172.21.15.86:0/2955921533 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe40c153220 0x7fe3f40039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:35.358 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.351+0000 7fe40b7fe640 1 --2- 172.21.15.86:0/2955921533 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe3f4003f40 0x7fe3f4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:35.358 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.351+0000 7fe40b7fe640 1 --2- 172.21.15.86:0/2955921533 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe3f4004d50 0x7fe3f40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:35.358 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.351+0000 7fe40b7fe640 1 -- 172.21.15.86:0/2955921533 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe40c153660 con 0x7fe3f4003f40 2024-04-25T12:21:35.358 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.351+0000 7fe40b7fe640 1 -- 172.21.15.86:0/2955921533 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe40c074550 con 0x7fe3f4004d50 2024-04-25T12:21:35.358 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.351+0000 7fe40b7fe640 1 -- 172.21.15.86:0/2955921533 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fe3f400b9d0 con 0x7fe40c153220 2024-04-25T12:21:35.358 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.351+0000 7fe40bfff640 1 --2- 172.21.15.86:0/2955921533 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe3f4003f40 0x7fe3f4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:35.359 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.351+0000 7fe41099c640 1 --2- 172.21.15.86:0/2955921533 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe40c153220 0x7fe3f40039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:35.359 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.351+0000 7fe40bfff640 1 -- 172.21.15.86:0/2955921533 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe40c153220 msgr2=0x7fe3f40039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:35.359 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.351+0000 7fe40bfff640 1 --2- 172.21.15.86:0/2955921533 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe40c153220 0x7fe3f40039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:35.359 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.351+0000 7fe40bfff640 1 -- 172.21.15.86:0/2955921533 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe3f4004d50 msgr2=0x7fe3f40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:35.359 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.351+0000 7fe40bfff640 1 --2- 172.21.15.86:0/2955921533 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe3f4004d50 0x7fe3f40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:35.359 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.351+0000 7fe40bfff640 1 -- 172.21.15.86:0/2955921533 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3f4003530 con 0x7fe3f4003f40 2024-04-25T12:21:35.360 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.355+0000 7fe40bfff640 1 --2- 172.21.15.86:0/2955921533 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe3f4003f40 0x7fe3f4004810 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe400009ab0 tx=0x7fe40001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b2fe44f3db156b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:35.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.355+0000 7fe40b7fe640 1 -- 172.21.15.86:0/2955921533 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4000b2070 con 0x7fe3f4003f40 2024-04-25T12:21:35.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.355+0000 7fe40b7fe640 1 -- 172.21.15.86:0/2955921533 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4000a5680 con 0x7fe3f4003f40 2024-04-25T12:21:35.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.355+0000 7fe40b7fe640 1 -- 172.21.15.86:0/2955921533 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4000096b0 con 0x7fe3f4003f40 2024-04-25T12:21:35.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.355+0000 7fe412c00640 1 -- 172.21.15.86:0/2955921533 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe3f4003f40 msgr2=0x7fe3f4004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:35.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.355+0000 7fe412c00640 1 --2- 172.21.15.86:0/2955921533 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe3f4003f40 0x7fe3f4004810 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe400009ab0 tx=0x7fe40001ca30 comp rx=0 tx=0).stop 2024-04-25T12:21:35.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.355+0000 7fe41119d640 1 -- 172.21.15.86:0/2955921533 reap_dead start 2024-04-25T12:21:35.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.355+0000 7fe412c00640 1 -- 172.21.15.86:0/2955921533 shutdown_connections 2024-04-25T12:21:35.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.355+0000 7fe412c00640 1 -- 172.21.15.86:0/2955921533 >> 172.21.15.86:0/2955921533 conn(0x7fe40c0c9a70 msgr2=0x7fe40c0c9e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:35.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.355+0000 7fe412c00640 1 -- 172.21.15.86:0/2955921533 shutdown_connections 2024-04-25T12:21:35.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.355+0000 7fe412c00640 1 -- 172.21.15.86:0/2955921533 wait complete. 2024-04-25T12:21:35.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.355+0000 7fe412c00640 1 Processor -- start 2024-04-25T12:21:35.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.355+0000 7fe412c00640 1 -- start start 2024-04-25T12:21:35.363 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.355+0000 7fe412c00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe3f4003f40 0x7fe40c150ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:35.363 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.355+0000 7fe412c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe40c0c33a0 0x7fe40c157e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:35.363 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.355+0000 7fe412c00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe40c14aa20 0x7fe40c14aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:35.363 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.355+0000 7fe412c00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe40c159d40 con 0x7fe40c0c33a0 2024-04-25T12:21:35.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.355+0000 7fe412c00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe40c0c9650 con 0x7fe3f4003f40 2024-04-25T12:21:35.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.355+0000 7fe412c00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fe40c0676a0 con 0x7fe40c14aa20 2024-04-25T12:21:35.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.355+0000 7fe40bfff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe40c0c33a0 0x7fe40c157e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:35.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.355+0000 7fe40bfff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe40c0c33a0 0x7fe40c157e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:45880/0 (socket says 172.21.15.86:45880) 2024-04-25T12:21:35.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.355+0000 7fe40bfff640 1 -- 172.21.15.86:0/2225790116 learned_addr learned my addr 172.21.15.86:0/2225790116 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:35.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.355+0000 7fe41099c640 1 --2- 172.21.15.86:0/2225790116 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe3f4003f40 0x7fe40c150ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:35.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.355+0000 7fe41119d640 1 --2- 172.21.15.86:0/2225790116 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe40c14aa20 0x7fe40c14aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:35.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.355+0000 7fe40bfff640 1 -- 172.21.15.86:0/2225790116 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe40c14aa20 msgr2=0x7fe40c14aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:35.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.355+0000 7fe40bfff640 1 --2- 172.21.15.86:0/2225790116 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe40c14aa20 0x7fe40c14aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:35.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.355+0000 7fe40bfff640 1 -- 172.21.15.86:0/2225790116 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe3f4003f40 msgr2=0x7fe40c150ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:35.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.355+0000 7fe40bfff640 1 --2- 172.21.15.86:0/2225790116 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe3f4003f40 0x7fe40c150ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:35.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.355+0000 7fe40bfff640 1 -- 172.21.15.86:0/2225790116 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe40c0c3800 con 0x7fe40c0c33a0 2024-04-25T12:21:35.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.355+0000 7fe40bfff640 1 --2- 172.21.15.86:0/2225790116 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe40c0c33a0 0x7fe40c157e40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe40001d2d0 tx=0x7fe3f4005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:35.365 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.355+0000 7fe4097fa640 1 -- 172.21.15.86:0/2225790116 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4000b2040 con 0x7fe40c0c33a0 2024-04-25T12:21:35.365 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.355+0000 7fe4097fa640 1 -- 172.21.15.86:0/2225790116 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe400004020 con 0x7fe40c0c33a0 2024-04-25T12:21:35.365 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.355+0000 7fe412c00640 1 -- 172.21.15.86:0/2225790116 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe40c0c2c50 con 0x7fe40c0c33a0 2024-04-25T12:21:35.365 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.355+0000 7fe4097fa640 1 -- 172.21.15.86:0/2225790116 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe400004410 con 0x7fe40c0c33a0 2024-04-25T12:21:35.365 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.355+0000 7fe412c00640 1 -- 172.21.15.86:0/2225790116 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe40c150a30 con 0x7fe40c0c33a0 2024-04-25T12:21:35.365 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.359+0000 7fe412c00640 1 -- 172.21.15.86:0/2225790116 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe40c075df0 con 0x7fe40c0c33a0 2024-04-25T12:21:35.365 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.359+0000 7fe4097fa640 1 -- 172.21.15.86:0/2225790116 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe4000c0060 con 0x7fe40c0c33a0 2024-04-25T12:21:35.366 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.359+0000 7fe4097fa640 1 --2- 172.21.15.86:0/2225790116 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fe3f8068380 0x7fe3f806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:35.366 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.359+0000 7fe4097fa640 1 -- 172.21.15.86:0/2225790116 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe400120ad0 con 0x7fe40c0c33a0 2024-04-25T12:21:35.366 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.359+0000 7fe41099c640 1 --2- 172.21.15.86:0/2225790116 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fe3f8068380 0x7fe3f806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:35.366 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.359+0000 7fe41099c640 1 --2- 172.21.15.86:0/2225790116 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fe3f8068380 0x7fe3f806a840 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc0013e0 tx=0x7fe3fc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:35.368 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.363+0000 7fe4097fa640 1 -- 172.21.15.86:0/2225790116 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe4000167a0 con 0x7fe40c0c33a0 2024-04-25T12:21:35.568 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.563+0000 7fe412c00640 1 -- 172.21.15.86:0/2225790116 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fe40c1f0f60 con 0x7fe40c0c33a0 2024-04-25T12:21:35.569 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.563+0000 7fe4097fa640 1 -- 172.21.15.86:0/2225790116 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+88 (secure 0 0 0) 0x7fe4000f0cc0 con 0x7fe40c0c33a0 2024-04-25T12:21:35.569 INFO:teuthology.orchestra.run.smithi086.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-25T12:21:35.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.567+0000 7fe412c00640 1 -- 172.21.15.86:0/2225790116 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fe3f8068380 msgr2=0x7fe3f806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:35.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.567+0000 7fe412c00640 1 --2- 172.21.15.86:0/2225790116 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fe3f8068380 0x7fe3f806a840 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc0013e0 tx=0x7fe3fc009040 comp rx=0 tx=0).stop 2024-04-25T12:21:35.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.567+0000 7fe412c00640 1 -- 172.21.15.86:0/2225790116 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe40c0c33a0 msgr2=0x7fe40c157e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:35.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.567+0000 7fe412c00640 1 --2- 172.21.15.86:0/2225790116 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe40c0c33a0 0x7fe40c157e40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe40001d2d0 tx=0x7fe3f4005840 comp rx=0 tx=0).stop 2024-04-25T12:21:35.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.567+0000 7fe412c00640 1 -- 172.21.15.86:0/2225790116 shutdown_connections 2024-04-25T12:21:35.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.567+0000 7fe412c00640 1 --2- 172.21.15.86:0/2225790116 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe40c14aa20 0x7fe40c14aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:35.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.567+0000 7fe412c00640 1 --2- 172.21.15.86:0/2225790116 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fe3f8068380 0x7fe3f806a840 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:35.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.567+0000 7fe412c00640 1 --2- 172.21.15.86:0/2225790116 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe40c0c33a0 0x7fe40c157e40 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:35.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.567+0000 7fe412c00640 1 --2- 172.21.15.86:0/2225790116 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe3f4003f40 0x7fe40c150ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:35.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.567+0000 7fe412c00640 1 -- 172.21.15.86:0/2225790116 >> 172.21.15.86:0/2225790116 conn(0x7fe40c0c9a70 msgr2=0x7fe40c0c7990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:35.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.567+0000 7fe412c00640 1 -- 172.21.15.86:0/2225790116 shutdown_connections 2024-04-25T12:21:35.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35.567+0000 7fe412c00640 1 -- 172.21.15.86:0/2225790116 wait complete. 2024-04-25T12:21:35.588 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T12:21:35.588 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T12:21:35.588 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi086.front.sepia.ceph.com 2024-04-25T12:21:35.588 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-04-25T12:21:35.588 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-25T12:21:35.588 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T12:21:35.588 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T12:21:35.589 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T12:21:35.589 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-04-25T12:21:35.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:21:35.589 DEBUG:teuthology.orchestra.run.smithi086:> ip addr 2024-04-25T12:21:35.595 INFO:teuthology.orchestra.run.smithi086.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T12:21:35.595 INFO:teuthology.orchestra.run.smithi086.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T12:21:35.595 INFO:teuthology.orchestra.run.smithi086.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T12:21:35.595 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2024-04-25T12:21:35.595 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 ::1/128 scope host 2024-04-25T12:21:35.595 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2024-04-25T12:21:35.595 INFO:teuthology.orchestra.run.smithi086.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T12:21:35.595 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f6 brd ff:ff:ff:ff:ff:ff 2024-04-25T12:21:35.595 INFO:teuthology.orchestra.run.smithi086.stdout: altname enp7s0f0 2024-04-25T12:21:35.596 INFO:teuthology.orchestra.run.smithi086.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T12:21:35.596 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f7 brd ff:ff:ff:ff:ff:ff 2024-04-25T12:21:35.596 INFO:teuthology.orchestra.run.smithi086.stdout: altname enp7s0f1 2024-04-25T12:21:35.596 INFO:teuthology.orchestra.run.smithi086.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T12:21:35.596 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:08 brd ff:ff:ff:ff:ff:ff 2024-04-25T12:21:35.596 INFO:teuthology.orchestra.run.smithi086.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T12:21:35.596 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:09 brd ff:ff:ff:ff:ff:ff 2024-04-25T12:21:35.596 INFO:teuthology.orchestra.run.smithi086.stdout: inet 172.21.15.86/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-25T12:21:35.596 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft 42490sec preferred_lft 42490sec 2024-04-25T12:21:35.596 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::ec4:7aff:fe8f:d809/64 scope link 2024-04-25T12:21:35.596 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2024-04-25T12:21:35.596 INFO:teuthology.orchestra.run.smithi086.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T12:21:35.596 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 02:42:6a:96:63:a2 brd ff:ff:ff:ff:ff:ff 2024-04-25T12:21:35.596 INFO:teuthology.orchestra.run.smithi086.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T12:21:35.596 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2024-04-25T12:21:35.597 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T12:21:35.597 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T12:21:35.597 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2024-04-25T12:21:35.597 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link add name ceph-brx type bridge 2024-04-25T12:21:35.597 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip addr flush dev ceph-brx 2024-04-25T12:21:35.597 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link set ceph-brx up 2024-04-25T12:21:35.597 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T12:21:35.598 DEBUG:teuthology.orchestra.run.smithi086:> ') 2024-04-25T12:21:35.682 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T12:21:35.715 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T12:21:35.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:21:35.722 DEBUG:teuthology.orchestra.run.smithi086:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T12:21:35.771 INFO:teuthology.orchestra.run.smithi086.stdout:1 2024-04-25T12:21:35.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:21:35.772 DEBUG:teuthology.orchestra.run.smithi086:> route 2024-04-25T12:21:35.846 INFO:teuthology.orchestra.run.smithi086.stdout:Kernel IP routing table 2024-04-25T12:21:35.846 INFO:teuthology.orchestra.run.smithi086.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T12:21:35.846 INFO:teuthology.orchestra.run.smithi086.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-25T12:21:35.846 INFO:teuthology.orchestra.run.smithi086.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T12:21:35.847 INFO:teuthology.orchestra.run.smithi086.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-25T12:21:35.847 INFO:teuthology.orchestra.run.smithi086.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T12:21:35.847 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T12:21:35.847 INFO:teuthology.orchestra.run.smithi086.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T12:21:35.847 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T12:21:35.847 INFO:teuthology.orchestra.run.smithi086.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T12:21:35.847 INFO:teuthology.orchestra.run.smithi086.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T12:21:35.847 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T12:21:35.847 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2024-04-25T12:21:35.847 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T12:21:35.848 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T12:21:35.848 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T12:21:35.848 DEBUG:teuthology.orchestra.run.smithi086:> ') 2024-04-25T12:21:35.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T12:21:35.966 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T12:21:35.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:21:35.974 DEBUG:teuthology.orchestra.run.smithi086:> ip netns list 2024-04-25T12:21:35.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:21:35.980 DEBUG:teuthology.orchestra.run.smithi086:> ip netns list-id 2024-04-25T12:21:36.027 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T12:21:36.027 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2024-04-25T12:21:36.027 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T12:21:36.027 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-04-25T12:21:36.027 DEBUG:teuthology.orchestra.run.smithi086:> ') 2024-04-25T12:21:36.116 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T12:21:36.141 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T12:21:36.149 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-04-25T12:21:36.149 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T12:21:36.149 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2024-04-25T12:21:36.149 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-04-25T12:21:36.149 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T12:21:36.149 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-04-25T12:21:36.149 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-04-25T12:21:36.149 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-04-25T12:21:36.149 DEBUG:teuthology.orchestra.run.smithi086:> ') 2024-04-25T12:21:36.193 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T12:21:36.253 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T12:21:36.259 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T12:21:36.260 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2024-04-25T12:21:36.260 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link set brx.0 up 2024-04-25T12:21:36.260 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T12:21:36.260 DEBUG:teuthology.orchestra.run.smithi086:> ') 2024-04-25T12:21:36.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T12:21:36.356 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T12:21:36.363 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-04-25T12:21:36.363 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T12:21:36.363 DEBUG:teuthology.orchestra.run.smithi086:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-04-25T12:21:36.411 INFO:teuthology.orchestra.run.smithi086.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-04-25T12:21:36.412 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T12:21:36.412 DEBUG:teuthology.orchestra.run.smithi086:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-04-25T12:21:36.459 DEBUG:teuthology.orchestra.run.smithi086:> sudo modprobe fuse 2024-04-25T12:21:36.517 DEBUG:teuthology.orchestra.run.smithi086:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T12:21:36.564 INFO:teuthology.orchestra.run.smithi086.stdout:/sys 2024-04-25T12:21:36.564 INFO:teuthology.orchestra.run.smithi086.stdout:/proc 2024-04-25T12:21:36.564 INFO:teuthology.orchestra.run.smithi086.stdout:/dev 2024-04-25T12:21:36.565 INFO:teuthology.orchestra.run.smithi086.stdout:/dev/pts 2024-04-25T12:21:36.565 INFO:teuthology.orchestra.run.smithi086.stdout:/run 2024-04-25T12:21:36.565 INFO:teuthology.orchestra.run.smithi086.stdout:/ 2024-04-25T12:21:36.565 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/kernel/security 2024-04-25T12:21:36.565 INFO:teuthology.orchestra.run.smithi086.stdout:/dev/shm 2024-04-25T12:21:36.565 INFO:teuthology.orchestra.run.smithi086.stdout:/run/lock 2024-04-25T12:21:36.565 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/fs/cgroup 2024-04-25T12:21:36.565 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/fs/pstore 2024-04-25T12:21:36.565 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/fs/bpf 2024-04-25T12:21:36.565 INFO:teuthology.orchestra.run.smithi086.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T12:21:36.565 INFO:teuthology.orchestra.run.smithi086.stdout:/dev/hugepages 2024-04-25T12:21:36.565 INFO:teuthology.orchestra.run.smithi086.stdout:/dev/mqueue 2024-04-25T12:21:36.565 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/kernel/debug 2024-04-25T12:21:36.565 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/kernel/tracing 2024-04-25T12:21:36.565 INFO:teuthology.orchestra.run.smithi086.stdout:/proc/fs/nfsd 2024-04-25T12:21:36.566 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/fs/fuse/connections 2024-04-25T12:21:36.566 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/kernel/config 2024-04-25T12:21:36.566 INFO:teuthology.orchestra.run.smithi086.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T12:21:36.566 INFO:teuthology.orchestra.run.smithi086.stdout:/run/rpc_pipefs 2024-04-25T12:21:36.566 INFO:teuthology.orchestra.run.smithi086.stdout:/run/user/1000 2024-04-25T12:21:36.566 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/ceph 2024-04-25T12:21:36.566 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T12:21:36.566 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T12:21:36.566 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T12:21:36.566 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T12:21:36.566 INFO:teuthology.orchestra.run.smithi086.stdout:/run/netns 2024-04-25T12:21:36.566 INFO:teuthology.orchestra.run.smithi086.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T12:21:36.566 INFO:teuthology.orchestra.run.smithi086.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T12:21:36.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:21:36.567 DEBUG:teuthology.orchestra.run.smithi086:> ls /sys/fs/fuse/connections 2024-04-25T12:21:36.615 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-25T12:21:36.615 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-04-25T12:21:36.660 DEBUG:teuthology.orchestra.run.smithi086:> sudo modprobe fuse 2024-04-25T12:21:36.674 DEBUG:teuthology.orchestra.run.smithi086:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T12:21:36.719 INFO:teuthology.orchestra.run.smithi086.stdout:/sys 2024-04-25T12:21:36.719 INFO:teuthology.orchestra.run.smithi086.stdout:/proc 2024-04-25T12:21:36.719 INFO:teuthology.orchestra.run.smithi086.stdout:/dev 2024-04-25T12:21:36.719 INFO:teuthology.orchestra.run.smithi086.stdout:/dev/pts 2024-04-25T12:21:36.719 INFO:teuthology.orchestra.run.smithi086.stdout:/run 2024-04-25T12:21:36.719 INFO:teuthology.orchestra.run.smithi086.stdout:/ 2024-04-25T12:21:36.719 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/kernel/security 2024-04-25T12:21:36.720 INFO:teuthology.orchestra.run.smithi086.stdout:/dev/shm 2024-04-25T12:21:36.720 INFO:teuthology.orchestra.run.smithi086.stdout:/run/lock 2024-04-25T12:21:36.720 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/fs/cgroup 2024-04-25T12:21:36.720 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/fs/pstore 2024-04-25T12:21:36.720 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/fs/bpf 2024-04-25T12:21:36.720 INFO:teuthology.orchestra.run.smithi086.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T12:21:36.720 INFO:teuthology.orchestra.run.smithi086.stdout:/dev/hugepages 2024-04-25T12:21:36.720 INFO:teuthology.orchestra.run.smithi086.stdout:/dev/mqueue 2024-04-25T12:21:36.720 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/kernel/debug 2024-04-25T12:21:36.720 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/kernel/tracing 2024-04-25T12:21:36.720 INFO:teuthology.orchestra.run.smithi086.stdout:/proc/fs/nfsd 2024-04-25T12:21:36.720 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/fs/fuse/connections 2024-04-25T12:21:36.720 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/kernel/config 2024-04-25T12:21:36.720 INFO:teuthology.orchestra.run.smithi086.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T12:21:36.720 INFO:teuthology.orchestra.run.smithi086.stdout:/run/rpc_pipefs 2024-04-25T12:21:36.721 INFO:teuthology.orchestra.run.smithi086.stdout:/run/user/1000 2024-04-25T12:21:36.721 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/ceph 2024-04-25T12:21:36.721 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T12:21:36.721 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T12:21:36.721 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T12:21:36.721 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T12:21:36.721 INFO:teuthology.orchestra.run.smithi086.stdout:/run/netns 2024-04-25T12:21:36.721 INFO:teuthology.orchestra.run.smithi086.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T12:21:36.721 INFO:teuthology.orchestra.run.smithi086.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T12:21:36.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:21:36.722 DEBUG:teuthology.orchestra.run.smithi086:> ls /sys/fs/fuse/connections 2024-04-25T12:21:36.743 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi086.stderr:2024-04-25T12:21:36.739+0000 7f27c6a9c580 -1 init, newargv = 0x55f5c7ee4920 newargc=15 2024-04-25T12:21:36.744 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi086.stderr:ceph-fuse[33944]: starting ceph client 2024-04-25T12:21:36.954 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi086.stderr:ceph-fuse[33944]: starting fuse 2024-04-25T12:21:37.849 DEBUG:teuthology.orchestra.run.smithi086:> sudo modprobe fuse 2024-04-25T12:21:37.865 DEBUG:teuthology.orchestra.run.smithi086:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T12:21:37.913 INFO:teuthology.orchestra.run.smithi086.stdout:/sys 2024-04-25T12:21:37.913 INFO:teuthology.orchestra.run.smithi086.stdout:/proc 2024-04-25T12:21:37.913 INFO:teuthology.orchestra.run.smithi086.stdout:/dev 2024-04-25T12:21:37.913 INFO:teuthology.orchestra.run.smithi086.stdout:/dev/pts 2024-04-25T12:21:37.914 INFO:teuthology.orchestra.run.smithi086.stdout:/run 2024-04-25T12:21:37.914 INFO:teuthology.orchestra.run.smithi086.stdout:/ 2024-04-25T12:21:37.914 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/kernel/security 2024-04-25T12:21:37.914 INFO:teuthology.orchestra.run.smithi086.stdout:/dev/shm 2024-04-25T12:21:37.914 INFO:teuthology.orchestra.run.smithi086.stdout:/run/lock 2024-04-25T12:21:37.914 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/fs/cgroup 2024-04-25T12:21:37.914 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/fs/pstore 2024-04-25T12:21:37.914 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/fs/bpf 2024-04-25T12:21:37.914 INFO:teuthology.orchestra.run.smithi086.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T12:21:37.914 INFO:teuthology.orchestra.run.smithi086.stdout:/dev/hugepages 2024-04-25T12:21:37.914 INFO:teuthology.orchestra.run.smithi086.stdout:/dev/mqueue 2024-04-25T12:21:37.914 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/kernel/debug 2024-04-25T12:21:37.914 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/kernel/tracing 2024-04-25T12:21:37.914 INFO:teuthology.orchestra.run.smithi086.stdout:/proc/fs/nfsd 2024-04-25T12:21:37.915 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/fs/fuse/connections 2024-04-25T12:21:37.915 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/kernel/config 2024-04-25T12:21:37.915 INFO:teuthology.orchestra.run.smithi086.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T12:21:37.915 INFO:teuthology.orchestra.run.smithi086.stdout:/run/rpc_pipefs 2024-04-25T12:21:37.915 INFO:teuthology.orchestra.run.smithi086.stdout:/run/user/1000 2024-04-25T12:21:37.915 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/ceph 2024-04-25T12:21:37.915 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T12:21:37.915 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T12:21:37.915 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T12:21:37.915 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T12:21:37.915 INFO:teuthology.orchestra.run.smithi086.stdout:/run/netns 2024-04-25T12:21:37.915 INFO:teuthology.orchestra.run.smithi086.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T12:21:37.915 INFO:teuthology.orchestra.run.smithi086.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T12:21:37.915 INFO:teuthology.orchestra.run.smithi086.stdout:/home/ubuntu/cephtest/mnt.admin 2024-04-25T12:21:37.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:21:37.916 DEBUG:teuthology.orchestra.run.smithi086:> ls /sys/fs/fuse/connections 2024-04-25T12:21:37.963 INFO:teuthology.orchestra.run.smithi086.stdout:45 2024-04-25T12:21:37.963 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-04-25T12:21:37.964 DEBUG:teuthology.orchestra.run.smithi086:> sudo stdin-killer -- python3 -c ' 2024-04-25T12:21:37.964 DEBUG:teuthology.orchestra.run.smithi086:> import glob 2024-04-25T12:21:37.964 DEBUG:teuthology.orchestra.run.smithi086:> import re 2024-04-25T12:21:37.964 DEBUG:teuthology.orchestra.run.smithi086:> import os 2024-04-25T12:21:37.964 DEBUG:teuthology.orchestra.run.smithi086:> import subprocess 2024-04-25T12:21:37.964 DEBUG:teuthology.orchestra.run.smithi086:> 2024-04-25T12:21:37.964 DEBUG:teuthology.orchestra.run.smithi086:> def _find_admin_socket(client_name): 2024-04-25T12:21:37.964 DEBUG:teuthology.orchestra.run.smithi086:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-04-25T12:21:37.964 DEBUG:teuthology.orchestra.run.smithi086:> files = glob.glob(asok_path) 2024-04-25T12:21:37.964 DEBUG:teuthology.orchestra.run.smithi086:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-04-25T12:21:37.964 DEBUG:teuthology.orchestra.run.smithi086:> 2024-04-25T12:21:37.964 DEBUG:teuthology.orchestra.run.smithi086:> # Given a non-glob path, it better be there 2024-04-25T12:21:37.964 DEBUG:teuthology.orchestra.run.smithi086:> if "*" not in asok_path: 2024-04-25T12:21:37.964 DEBUG:teuthology.orchestra.run.smithi086:> assert(len(files) == 1) 2024-04-25T12:21:37.965 DEBUG:teuthology.orchestra.run.smithi086:> return files[0] 2024-04-25T12:21:37.965 DEBUG:teuthology.orchestra.run.smithi086:> 2024-04-25T12:21:37.965 DEBUG:teuthology.orchestra.run.smithi086:> for f in files: 2024-04-25T12:21:37.965 DEBUG:teuthology.orchestra.run.smithi086:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-25T12:21:37.965 DEBUG:teuthology.orchestra.run.smithi086:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-25T12:21:37.965 DEBUG:teuthology.orchestra.run.smithi086:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-25T12:21:37.965 DEBUG:teuthology.orchestra.run.smithi086:> contents = proc_f.read() 2024-04-25T12:21:37.965 DEBUG:teuthology.orchestra.run.smithi086:> if mountpoint in contents: 2024-04-25T12:21:37.965 DEBUG:teuthology.orchestra.run.smithi086:> return f 2024-04-25T12:21:37.965 DEBUG:teuthology.orchestra.run.smithi086:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-25T12:21:37.965 DEBUG:teuthology.orchestra.run.smithi086:> 2024-04-25T12:21:37.965 DEBUG:teuthology.orchestra.run.smithi086:> print(_find_admin_socket("client.admin")) 2024-04-25T12:21:37.965 DEBUG:teuthology.orchestra.run.smithi086:> ' 2024-04-25T12:21:38.086 INFO:teuthology.orchestra.run.smithi086.stdout:/var/run/ceph/ceph-client.admin.33944.asok 2024-04-25T12:21:38.090 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T12:21:38.098 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.33944.asok 2024-04-25T12:21:38.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:21:38.099 DEBUG:teuthology.orchestra.run.smithi086:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.33944.asok status 2024-04-25T12:21:38.254 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-25T12:21:38.254 INFO:teuthology.orchestra.run.smithi086.stdout: "metadata": { 2024-04-25T12:21:38.254 INFO:teuthology.orchestra.run.smithi086.stdout: "ceph_sha1": "d69f13d827952bb07bb9b7973bca14f97d764d6f", 2024-04-25T12:21:38.254 INFO:teuthology.orchestra.run.smithi086.stdout: "ceph_version": "ceph version 19.0.0-3156-gd69f13d8 (d69f13d827952bb07bb9b7973bca14f97d764d6f) squid (dev)", 2024-04-25T12:21:38.255 INFO:teuthology.orchestra.run.smithi086.stdout: "entity_id": "admin", 2024-04-25T12:21:38.255 INFO:teuthology.orchestra.run.smithi086.stdout: "hostname": "smithi086", 2024-04-25T12:21:38.255 INFO:teuthology.orchestra.run.smithi086.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-04-25T12:21:38.255 INFO:teuthology.orchestra.run.smithi086.stdout: "pid": "33944", 2024-04-25T12:21:38.255 INFO:teuthology.orchestra.run.smithi086.stdout: "root": "/" 2024-04-25T12:21:38.255 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-25T12:21:38.255 INFO:teuthology.orchestra.run.smithi086.stdout: "dentry_count": 0, 2024-04-25T12:21:38.255 INFO:teuthology.orchestra.run.smithi086.stdout: "dentry_pinned_count": 0, 2024-04-25T12:21:38.255 INFO:teuthology.orchestra.run.smithi086.stdout: "id": 4419, 2024-04-25T12:21:38.255 INFO:teuthology.orchestra.run.smithi086.stdout: "inst": { 2024-04-25T12:21:38.255 INFO:teuthology.orchestra.run.smithi086.stdout: "name": { 2024-04-25T12:21:38.255 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "client", 2024-04-25T12:21:38.255 INFO:teuthology.orchestra.run.smithi086.stdout: "num": 4419 2024-04-25T12:21:38.256 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-25T12:21:38.256 INFO:teuthology.orchestra.run.smithi086.stdout: "addr": { 2024-04-25T12:21:38.256 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "v1", 2024-04-25T12:21:38.256 INFO:teuthology.orchestra.run.smithi086.stdout: "addr": "192.168.0.1:0", 2024-04-25T12:21:38.256 INFO:teuthology.orchestra.run.smithi086.stdout: "nonce": 1317592037 2024-04-25T12:21:38.256 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-25T12:21:38.256 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-25T12:21:38.256 INFO:teuthology.orchestra.run.smithi086.stdout: "addr": { 2024-04-25T12:21:38.256 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "v1", 2024-04-25T12:21:38.256 INFO:teuthology.orchestra.run.smithi086.stdout: "addr": "192.168.0.1:0", 2024-04-25T12:21:38.256 INFO:teuthology.orchestra.run.smithi086.stdout: "nonce": 1317592037 2024-04-25T12:21:38.256 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-25T12:21:38.256 INFO:teuthology.orchestra.run.smithi086.stdout: "inst_str": "client.4419 192.168.0.1:0/1317592037", 2024-04-25T12:21:38.256 INFO:teuthology.orchestra.run.smithi086.stdout: "addr_str": "192.168.0.1:0/1317592037", 2024-04-25T12:21:38.256 INFO:teuthology.orchestra.run.smithi086.stdout: "inode_count": 1, 2024-04-25T12:21:38.256 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_epoch": 6, 2024-04-25T12:21:38.257 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_epoch": 24, 2024-04-25T12:21:38.257 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_epoch_barrier": 0, 2024-04-25T12:21:38.257 INFO:teuthology.orchestra.run.smithi086.stdout: "blocklisted": false, 2024-04-25T12:21:38.257 INFO:teuthology.orchestra.run.smithi086.stdout: "fs_name": "cephfs" 2024-04-25T12:21:38.257 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-25T12:21:38.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:21:38.268 DEBUG:teuthology.orchestra.run.smithi086:> stat --file-system '--printf=%T 2024-04-25T12:21:38.269 DEBUG:teuthology.orchestra.run.smithi086:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-04-25T12:21:38.274 INFO:teuthology.orchestra.run.smithi086.stdout:fuseblk 2024-04-25T12:21:38.275 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-04-25T12:21:38.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:21:38.275 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-04-25T12:21:38.329 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-04-25T12:21:38.410 INFO:tasks.ceph.mds.f.smithi134.stderr:2024-04-25T12:21:38.407+0000 7f970442b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T12:21:38.414 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T12:21:39.286 INFO:teuthology.orchestra.run.smithi086.stdout:# file: . 2024-04-25T12:21:39.286 INFO:teuthology.orchestra.run.smithi086.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-04-25T12:21:39.286 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:21:39.286 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T12:21:39.294 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-04-25T12:21:39.294 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T12:21:39.344 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T12:21:39.515 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.511+0000 7f83d86f6640 1 Processor -- start 2024-04-25T12:21:39.515 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.511+0000 7f83d86f6640 1 -- start start 2024-04-25T12:21:39.516 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.511+0000 7f83d86f6640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f83d014ffa0 0x7f83d006f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:39.516 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.511+0000 7f83d86f6640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83d00c5d70 con 0x7f83d0074100 2024-04-25T12:21:39.516 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.511+0000 7f83d86f6640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83d00c6050 con 0x7f83d014fbc0 2024-04-25T12:21:39.516 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.511+0000 7f83d86f6640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f83d00c6330 con 0x7f83d014ffa0 2024-04-25T12:21:39.516 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.511+0000 7f83d6c93640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f83d0074100 0x7f83d00c7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:53072/0 (socket says 172.21.15.86:53072) 2024-04-25T12:21:39.516 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.511+0000 7f83d6c93640 1 -- 172.21.15.86:0/2369127211 learned_addr learned my addr 172.21.15.86:0/2369127211 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-04-25T12:21:39.516 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.511+0000 7f83d5c91640 1 --2- 172.21.15.86:0/2369127211 >> v2:172.21.15.134:3300/0 conn(0x7f83d014ffa0 0x7f83d006f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:39.516 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.511+0000 7f83d5490640 1 -- 172.21.15.86:0/2369127211 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1389394058 0 0) 0x7f83d00c5d70 con 0x7f83d0074100 2024-04-25T12:21:39.517 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.511+0000 7f83d5490640 1 -- 172.21.15.86:0/2369127211 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83bc003530 con 0x7f83d0074100 2024-04-25T12:21:39.519 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.511+0000 7f83d5490640 1 -- 172.21.15.86:0/2369127211 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 131477162 0 0) 0x7f83bc003530 con 0x7f83d0074100 2024-04-25T12:21:39.519 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.511+0000 7f83d5490640 1 -- 172.21.15.86:0/2369127211 >> v2:172.21.15.134:3300/0 conn(0x7f83d014ffa0 msgr2=0x7f83d006f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:39.519 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.511+0000 7f83d5490640 1 --2- 172.21.15.86:0/2369127211 >> v2:172.21.15.134:3300/0 conn(0x7f83d014ffa0 0x7f83d006f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:39.519 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.511+0000 7f83d5490640 1 -- 172.21.15.86:0/2369127211 >> v1:172.21.15.134:6789/0 conn(0x7f83d014fbc0 legacy=0x7f83d00c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:39.519 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.511+0000 7f83d5490640 1 -- 172.21.15.86:0/2369127211 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83d00c6610 con 0x7f83d0074100 2024-04-25T12:21:39.519 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.511+0000 7f83d5490640 1 -- 172.21.15.86:0/2369127211 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1387950573 0 0) 0x7f83c8001a00 con 0x7f83d0074100 2024-04-25T12:21:39.519 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.511+0000 7f83d5490640 1 -- 172.21.15.86:0/2369127211 >> v1:172.21.15.86:6789/0 conn(0x7f83d0074100 legacy=0x7f83d00c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:39.519 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.511+0000 7f83d5490640 1 --2- 172.21.15.86:0/2369127211 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f83bc0039c0 0x7f83bc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:39.519 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.511+0000 7f83d5490640 1 --2- 172.21.15.86:0/2369127211 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f83bc004810 0x7f83bc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:39.519 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.511+0000 7f83d5490640 1 --2- 172.21.15.86:0/2369127211 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83bc0051d0 0x7f83bc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:39.519 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.511+0000 7f83d5490640 1 -- 172.21.15.86:0/2369127211 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f83d00c6330 con 0x7f83bc004810 2024-04-25T12:21:39.519 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.511+0000 7f83d5490640 1 -- 172.21.15.86:0/2369127211 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f83bc00c070 con 0x7f83bc0051d0 2024-04-25T12:21:39.519 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.511+0000 7f83d5490640 1 -- 172.21.15.86:0/2369127211 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f83bc00c270 con 0x7f83bc0039c0 2024-04-25T12:21:39.520 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.511+0000 7f83d5c91640 1 --2- 172.21.15.86:0/2369127211 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f83bc004810 0x7f83bc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:39.520 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.511+0000 7f83d6492640 1 --2- 172.21.15.86:0/2369127211 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f83bc0039c0 0x7f83bc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:39.520 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.511+0000 7f83d6c93640 1 --2- 172.21.15.86:0/2369127211 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83bc0051d0 0x7f83bc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:39.520 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.511+0000 7f83d5c91640 1 -- 172.21.15.86:0/2369127211 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f83bc0039c0 msgr2=0x7f83bc003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:39.520 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.511+0000 7f83d5c91640 1 --2- 172.21.15.86:0/2369127211 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f83bc0039c0 0x7f83bc003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:39.520 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.511+0000 7f83d5c91640 1 -- 172.21.15.86:0/2369127211 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83bc0051d0 msgr2=0x7f83bc00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:39.520 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.511+0000 7f83d5c91640 1 --2- 172.21.15.86:0/2369127211 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83bc0051d0 0x7f83bc00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:39.520 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.511+0000 7f83d5c91640 1 -- 172.21.15.86:0/2369127211 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83bc003530 con 0x7f83bc004810 2024-04-25T12:21:39.520 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.511+0000 7f83d6c93640 1 -- 172.21.15.86:0/2369127211 reap_dead start 2024-04-25T12:21:39.520 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.511+0000 7f83d6492640 1 --2- 172.21.15.86:0/2369127211 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f83bc0039c0 0x7f83bc003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:21:39.521 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.515+0000 7f83d5c91640 1 --2- 172.21.15.86:0/2369127211 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f83bc004810 0x7f83bc004c90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f83c0009ae0 tx=0x7f83c001ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=465b774d247eb56 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:39.521 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.515+0000 7f83d5490640 1 -- 172.21.15.86:0/2369127211 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83c00b2070 con 0x7f83bc004810 2024-04-25T12:21:39.522 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.515+0000 7f83d5490640 1 -- 172.21.15.86:0/2369127211 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83c00a5550 con 0x7f83bc004810 2024-04-25T12:21:39.522 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.515+0000 7f83d5490640 1 -- 172.21.15.86:0/2369127211 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83c00096b0 con 0x7f83bc004810 2024-04-25T12:21:39.522 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.515+0000 7f83d86f6640 1 -- 172.21.15.86:0/2369127211 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f83bc004810 msgr2=0x7f83bc004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:39.522 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.515+0000 7f83d86f6640 1 --2- 172.21.15.86:0/2369127211 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f83bc004810 0x7f83bc004c90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f83c0009ae0 tx=0x7f83c001ca70 comp rx=0 tx=0).stop 2024-04-25T12:21:39.522 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.515+0000 7f83d86f6640 1 -- 172.21.15.86:0/2369127211 shutdown_connections 2024-04-25T12:21:39.522 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.515+0000 7f83d86f6640 1 --2- 172.21.15.86:0/2369127211 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f83bc004810 0x7f83bc004c90 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:39.522 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.515+0000 7f83d86f6640 1 -- 172.21.15.86:0/2369127211 >> 172.21.15.86:0/2369127211 conn(0x7f83d006b9d0 msgr2=0x7f83d006bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:39.522 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.515+0000 7f83d86f6640 1 -- 172.21.15.86:0/2369127211 shutdown_connections 2024-04-25T12:21:39.522 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.515+0000 7f83d86f6640 1 -- 172.21.15.86:0/2369127211 wait complete. 2024-04-25T12:21:39.522 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.515+0000 7f83d86f6640 1 Processor -- start 2024-04-25T12:21:39.522 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.515+0000 7f83d86f6640 1 -- start start 2024-04-25T12:21:39.524 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.519+0000 7f83d86f6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83bc004810 0x7f83d014a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:39.524 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.519+0000 7f83d86f6640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f83d014adf0 0x7f83d014bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:39.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.519+0000 7f83d86f6640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f83d014c520 0x7f83d0151b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:39.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.519+0000 7f83d86f6640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f83d0068350 con 0x7f83d014adf0 2024-04-25T12:21:39.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.519+0000 7f83d86f6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f83d00681d0 con 0x7f83bc004810 2024-04-25T12:21:39.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.519+0000 7f83d86f6640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f83d006f700 con 0x7f83d014c520 2024-04-25T12:21:39.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.519+0000 7f83d5c91640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f83d014adf0 0x7f83d014bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:39.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.519+0000 7f83d5c91640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f83d014adf0 0x7f83d014bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:45892/0 (socket says 172.21.15.86:45892) 2024-04-25T12:21:39.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.519+0000 7f83d5c91640 1 -- 172.21.15.86:0/21906393 learned_addr learned my addr 172.21.15.86:0/21906393 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:39.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.519+0000 7f83d6492640 1 --2- 172.21.15.86:0/21906393 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83bc004810 0x7f83d014a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:39.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.519+0000 7f83d6c93640 1 --2- 172.21.15.86:0/21906393 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f83d014c520 0x7f83d0151b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:39.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.519+0000 7f83d5c91640 1 -- 172.21.15.86:0/21906393 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f83d014c520 msgr2=0x7f83d0151b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:39.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.519+0000 7f83d5c91640 1 --2- 172.21.15.86:0/21906393 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f83d014c520 0x7f83d0151b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:39.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.519+0000 7f83d5c91640 1 -- 172.21.15.86:0/21906393 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83bc004810 msgr2=0x7f83d014a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:39.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.519+0000 7f83d5c91640 1 --2- 172.21.15.86:0/21906393 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83bc004810 0x7f83d014a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:39.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.519+0000 7f83d5c91640 1 -- 172.21.15.86:0/21906393 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83d014ca90 con 0x7f83d014adf0 2024-04-25T12:21:39.526 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.519+0000 7f83d6492640 1 --2- 172.21.15.86:0/21906393 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83bc004810 0x7f83d014a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:21:39.526 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.519+0000 7f83d5c91640 1 --2- 172.21.15.86:0/21906393 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f83d014adf0 0x7f83d014bfe0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f83c00b0040 tx=0x7f83c0019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:39.526 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.519+0000 7f83c6ffd640 1 -- 172.21.15.86:0/21906393 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83c00b2040 con 0x7f83d014adf0 2024-04-25T12:21:39.526 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.519+0000 7f83c6ffd640 1 -- 172.21.15.86:0/21906393 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83c0004020 con 0x7f83d014adf0 2024-04-25T12:21:39.526 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.519+0000 7f83c6ffd640 1 -- 172.21.15.86:0/21906393 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83c0004410 con 0x7f83d014adf0 2024-04-25T12:21:39.526 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.519+0000 7f83d86f6640 1 -- 172.21.15.86:0/21906393 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83d014cd70 con 0x7f83d014adf0 2024-04-25T12:21:39.526 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.519+0000 7f83d86f6640 1 -- 172.21.15.86:0/21906393 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83d014d330 con 0x7f83d014adf0 2024-04-25T12:21:39.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.519+0000 7f83d86f6640 1 -- 172.21.15.86:0/21906393 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83d0075df0 con 0x7f83d014adf0 2024-04-25T12:21:39.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.519+0000 7f83c6ffd640 1 -- 172.21.15.86:0/21906393 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f83c00bf020 con 0x7f83d014adf0 2024-04-25T12:21:39.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.519+0000 7f83c6ffd640 1 --2- 172.21.15.86:0/21906393 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f83b40683b0 0x7f83b406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:39.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.519+0000 7f83c6ffd640 1 -- 172.21.15.86:0/21906393 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f83c0120840 con 0x7f83d014adf0 2024-04-25T12:21:39.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.519+0000 7f83d6492640 1 --2- 172.21.15.86:0/21906393 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f83b40683b0 0x7f83b406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:39.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.523+0000 7f83d6492640 1 --2- 172.21.15.86:0/21906393 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f83b40683b0 0x7f83b406a870 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f83cc000c10 tx=0x7f83cc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:39.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.527+0000 7f83c6ffd640 1 -- 172.21.15.86:0/21906393 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f83c0016780 con 0x7f83d014adf0 2024-04-25T12:21:39.690 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.687+0000 7f83d86f6640 1 -- 172.21.15.86:0/21906393 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f83d014e820 con 0x7f83d014adf0 2024-04-25T12:21:39.694 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.687+0000 7f83c6ffd640 1 -- 172.21.15.86:0/21906393 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18514 (secure 0 0 0) 0x7f83c00f0b50 con 0x7f83d014adf0 2024-04-25T12:21:39.694 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:21:39.694 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":24,"fsid":"f2ef5c0c-9576-4650-b4f7-6cb14247f62a","created":"2024-04-25T12:20:59.241733+0000","modified":"2024-04-25T12:21:28.541128+0000","last_up_change":"2024-04-25T12:21:10.939617+0000","last_in_change":"2024-04-25T12:21:01.534145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T12:21:11.839922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T12:21:21.854040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T12:21:22.406060+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T12:21:26.152386+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1f713f00-ef9f-4a6f-a620-38a8a1f8a822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6801","nonce":2812764579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6803","nonce":2812764579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6807","nonce":2812764579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6805","nonce":2812764579}]},"public_addr":"172.21.15.86:6801/2812764579","cluster_addr":"172.21.15.86:6803/2812764579","heartbeat_back_addr":"172.21.15.86:6807/2812764579","heartbeat_front_addr":"172.21.15.86:6805/2812764579","state":["exists","up"]},{"osd":1,"uuid":"baf6606d-a556-4fbe-a930-855e04ff1534","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6809","nonce":467966038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6811","nonce":467966038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6815","nonce":467966038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6813","nonce":467966038}]},"public_addr":"172.21.15.86:6809/467966038","cluster_addr":"172.21.15.86:6811/467966038","heartbeat_back_addr":"172.21.15.86:6815/467966038","heartbeat_front_addr":"172.21.15.86:6813/467966038","state":["exists","up"]},{"osd":2,"uuid":"c983d68e-6d60-434f-aed6-108420c5dd09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6817","nonce":3279762843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6820","nonce":3279762843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6825","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6827","nonce":3279762843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6824","nonce":3279762843}]},"public_addr":"172.21.15.86:6817/3279762843","cluster_addr":"172.21.15.86:6820/3279762843","heartbeat_back_addr":"172.21.15.86:6827/3279762843","heartbeat_front_addr":"172.21.15.86:6824/3279762843","state":["exists","up"]},{"osd":3,"uuid":"e77657bb-45aa-43bf-ab41-c7377eb495ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6821","nonce":2861354413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6826","nonce":2861354413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6831","nonce":2861354413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6829","nonce":2861354413}]},"public_addr":"172.21.15.86:6821/2861354413","cluster_addr":"172.21.15.86:6826/2861354413","heartbeat_back_addr":"172.21.15.86:6831/2861354413","heartbeat_front_addr":"172.21.15.86:6829/2861354413","state":["exists","up"]},{"osd":4,"uuid":"252bd300-d75a-4b00-be4b-27e6b51de4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6802","nonce":1872913602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6805","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6808","nonce":1872913602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6815","nonce":1872913602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6813","nonce":1872913602}]},"public_addr":"172.21.15.134:6802/1872913602","cluster_addr":"172.21.15.134:6808/1872913602","heartbeat_back_addr":"172.21.15.134:6815/1872913602","heartbeat_front_addr":"172.21.15.134:6813/1872913602","state":["exists","up"]},{"osd":5,"uuid":"4135da3f-7427-4409-a48e-78bd8a7b46ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6801","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6803","nonce":2261413981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6806","nonce":2261413981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6812","nonce":2261413981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6809","nonce":2261413981}]},"public_addr":"172.21.15.134:6803/2261413981","cluster_addr":"172.21.15.134:6806/2261413981","heartbeat_back_addr":"172.21.15.134:6812/2261413981","heartbeat_front_addr":"172.21.15.134:6809/2261413981","state":["exists","up"]},{"osd":6,"uuid":"b6e7a5f1-fa7e-497d-abac-a19994d26820","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6825","nonce":2841082767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6827","nonce":2841082767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6831","nonce":2841082767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6829","nonce":2841082767}]},"public_addr":"172.21.15.134:6825/2841082767","cluster_addr":"172.21.15.134:6827/2841082767","heartbeat_back_addr":"172.21.15.134:6831/2841082767","heartbeat_front_addr":"172.21.15.134:6829/2841082767","state":["exists","up"]},{"osd":7,"uuid":"c5597e50-1962-4103-9124-dd7bceb8ac97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6817","nonce":1277404274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6819","nonce":1277404274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6823","nonce":1277404274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6821","nonce":1277404274}]},"public_addr":"172.21.15.134:6817/1277404274","cluster_addr":"172.21.15.134:6819/1277404274","heartbeat_back_addr":"172.21.15.134:6823/1277404274","heartbeat_front_addr":"172.21.15.134:6821/1277404274","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.018125+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.157958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.113619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.136904+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.844514+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.872629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.775339+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.822867+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T12:21:39.696 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.691+0000 7f83d86f6640 1 -- 172.21.15.86:0/21906393 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f83b40683b0 msgr2=0x7f83b406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:39.696 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.691+0000 7f83d86f6640 1 --2- 172.21.15.86:0/21906393 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f83b40683b0 0x7f83b406a870 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f83cc000c10 tx=0x7f83cc009040 comp rx=0 tx=0).stop 2024-04-25T12:21:39.696 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.691+0000 7f83d86f6640 1 -- 172.21.15.86:0/21906393 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f83d014adf0 msgr2=0x7f83d014bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:39.696 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.691+0000 7f83d86f6640 1 --2- 172.21.15.86:0/21906393 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f83d014adf0 0x7f83d014bfe0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f83c00b0040 tx=0x7f83c0019810 comp rx=0 tx=0).stop 2024-04-25T12:21:39.696 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.691+0000 7f83d86f6640 1 -- 172.21.15.86:0/21906393 shutdown_connections 2024-04-25T12:21:39.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.691+0000 7f83d86f6640 1 --2- 172.21.15.86:0/21906393 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f83d014c520 0x7f83d0151b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:39.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.691+0000 7f83d86f6640 1 --2- 172.21.15.86:0/21906393 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f83b40683b0 0x7f83b406a870 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:39.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.691+0000 7f83d86f6640 1 --2- 172.21.15.86:0/21906393 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f83d014adf0 0x7f83d014bfe0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:39.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.691+0000 7f83d86f6640 1 --2- 172.21.15.86:0/21906393 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83bc004810 0x7f83d014a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:39.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.691+0000 7f83d86f6640 1 -- 172.21.15.86:0/21906393 >> 172.21.15.86:0/21906393 conn(0x7f83d006b9d0 msgr2=0x7f83d0071980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:39.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.691+0000 7f83d86f6640 1 -- 172.21.15.86:0/21906393 shutdown_connections 2024-04-25T12:21:39.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.691+0000 7f83d86f6640 1 -- 172.21.15.86:0/21906393 wait complete. 2024-04-25T12:21:39.712 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T12:21:11.839922+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T12:21:21.854040+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T12:21:22.406060+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T12:21:26.152386+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T12:21:39.713 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T12:21:39.835 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.831+0000 7f78d9777640 1 Processor -- start 2024-04-25T12:21:39.835 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.831+0000 7f78d9777640 1 -- start start 2024-04-25T12:21:39.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.831+0000 7f78d9777640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f78d414fbc0 0x7f78d406f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:39.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.831+0000 7f78d9777640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f78d414ffa0 0x7f78d40c8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:39.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.831+0000 7f78d9777640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f78d4074100 0x7f78d40c8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:39.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.831+0000 7f78d9777640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f78d40c5d70 con 0x7f78d414fbc0 2024-04-25T12:21:39.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.831+0000 7f78d9777640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f78d40c6050 con 0x7f78d414ffa0 2024-04-25T12:21:39.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.831+0000 7f78d9777640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f78d40c6330 con 0x7f78d4074100 2024-04-25T12:21:39.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.831+0000 7f78d2ffd640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f78d414fbc0 0x7f78d406f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:39.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.831+0000 7f78d2ffd640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f78d414fbc0 0x7f78d406f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:45896/0 (socket says 172.21.15.86:45896) 2024-04-25T12:21:39.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.831+0000 7f78d2ffd640 1 -- 172.21.15.86:0/1547364743 learned_addr learned my addr 172.21.15.86:0/1547364743 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:39.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.831+0000 7f78d2ffd640 1 -- 172.21.15.86:0/1547364743 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f78d4074100 msgr2=0x7f78d40c8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:39.838 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.831+0000 7f78d37fe640 1 --2- 172.21.15.86:0/1547364743 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f78d4074100 0x7f78d40c8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:39.838 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.831+0000 7f78d27fc640 1 --2- 172.21.15.86:0/1547364743 >> v2:172.21.15.134:3300/0 conn(0x7f78d414ffa0 0x7f78d40c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:39.838 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.831+0000 7f78d2ffd640 1 --2- 172.21.15.86:0/1547364743 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f78d4074100 0x7f78d40c8760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:39.838 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.831+0000 7f78d2ffd640 1 -- 172.21.15.86:0/1547364743 >> v2:172.21.15.134:3300/0 conn(0x7f78d414ffa0 msgr2=0x7f78d40c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:39.838 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.831+0000 7f78d2ffd640 1 --2- 172.21.15.86:0/1547364743 >> v2:172.21.15.134:3300/0 conn(0x7f78d414ffa0 0x7f78d40c8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:39.838 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.831+0000 7f78d2ffd640 1 -- 172.21.15.86:0/1547364743 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78d40c6610 con 0x7f78d414fbc0 2024-04-25T12:21:39.838 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.831+0000 7f78d27fc640 1 --2- 172.21.15.86:0/1547364743 >> v2:172.21.15.134:3300/0 conn(0x7f78d414ffa0 0x7f78d40c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:21:39.840 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.835+0000 7f78d2ffd640 1 --2- 172.21.15.86:0/1547364743 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78d414fbc0 0x7f78d406f700 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f78d40691a0 tx=0x7f78c401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad621134cd29d75c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:39.840 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.835+0000 7f78d1ffb640 1 -- 172.21.15.86:0/1547364743 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78c40aa660 con 0x7f78d414fbc0 2024-04-25T12:21:39.840 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.835+0000 7f78d1ffb640 1 -- 172.21.15.86:0/1547364743 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78c40af070 con 0x7f78d414fbc0 2024-04-25T12:21:39.840 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.835+0000 7f78d1ffb640 1 -- 172.21.15.86:0/1547364743 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78c40aaa20 con 0x7f78d414fbc0 2024-04-25T12:21:39.840 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.835+0000 7f78d9777640 1 -- 172.21.15.86:0/1547364743 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78d414fbc0 msgr2=0x7f78d406f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:39.840 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.835+0000 7f78d9777640 1 --2- 172.21.15.86:0/1547364743 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78d414fbc0 0x7f78d406f700 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f78d40691a0 tx=0x7f78c401c520 comp rx=0 tx=0).stop 2024-04-25T12:21:39.840 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.835+0000 7f78d9777640 1 -- 172.21.15.86:0/1547364743 shutdown_connections 2024-04-25T12:21:39.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.835+0000 7f78d9777640 1 --2- 172.21.15.86:0/1547364743 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f78d4074100 0x7f78d40c8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:39.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.835+0000 7f78d9777640 1 --2- 172.21.15.86:0/1547364743 >> v2:172.21.15.134:3300/0 conn(0x7f78d414ffa0 0x7f78d40c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:39.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.835+0000 7f78d9777640 1 --2- 172.21.15.86:0/1547364743 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78d414fbc0 0x7f78d406f700 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:39.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.835+0000 7f78d9777640 1 -- 172.21.15.86:0/1547364743 >> 172.21.15.86:0/1547364743 conn(0x7f78d406b9d0 msgr2=0x7f78d406bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:39.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.835+0000 7f78d9777640 1 -- 172.21.15.86:0/1547364743 shutdown_connections 2024-04-25T12:21:39.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.835+0000 7f78d9777640 1 -- 172.21.15.86:0/1547364743 wait complete. 2024-04-25T12:21:39.844 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.835+0000 7f78d9777640 1 Processor -- start 2024-04-25T12:21:39.845 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.835+0000 7f78d9777640 1 -- start start 2024-04-25T12:21:39.845 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.835+0000 7f78d9777640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f78d4074100 0x7f78d40c5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:39.845 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.835+0000 7f78d9777640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78d414fbc0 0x7f78d41514f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:39.845 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.835+0000 7f78d9777640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78d414ffa0 0x7f78d4157ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:39.845 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.835+0000 7f78d9777640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f78d41592e0 con 0x7f78d414ffa0 2024-04-25T12:21:39.845 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.835+0000 7f78d9777640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f78d4159160 con 0x7f78d414fbc0 2024-04-25T12:21:39.845 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.835+0000 7f78d9777640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f78d4159460 con 0x7f78d4074100 2024-04-25T12:21:39.845 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.835+0000 7f78d37fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78d414ffa0 0x7f78d4157ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:39.845 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.835+0000 7f78d37fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78d414ffa0 0x7f78d4157ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:45912/0 (socket says 172.21.15.86:45912) 2024-04-25T12:21:39.845 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.835+0000 7f78d37fe640 1 -- 172.21.15.86:0/3504041703 learned_addr learned my addr 172.21.15.86:0/3504041703 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:39.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.835+0000 7f78d2ffd640 1 --2- 172.21.15.86:0/3504041703 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f78d4074100 0x7f78d40c5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:39.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.835+0000 7f78d27fc640 1 --2- 172.21.15.86:0/3504041703 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78d414fbc0 0x7f78d41514f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:39.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.835+0000 7f78d37fe640 1 -- 172.21.15.86:0/3504041703 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f78d4074100 msgr2=0x7f78d40c5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:39.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.835+0000 7f78d37fe640 1 --2- 172.21.15.86:0/3504041703 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f78d4074100 0x7f78d40c5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:39.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.835+0000 7f78d37fe640 1 -- 172.21.15.86:0/3504041703 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78d414fbc0 msgr2=0x7f78d41514f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:39.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.835+0000 7f78d37fe640 1 --2- 172.21.15.86:0/3504041703 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78d414fbc0 0x7f78d41514f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:39.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.835+0000 7f78d37fe640 1 -- 172.21.15.86:0/3504041703 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78d4152b50 con 0x7f78d414ffa0 2024-04-25T12:21:39.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.835+0000 7f78d37fe640 1 --2- 172.21.15.86:0/3504041703 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78d414ffa0 0x7f78d4157ea0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f78cc00ccf0 tx=0x7f78cc00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:39.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.835+0000 7f78bb7fe640 1 -- 172.21.15.86:0/3504041703 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78cc003ba0 con 0x7f78d414ffa0 2024-04-25T12:21:39.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.835+0000 7f78bb7fe640 1 -- 172.21.15.86:0/3504041703 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78cc003d40 con 0x7f78d414ffa0 2024-04-25T12:21:39.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.835+0000 7f78d9777640 1 -- 172.21.15.86:0/3504041703 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78d4158d60 con 0x7f78d414ffa0 2024-04-25T12:21:39.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.835+0000 7f78bb7fe640 1 -- 172.21.15.86:0/3504041703 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78cc004260 con 0x7f78d414ffa0 2024-04-25T12:21:39.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.835+0000 7f78d9777640 1 -- 172.21.15.86:0/3504041703 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78d41f75c0 con 0x7f78d414ffa0 2024-04-25T12:21:39.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.839+0000 7f78d9777640 1 -- 172.21.15.86:0/3504041703 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78d4075df0 con 0x7f78d414ffa0 2024-04-25T12:21:39.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.839+0000 7f78bb7fe640 1 -- 172.21.15.86:0/3504041703 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f78cc004400 con 0x7f78d414ffa0 2024-04-25T12:21:39.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.839+0000 7f78bb7fe640 1 --2- 172.21.15.86:0/3504041703 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f78c0068380 0x7f78c006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:39.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.839+0000 7f78bb7fe640 1 -- 172.21.15.86:0/3504041703 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f78cc0876a0 con 0x7f78d414ffa0 2024-04-25T12:21:39.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.839+0000 7f78d2ffd640 1 --2- 172.21.15.86:0/3504041703 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f78c0068380 0x7f78c006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:39.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.839+0000 7f78d2ffd640 1 --2- 172.21.15.86:0/3504041703 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f78c0068380 0x7f78c006a840 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f78c40ae000 tx=0x7f78c40a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:39.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.843+0000 7f78bb7fe640 1 -- 172.21.15.86:0/3504041703 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f78cc01d340 con 0x7f78d414ffa0 2024-04-25T12:21:40.000 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.995+0000 7f78d9777640 1 -- 172.21.15.86:0/3504041703 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f78d40c7df0 con 0x7f78d414ffa0 2024-04-25T12:21:40.001 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.995+0000 7f78bb7fe640 1 -- 172.21.15.86:0/3504041703 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7f78cc057920 con 0x7f78d414ffa0 2024-04-25T12:21:40.001 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 1 2024-04-25T12:21:40.003 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.999+0000 7f78d9777640 1 -- 172.21.15.86:0/3504041703 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f78c0068380 msgr2=0x7f78c006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:40.003 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.999+0000 7f78d9777640 1 --2- 172.21.15.86:0/3504041703 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f78c0068380 0x7f78c006a840 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f78c40ae000 tx=0x7f78c40a7000 comp rx=0 tx=0).stop 2024-04-25T12:21:40.003 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.999+0000 7f78d9777640 1 -- 172.21.15.86:0/3504041703 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78d414ffa0 msgr2=0x7f78d4157ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:40.003 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.999+0000 7f78d9777640 1 --2- 172.21.15.86:0/3504041703 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78d414ffa0 0x7f78d4157ea0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f78cc00ccf0 tx=0x7f78cc00a660 comp rx=0 tx=0).stop 2024-04-25T12:21:40.003 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.999+0000 7f78d9777640 1 -- 172.21.15.86:0/3504041703 shutdown_connections 2024-04-25T12:21:40.004 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.999+0000 7f78d9777640 1 --2- 172.21.15.86:0/3504041703 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f78c0068380 0x7f78c006a840 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:40.004 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.999+0000 7f78d9777640 1 --2- 172.21.15.86:0/3504041703 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78d414ffa0 0x7f78d4157ea0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:40.004 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.999+0000 7f78d9777640 1 --2- 172.21.15.86:0/3504041703 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78d414fbc0 0x7f78d41514f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:40.004 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.999+0000 7f78d9777640 1 --2- 172.21.15.86:0/3504041703 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f78d4074100 0x7f78d40c5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:40.004 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.999+0000 7f78d9777640 1 -- 172.21.15.86:0/3504041703 >> 172.21.15.86:0/3504041703 conn(0x7f78d406b9d0 msgr2=0x7f78d414e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:40.004 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.999+0000 7f78d9777640 1 -- 172.21.15.86:0/3504041703 shutdown_connections 2024-04-25T12:21:40.004 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:39.999+0000 7f78d9777640 1 -- 172.21.15.86:0/3504041703 wait complete. 2024-04-25T12:21:40.018 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T12:21:40.139 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.135+0000 7f05e913e640 1 Processor -- start 2024-04-25T12:21:40.139 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.135+0000 7f05e913e640 1 -- start start 2024-04-25T12:21:40.140 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.135+0000 7f05e913e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05e40cda50 0x7f05e40c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:40.140 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.135+0000 7f05e913e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f05e415b0b0 0x7f05e415b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:40.140 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.135+0000 7f05e913e640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05e415beb0 con 0x7f05e4155350 2024-04-25T12:21:40.140 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.135+0000 7f05e913e640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f05e40cca40 con 0x7f05e415b0b0 2024-04-25T12:21:40.140 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.135+0000 7f05e913e640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f05e40ccc90 con 0x7f05e40cda50 2024-04-25T12:21:40.140 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.135+0000 7f05e259c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05e40cda50 0x7f05e40c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:40.140 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.135+0000 7f05e259c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05e40cda50 0x7f05e40c59c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.86:33814/0 (socket says 172.21.15.86:33814) 2024-04-25T12:21:40.140 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.135+0000 7f05e259c640 1 -- 172.21.15.86:0/3084784523 learned_addr learned my addr 172.21.15.86:0/3084784523 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:40.141 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.135+0000 7f05e359e640 1 --2- 172.21.15.86:0/3084784523 >> v2:172.21.15.134:3300/0 conn(0x7f05e415b0b0 0x7f05e415b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:40.141 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.135+0000 7f05e259c640 1 -- 172.21.15.86:0/3084784523 >> v2:172.21.15.134:3300/0 conn(0x7f05e415b0b0 msgr2=0x7f05e415b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:40.141 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.135+0000 7f05e259c640 1 --2- 172.21.15.86:0/3084784523 >> v2:172.21.15.134:3300/0 conn(0x7f05e415b0b0 0x7f05e415b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:40.141 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.135+0000 7f05e259c640 1 -- 172.21.15.86:0/3084784523 >> v1:172.21.15.134:6789/0 conn(0x7f05e4155350 legacy=0x7f05e40cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:40.141 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.135+0000 7f05e259c640 1 -- 172.21.15.86:0/3084784523 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05e40ccf70 con 0x7f05e40cda50 2024-04-25T12:21:40.143 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.139+0000 7f05e259c640 1 --2- 172.21.15.86:0/3084784523 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05e40cda50 0x7f05e40c59c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f05d8009870 tx=0x7f05d801ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4028466d27dc09c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:40.144 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.139+0000 7f05e1d9b640 1 -- 172.21.15.86:0/3084784523 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d80b5070 con 0x7f05e40cda50 2024-04-25T12:21:40.144 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.139+0000 7f05e1d9b640 1 -- 172.21.15.86:0/3084784523 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05d80a8a50 con 0x7f05e40cda50 2024-04-25T12:21:40.144 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.139+0000 7f05e1d9b640 1 -- 172.21.15.86:0/3084784523 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d80a8e20 con 0x7f05e40cda50 2024-04-25T12:21:40.145 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.139+0000 7f05e913e640 1 -- 172.21.15.86:0/3084784523 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05e40cda50 msgr2=0x7f05e40c59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:40.145 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.139+0000 7f05e913e640 1 --2- 172.21.15.86:0/3084784523 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05e40cda50 0x7f05e40c59c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f05d8009870 tx=0x7f05d801ed50 comp rx=0 tx=0).stop 2024-04-25T12:21:40.145 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.139+0000 7f05e913e640 1 -- 172.21.15.86:0/3084784523 shutdown_connections 2024-04-25T12:21:40.145 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.139+0000 7f05e913e640 1 --2- 172.21.15.86:0/3084784523 >> v2:172.21.15.134:3300/0 conn(0x7f05e415b0b0 0x7f05e415b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:40.145 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.139+0000 7f05e913e640 1 --2- 172.21.15.86:0/3084784523 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05e40cda50 0x7f05e40c59c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:40.145 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.139+0000 7f05e913e640 1 -- 172.21.15.86:0/3084784523 >> 172.21.15.86:0/3084784523 conn(0x7f05e406cc30 msgr2=0x7f05e406d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:40.145 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.139+0000 7f05e913e640 1 -- 172.21.15.86:0/3084784523 shutdown_connections 2024-04-25T12:21:40.145 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.139+0000 7f05e913e640 1 -- 172.21.15.86:0/3084784523 wait complete. 2024-04-25T12:21:40.147 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.139+0000 7f05e913e640 1 Processor -- start 2024-04-25T12:21:40.147 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.139+0000 7f05e913e640 1 -- start start 2024-04-25T12:21:40.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.139+0000 7f05e913e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05e40cda50 0x7f05e4154740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:40.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.139+0000 7f05e913e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05e4155350 0x7f05e415a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:40.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.139+0000 7f05e913e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05e415b0b0 0x7f05e414b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:40.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.139+0000 7f05e913e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f05e4155730 con 0x7f05e40cda50 2024-04-25T12:21:40.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.139+0000 7f05e913e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f05e40cd530 con 0x7f05e4155350 2024-04-25T12:21:40.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.139+0000 7f05e913e640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f05e415e860 con 0x7f05e415b0b0 2024-04-25T12:21:40.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.139+0000 7f05e2d9d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05e40cda50 0x7f05e4154740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:40.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.139+0000 7f05e2d9d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05e40cda50 0x7f05e4154740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:45914/0 (socket says 172.21.15.86:45914) 2024-04-25T12:21:40.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.139+0000 7f05e2d9d640 1 -- 172.21.15.86:0/2393219424 learned_addr learned my addr 172.21.15.86:0/2393219424 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:40.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.143+0000 7f05e359e640 1 --2- 172.21.15.86:0/2393219424 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05e415b0b0 0x7f05e414b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:40.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.143+0000 7f05e259c640 1 --2- 172.21.15.86:0/2393219424 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05e4155350 0x7f05e415a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:40.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.143+0000 7f05e2d9d640 1 -- 172.21.15.86:0/2393219424 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05e415b0b0 msgr2=0x7f05e414b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:40.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.143+0000 7f05e2d9d640 1 --2- 172.21.15.86:0/2393219424 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05e415b0b0 0x7f05e414b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:40.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.143+0000 7f05e2d9d640 1 -- 172.21.15.86:0/2393219424 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05e4155350 msgr2=0x7f05e415a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:40.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.143+0000 7f05e2d9d640 1 --2- 172.21.15.86:0/2393219424 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05e4155350 0x7f05e415a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:40.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.143+0000 7f05e2d9d640 1 -- 172.21.15.86:0/2393219424 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05e40b5d80 con 0x7f05e40cda50 2024-04-25T12:21:40.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.143+0000 7f05e2d9d640 1 --2- 172.21.15.86:0/2393219424 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05e40cda50 0x7f05e4154740 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f05d400c450 tx=0x7f05d400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:40.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.143+0000 7f05cb7fe640 1 -- 172.21.15.86:0/2393219424 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d4016020 con 0x7f05e40cda50 2024-04-25T12:21:40.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.143+0000 7f05cb7fe640 1 -- 172.21.15.86:0/2393219424 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05d40052d0 con 0x7f05e40cda50 2024-04-25T12:21:40.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.143+0000 7f05e913e640 1 -- 172.21.15.86:0/2393219424 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05e40b6060 con 0x7f05e40cda50 2024-04-25T12:21:40.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.143+0000 7f05cb7fe640 1 -- 172.21.15.86:0/2393219424 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d4007260 con 0x7f05e40cda50 2024-04-25T12:21:40.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.143+0000 7f05e913e640 1 -- 172.21.15.86:0/2393219424 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05e40b6620 con 0x7f05e40cda50 2024-04-25T12:21:40.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.143+0000 7f05e913e640 1 -- 172.21.15.86:0/2393219424 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05e4075df0 con 0x7f05e40cda50 2024-04-25T12:21:40.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.143+0000 7f05cb7fe640 1 -- 172.21.15.86:0/2393219424 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f05d4007400 con 0x7f05e40cda50 2024-04-25T12:21:40.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.143+0000 7f05cb7fe640 1 --2- 172.21.15.86:0/2393219424 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f05d0068380 0x7f05d006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:40.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.143+0000 7f05cb7fe640 1 -- 172.21.15.86:0/2393219424 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f05d4086710 con 0x7f05e40cda50 2024-04-25T12:21:40.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.143+0000 7f05e259c640 1 --2- 172.21.15.86:0/2393219424 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f05d0068380 0x7f05d006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:40.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.143+0000 7f05e259c640 1 --2- 172.21.15.86:0/2393219424 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f05d0068380 0x7f05d006a840 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f05d80b2000 tx=0x7f05d8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:40.153 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.147+0000 7f05cb7fe640 1 -- 172.21.15.86:0/2393219424 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f05d4020020 con 0x7f05e40cda50 2024-04-25T12:21:40.303 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.299+0000 7f05e913e640 1 -- 172.21.15.86:0/2393219424 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f05e40cc610 con 0x7f05e40cda50 2024-04-25T12:21:40.304 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.299+0000 7f05cb7fe640 1 -- 172.21.15.86:0/2393219424 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7f05d4005480 con 0x7f05e40cda50 2024-04-25T12:21:40.304 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 32 2024-04-25T12:21:40.307 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.303+0000 7f05e913e640 1 -- 172.21.15.86:0/2393219424 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f05d0068380 msgr2=0x7f05d006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:40.307 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.303+0000 7f05e913e640 1 --2- 172.21.15.86:0/2393219424 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f05d0068380 0x7f05d006a840 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f05d80b2000 tx=0x7f05d8008040 comp rx=0 tx=0).stop 2024-04-25T12:21:40.307 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.303+0000 7f05e913e640 1 -- 172.21.15.86:0/2393219424 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05e40cda50 msgr2=0x7f05e4154740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:40.307 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.303+0000 7f05e913e640 1 --2- 172.21.15.86:0/2393219424 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05e40cda50 0x7f05e4154740 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f05d400c450 tx=0x7f05d400c910 comp rx=0 tx=0).stop 2024-04-25T12:21:40.307 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.303+0000 7f05e913e640 1 -- 172.21.15.86:0/2393219424 shutdown_connections 2024-04-25T12:21:40.307 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.303+0000 7f05e913e640 1 --2- 172.21.15.86:0/2393219424 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05e415b0b0 0x7f05e414b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:40.307 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.303+0000 7f05e913e640 1 --2- 172.21.15.86:0/2393219424 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05e4155350 0x7f05e415a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:40.307 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.303+0000 7f05e913e640 1 --2- 172.21.15.86:0/2393219424 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f05d0068380 0x7f05d006a840 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:40.307 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.303+0000 7f05e913e640 1 --2- 172.21.15.86:0/2393219424 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05e40cda50 0x7f05e4154740 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:40.307 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.303+0000 7f05e913e640 1 -- 172.21.15.86:0/2393219424 >> 172.21.15.86:0/2393219424 conn(0x7f05e406cc30 msgr2=0x7f05e415eb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:40.308 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.303+0000 7f05e913e640 1 -- 172.21.15.86:0/2393219424 shutdown_connections 2024-04-25T12:21:40.308 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.303+0000 7f05e913e640 1 -- 172.21.15.86:0/2393219424 wait complete. 2024-04-25T12:21:40.322 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T12:21:40.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.431+0000 7f84286a0640 1 Processor -- start 2024-04-25T12:21:40.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.431+0000 7f84286a0640 1 -- start start 2024-04-25T12:21:40.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.435+0000 7f84286a0640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f84200cdc80 0x7f842015f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:40.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.435+0000 7f84286a0640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8420143f20 0x7f8420144330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:40.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.435+0000 7f84286a0640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8420144870 con 0x7f84200cd8a0 2024-04-25T12:21:40.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.435+0000 7f84286a0640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f8420072420 con 0x7f84200cdc80 2024-04-25T12:21:40.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.435+0000 7f84286a0640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f842015b300 con 0x7f8420143f20 2024-04-25T12:21:40.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.435+0000 7f842643c640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f84200cd8a0 0x7f84200c9930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:53084/0 (socket says 172.21.15.86:53084) 2024-04-25T12:21:40.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.435+0000 7f8425c3b640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f84200cdc80 0x7f842015f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:40.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.435+0000 7f842643c640 1 -- 172.21.15.86:0/2658842636 learned_addr learned my addr 172.21.15.86:0/2658842636 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-04-25T12:21:40.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.435+0000 7f8426c3d640 1 --2- 172.21.15.86:0/2658842636 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8420143f20 0x7f8420144330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:40.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.435+0000 7f842543a640 1 -- 172.21.15.86:0/2658842636 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1386456770 0 0) 0x7f8420144870 con 0x7f84200cd8a0 2024-04-25T12:21:40.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.435+0000 7f842543a640 1 -- 172.21.15.86:0/2658842636 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f840c003530 con 0x7f84200cd8a0 2024-04-25T12:21:40.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.435+0000 7f8425c3b640 1 -- 172.21.15.86:0/2658842636 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8420143f20 msgr2=0x7f8420144330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:40.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.435+0000 7f8425c3b640 1 --2- 172.21.15.86:0/2658842636 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8420143f20 0x7f8420144330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:40.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.435+0000 7f8425c3b640 1 -- 172.21.15.86:0/2658842636 >> v1:172.21.15.86:6789/0 conn(0x7f84200cd8a0 legacy=0x7f84200c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:40.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.435+0000 7f8425c3b640 1 -- 172.21.15.86:0/2658842636 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f842015b5e0 con 0x7f84200cdc80 2024-04-25T12:21:40.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.439+0000 7f8425c3b640 1 --2- 172.21.15.86:0/2658842636 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84200cdc80 0x7f842015f2b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f84100097c0 tx=0x7f841001ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4baa4e7e8566c047 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:40.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.439+0000 7f842543a640 1 -- 172.21.15.86:0/2658842636 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84100b5070 con 0x7f84200cdc80 2024-04-25T12:21:40.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.439+0000 7f842543a640 1 -- 172.21.15.86:0/2658842636 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84100a8990 con 0x7f84200cdc80 2024-04-25T12:21:40.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.439+0000 7f842543a640 1 -- 172.21.15.86:0/2658842636 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84100a8d60 con 0x7f84200cdc80 2024-04-25T12:21:40.444 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.439+0000 7f84286a0640 1 -- 172.21.15.86:0/2658842636 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84200cdc80 msgr2=0x7f842015f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:40.444 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.439+0000 7f84286a0640 1 --2- 172.21.15.86:0/2658842636 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84200cdc80 0x7f842015f2b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f84100097c0 tx=0x7f841001ec90 comp rx=0 tx=0).stop 2024-04-25T12:21:40.444 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.439+0000 7f84286a0640 1 -- 172.21.15.86:0/2658842636 shutdown_connections 2024-04-25T12:21:40.444 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.439+0000 7f84286a0640 1 --2- 172.21.15.86:0/2658842636 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8420143f20 0x7f8420144330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:40.444 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.439+0000 7f84286a0640 1 --2- 172.21.15.86:0/2658842636 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84200cdc80 0x7f842015f2b0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:40.444 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.439+0000 7f84286a0640 1 -- 172.21.15.86:0/2658842636 >> 172.21.15.86:0/2658842636 conn(0x7f842006fca0 msgr2=0x7f84200700b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:40.445 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.439+0000 7f84286a0640 1 -- 172.21.15.86:0/2658842636 shutdown_connections 2024-04-25T12:21:40.445 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.439+0000 7f84286a0640 1 -- 172.21.15.86:0/2658842636 wait complete. 2024-04-25T12:21:40.447 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.439+0000 7f84286a0640 1 Processor -- start 2024-04-25T12:21:40.447 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.439+0000 7f84286a0640 1 -- start start 2024-04-25T12:21:40.447 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.439+0000 7f84286a0640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84200cd8a0 0x7f842013ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:40.447 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.439+0000 7f84286a0640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f84200cdc80 0x7f842013d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:40.447 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.439+0000 7f84286a0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8420143f20 0x7f842013bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:40.447 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.439+0000 7f84286a0640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f842015be80 con 0x7f84200cd8a0 2024-04-25T12:21:40.447 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.439+0000 7f84286a0640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f842015bba0 con 0x7f8420143f20 2024-04-25T12:21:40.448 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.439+0000 7f84286a0640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f842006bdb0 con 0x7f84200cdc80 2024-04-25T12:21:40.448 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.439+0000 7f842643c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84200cd8a0 0x7f842013ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:40.448 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.439+0000 7f842643c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84200cd8a0 0x7f842013ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:45932/0 (socket says 172.21.15.86:45932) 2024-04-25T12:21:40.448 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.439+0000 7f842643c640 1 -- 172.21.15.86:0/802848544 learned_addr learned my addr 172.21.15.86:0/802848544 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:40.448 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.439+0000 7f8425c3b640 1 --2- 172.21.15.86:0/802848544 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f84200cdc80 0x7f842013d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:40.448 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.439+0000 7f842643c640 1 -- 172.21.15.86:0/802848544 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f84200cdc80 msgr2=0x7f842013d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:40.448 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.439+0000 7f842643c640 1 --2- 172.21.15.86:0/802848544 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f84200cdc80 0x7f842013d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:40.448 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.439+0000 7f842643c640 1 -- 172.21.15.86:0/802848544 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8420143f20 msgr2=0x7f842013bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:40.448 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.439+0000 7f842643c640 1 --2- 172.21.15.86:0/802848544 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8420143f20 0x7f842013bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:40.448 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.439+0000 7f842643c640 1 -- 172.21.15.86:0/802848544 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84201f44e0 con 0x7f84200cd8a0 2024-04-25T12:21:40.448 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.439+0000 7f842643c640 1 --2- 172.21.15.86:0/802848544 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84200cd8a0 0x7f842013ef60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f841c00c460 tx=0x7f841c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:40.448 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.439+0000 7f8416ffd640 1 -- 172.21.15.86:0/802848544 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841c017070 con 0x7f84200cd8a0 2024-04-25T12:21:40.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.439+0000 7f8416ffd640 1 -- 172.21.15.86:0/802848544 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f841c005d10 con 0x7f84200cd8a0 2024-04-25T12:21:40.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.439+0000 7f8416ffd640 1 -- 172.21.15.86:0/802848544 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841c0072b0 con 0x7f84200cd8a0 2024-04-25T12:21:40.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.439+0000 7f84286a0640 1 -- 172.21.15.86:0/802848544 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f842013dbe0 con 0x7f84200cd8a0 2024-04-25T12:21:40.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.439+0000 7f84286a0640 1 -- 172.21.15.86:0/802848544 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84201f1310 con 0x7f84200cd8a0 2024-04-25T12:21:40.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.443+0000 7f84286a0640 1 -- 172.21.15.86:0/802848544 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8420075df0 con 0x7f84200cd8a0 2024-04-25T12:21:40.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.443+0000 7f8416ffd640 1 -- 172.21.15.86:0/802848544 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f841c01a070 con 0x7f84200cd8a0 2024-04-25T12:21:40.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.443+0000 7f8416ffd640 1 --2- 172.21.15.86:0/802848544 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f84040683b0 0x7f840406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:40.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.443+0000 7f8416ffd640 1 -- 172.21.15.86:0/802848544 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f841c086100 con 0x7f84200cd8a0 2024-04-25T12:21:40.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.443+0000 7f8425c3b640 1 --2- 172.21.15.86:0/802848544 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f84040683b0 0x7f840406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:40.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.443+0000 7f8425c3b640 1 --2- 172.21.15.86:0/802848544 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f84040683b0 0x7f840406a870 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f84100b2000 tx=0x7f84100aa070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:40.452 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.447+0000 7f8416ffd640 1 -- 172.21.15.86:0/802848544 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f841c0562f0 con 0x7f84200cd8a0 2024-04-25T12:21:40.609 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.603+0000 7f84286a0640 1 -- 172.21.15.86:0/802848544 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f84201431b0 con 0x7f84200cd8a0 2024-04-25T12:21:40.609 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.603+0000 7f8416ffd640 1 -- 172.21.15.86:0/802848544 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7f841c055bf0 con 0x7f84200cd8a0 2024-04-25T12:21:40.609 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 64 2024-04-25T12:21:40.612 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.607+0000 7f84286a0640 1 -- 172.21.15.86:0/802848544 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f84040683b0 msgr2=0x7f840406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:40.612 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.607+0000 7f84286a0640 1 --2- 172.21.15.86:0/802848544 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f84040683b0 0x7f840406a870 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f84100b2000 tx=0x7f84100aa070 comp rx=0 tx=0).stop 2024-04-25T12:21:40.612 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.607+0000 7f84286a0640 1 -- 172.21.15.86:0/802848544 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84200cd8a0 msgr2=0x7f842013ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:40.612 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.607+0000 7f84286a0640 1 --2- 172.21.15.86:0/802848544 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84200cd8a0 0x7f842013ef60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f841c00c460 tx=0x7f841c00c920 comp rx=0 tx=0).stop 2024-04-25T12:21:40.612 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.607+0000 7f84286a0640 1 -- 172.21.15.86:0/802848544 shutdown_connections 2024-04-25T12:21:40.612 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.607+0000 7f84286a0640 1 --2- 172.21.15.86:0/802848544 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8420143f20 0x7f842013bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:40.612 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.607+0000 7f84286a0640 1 --2- 172.21.15.86:0/802848544 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f84200cdc80 0x7f842013d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:40.612 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.607+0000 7f84286a0640 1 --2- 172.21.15.86:0/802848544 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f84040683b0 0x7f840406a870 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:40.612 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.607+0000 7f84286a0640 1 --2- 172.21.15.86:0/802848544 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84200cd8a0 0x7f842013ef60 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:40.612 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.607+0000 7f84286a0640 1 -- 172.21.15.86:0/802848544 >> 172.21.15.86:0/802848544 conn(0x7f842006fca0 msgr2=0x7f8420142340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:40.612 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.607+0000 7f84286a0640 1 -- 172.21.15.86:0/802848544 shutdown_connections 2024-04-25T12:21:40.612 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.607+0000 7f84286a0640 1 -- 172.21.15.86:0/802848544 wait complete. 2024-04-25T12:21:40.626 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T12:21:40.739 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.735+0000 7f8fede9d640 1 Processor -- start 2024-04-25T12:21:40.739 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.735+0000 7f8fede9d640 1 -- start start 2024-04-25T12:21:40.741 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.735+0000 7f8fede9d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8fe806e0c0 0x7f8fe8152e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:40.741 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.735+0000 7f8fede9d640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8fe80676a0 0x7f8fe8153390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:40.741 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.735+0000 7f8fede9d640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fe80ca950 con 0x7f8fe806dce0 2024-04-25T12:21:40.741 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.735+0000 7f8fede9d640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f8fe8158fc0 con 0x7f8fe80676a0 2024-04-25T12:21:40.741 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.735+0000 7f8fede9d640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f8fe806e950 con 0x7f8fe806e0c0 2024-04-25T12:21:40.741 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.735+0000 7f8fe7fff640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8fe80676a0 0x7f8fe8153390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:40.741 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.735+0000 7f8fe7fff640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8fe80676a0 0x7f8fe8153390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:45936/0 (socket says 172.21.15.86:45936) 2024-04-25T12:21:40.741 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.735+0000 7f8fe7fff640 1 -- 172.21.15.86:0/1057532000 learned_addr learned my addr 172.21.15.86:0/1057532000 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:40.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.735+0000 7f8fe6ffd640 1 --2- 172.21.15.86:0/1057532000 >> v2:172.21.15.134:3300/0 conn(0x7f8fe806e0c0 0x7f8fe8152e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:40.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.735+0000 7f8fe7fff640 1 -- 172.21.15.86:0/1057532000 >> v2:172.21.15.134:3300/0 conn(0x7f8fe806e0c0 msgr2=0x7f8fe8152e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:40.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.735+0000 7f8fe7fff640 1 --2- 172.21.15.86:0/1057532000 >> v2:172.21.15.134:3300/0 conn(0x7f8fe806e0c0 0x7f8fe8152e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:40.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.735+0000 7f8fe7fff640 1 -- 172.21.15.86:0/1057532000 >> v1:172.21.15.134:6789/0 conn(0x7f8fe806dce0 legacy=0x7f8fe815a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:40.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.735+0000 7f8fe7fff640 1 -- 172.21.15.86:0/1057532000 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fe8159280 con 0x7f8fe80676a0 2024-04-25T12:21:40.743 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.739+0000 7f8fe7fff640 1 --2- 172.21.15.86:0/1057532000 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8fe80676a0 0x7f8fe8153390 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8069000 tx=0x7f8fe001c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=840afd97caf6b7d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:40.743 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.739+0000 7f8fe67fc640 1 -- 172.21.15.86:0/1057532000 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe00a5840 con 0x7f8fe80676a0 2024-04-25T12:21:40.743 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.739+0000 7f8fe67fc640 1 -- 172.21.15.86:0/1057532000 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fe00a59e0 con 0x7f8fe80676a0 2024-04-25T12:21:40.743 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.739+0000 7f8fe67fc640 1 -- 172.21.15.86:0/1057532000 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe00a5db0 con 0x7f8fe80676a0 2024-04-25T12:21:40.744 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.739+0000 7f8fede9d640 1 -- 172.21.15.86:0/1057532000 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8fe80676a0 msgr2=0x7f8fe8153390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:40.744 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.739+0000 7f8fede9d640 1 --2- 172.21.15.86:0/1057532000 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8fe80676a0 0x7f8fe8153390 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8069000 tx=0x7f8fe001c980 comp rx=0 tx=0).stop 2024-04-25T12:21:40.744 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.739+0000 7f8fede9d640 1 -- 172.21.15.86:0/1057532000 shutdown_connections 2024-04-25T12:21:40.744 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.739+0000 7f8fede9d640 1 --2- 172.21.15.86:0/1057532000 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8fe80676a0 0x7f8fe8153390 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:40.744 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.739+0000 7f8fede9d640 1 --2- 172.21.15.86:0/1057532000 >> v2:172.21.15.134:3300/0 conn(0x7f8fe806e0c0 0x7f8fe8152e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:40.745 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.739+0000 7f8fede9d640 1 -- 172.21.15.86:0/1057532000 >> 172.21.15.86:0/1057532000 conn(0x7f8fe80c9a70 msgr2=0x7f8fe80c9e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:40.745 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.739+0000 7f8fede9d640 1 -- 172.21.15.86:0/1057532000 shutdown_connections 2024-04-25T12:21:40.745 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.739+0000 7f8fede9d640 1 -- 172.21.15.86:0/1057532000 wait complete. 2024-04-25T12:21:40.747 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.739+0000 7f8fede9d640 1 Processor -- start 2024-04-25T12:21:40.747 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.739+0000 7f8fede9d640 1 -- start start 2024-04-25T12:21:40.747 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.739+0000 7f8fede9d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8fe80676a0 0x7f8fe814b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:40.747 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.739+0000 7f8fede9d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8fe806dce0 0x7f8fe814be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:40.748 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.739+0000 7f8fede9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8fe806e0c0 0x7f8fe80c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:40.748 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.739+0000 7f8fede9d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f8fe806e5a0 con 0x7f8fe80676a0 2024-04-25T12:21:40.748 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.739+0000 7f8fede9d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8fe8067bb0 con 0x7f8fe806e0c0 2024-04-25T12:21:40.748 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.739+0000 7f8fede9d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f8fe8147ba0 con 0x7f8fe806dce0 2024-04-25T12:21:40.748 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.739+0000 7f8fe77fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8fe80676a0 0x7f8fe814b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:40.748 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.739+0000 7f8fe77fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8fe80676a0 0x7f8fe814b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:45952/0 (socket says 172.21.15.86:45952) 2024-04-25T12:21:40.748 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.739+0000 7f8fe77fe640 1 -- 172.21.15.86:0/172544382 learned_addr learned my addr 172.21.15.86:0/172544382 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:40.748 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.739+0000 7f8fe6ffd640 1 --2- 172.21.15.86:0/172544382 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8fe806dce0 0x7f8fe814be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:40.748 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.739+0000 7f8fe7fff640 1 --2- 172.21.15.86:0/172544382 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8fe806e0c0 0x7f8fe80c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:40.748 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.739+0000 7f8fe77fe640 1 -- 172.21.15.86:0/172544382 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8fe806dce0 msgr2=0x7f8fe814be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:40.748 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.739+0000 7f8fe77fe640 1 --2- 172.21.15.86:0/172544382 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8fe806dce0 0x7f8fe814be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:40.748 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.739+0000 7f8fe77fe640 1 -- 172.21.15.86:0/172544382 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8fe806e0c0 msgr2=0x7f8fe80c7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:40.749 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.739+0000 7f8fe77fe640 1 --2- 172.21.15.86:0/172544382 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8fe806e0c0 0x7f8fe80c7e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:40.749 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.739+0000 7f8fe77fe640 1 -- 172.21.15.86:0/172544382 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fe80c7660 con 0x7f8fe80676a0 2024-04-25T12:21:40.749 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.739+0000 7f8fe6ffd640 1 --2- 172.21.15.86:0/172544382 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8fe806dce0 0x7f8fe814be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:21:40.749 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.739+0000 7f8fe77fe640 1 --2- 172.21.15.86:0/172544382 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8fe80676a0 0x7f8fe814b8f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8fd800b410 tx=0x7f8fd800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:40.749 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.739+0000 7f8fcffff640 1 -- 172.21.15.86:0/172544382 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd8015030 con 0x7f8fe80676a0 2024-04-25T12:21:40.749 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.743+0000 7f8fcffff640 1 -- 172.21.15.86:0/172544382 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fd8004020 con 0x7f8fe80676a0 2024-04-25T12:21:40.749 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.743+0000 7f8fede9d640 1 -- 172.21.15.86:0/172544382 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fe8151110 con 0x7f8fe80676a0 2024-04-25T12:21:40.749 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.743+0000 7f8fcffff640 1 -- 172.21.15.86:0/172544382 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd8004450 con 0x7f8fe80676a0 2024-04-25T12:21:40.749 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.743+0000 7f8fede9d640 1 -- 172.21.15.86:0/172544382 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fe813f340 con 0x7f8fe80676a0 2024-04-25T12:21:40.749 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.743+0000 7f8fede9d640 1 -- 172.21.15.86:0/172544382 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fe8075df0 con 0x7f8fe80676a0 2024-04-25T12:21:40.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.743+0000 7f8fcffff640 1 -- 172.21.15.86:0/172544382 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8fd8018070 con 0x7f8fe80676a0 2024-04-25T12:21:40.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.743+0000 7f8fcffff640 1 --2- 172.21.15.86:0/172544382 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f8fd4068380 0x7f8fd406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:40.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.743+0000 7f8fcffff640 1 -- 172.21.15.86:0/172544382 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f8fd8086800 con 0x7f8fe80676a0 2024-04-25T12:21:40.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.743+0000 7f8fe6ffd640 1 --2- 172.21.15.86:0/172544382 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f8fd4068380 0x7f8fd406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:40.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.743+0000 7f8fe6ffd640 1 --2- 172.21.15.86:0/172544382 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f8fd4068380 0x7f8fd406a840 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc006fd0 tx=0x7f8fdc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:40.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.747+0000 7f8fcffff640 1 -- 172.21.15.86:0/172544382 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8fd8056b10 con 0x7f8fe80676a0 2024-04-25T12:21:40.900 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.895+0000 7f8fede9d640 1 -- 172.21.15.86:0/172544382 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f8fe8072fe0 con 0x7f8fe80676a0 2024-04-25T12:21:40.901 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.895+0000 7f8fcffff640 1 -- 172.21.15.86:0/172544382 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) ==== 103+0+11 (secure 0 0 0) 0x7f8fd8056410 con 0x7f8fe80676a0 2024-04-25T12:21:40.902 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 32 2024-04-25T12:21:40.903 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.899+0000 7f8fede9d640 1 -- 172.21.15.86:0/172544382 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f8fd4068380 msgr2=0x7f8fd406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:40.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.899+0000 7f8fede9d640 1 --2- 172.21.15.86:0/172544382 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f8fd4068380 0x7f8fd406a840 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc006fd0 tx=0x7f8fdc008040 comp rx=0 tx=0).stop 2024-04-25T12:21:40.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.899+0000 7f8fede9d640 1 -- 172.21.15.86:0/172544382 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8fe80676a0 msgr2=0x7f8fe814b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:40.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.899+0000 7f8fede9d640 1 --2- 172.21.15.86:0/172544382 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8fe80676a0 0x7f8fe814b8f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8fd800b410 tx=0x7f8fd800b8d0 comp rx=0 tx=0).stop 2024-04-25T12:21:40.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.899+0000 7f8fede9d640 1 -- 172.21.15.86:0/172544382 shutdown_connections 2024-04-25T12:21:40.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.899+0000 7f8fede9d640 1 --2- 172.21.15.86:0/172544382 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8fe806e0c0 0x7f8fe80c7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:40.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.899+0000 7f8fede9d640 1 --2- 172.21.15.86:0/172544382 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8fe806dce0 0x7f8fe814be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:40.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.899+0000 7f8fede9d640 1 --2- 172.21.15.86:0/172544382 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f8fd4068380 0x7f8fd406a840 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:40.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.899+0000 7f8fede9d640 1 --2- 172.21.15.86:0/172544382 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8fe80676a0 0x7f8fe814b8f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:40.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.899+0000 7f8fede9d640 1 -- 172.21.15.86:0/172544382 >> 172.21.15.86:0/172544382 conn(0x7f8fe80c9a70 msgr2=0x7f8fe8152c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:40.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.899+0000 7f8fede9d640 1 -- 172.21.15.86:0/172544382 shutdown_connections 2024-04-25T12:21:40.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:40.899+0000 7f8fede9d640 1 -- 172.21.15.86:0/172544382 wait complete. 2024-04-25T12:21:40.919 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T12:21:41.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.035+0000 7f14d0361640 1 Processor -- start 2024-04-25T12:21:41.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.035+0000 7f14d0361640 1 -- start start 2024-04-25T12:21:41.041 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.035+0000 7f14d0361640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f14c80cda50 0x7f14c80c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:41.041 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.035+0000 7f14d0361640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f14c815b0b0 0x7f14c815b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:41.041 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.035+0000 7f14d0361640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14c815beb0 con 0x7f14c8155350 2024-04-25T12:21:41.041 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.035+0000 7f14d0361640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f14c80cca40 con 0x7f14c80cda50 2024-04-25T12:21:41.042 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.035+0000 7f14d0361640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f14c80ccc90 con 0x7f14c815b0b0 2024-04-25T12:21:41.042 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.035+0000 7f14cd8fc640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f14c80cda50 0x7f14c80c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:41.042 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.035+0000 7f14cd8fc640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f14c80cda50 0x7f14c80c59c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:45958/0 (socket says 172.21.15.86:45958) 2024-04-25T12:21:41.042 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.035+0000 7f14ce0fd640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f14c8155350 0x7f14c80cb7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:53098/0 (socket says 172.21.15.86:53098) 2024-04-25T12:21:41.042 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.035+0000 7f14cd8fc640 1 -- 172.21.15.86:0/835535173 learned_addr learned my addr 172.21.15.86:0/835535173 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:41.042 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.035+0000 7f14ce8fe640 1 --2- 172.21.15.86:0/835535173 >> v2:172.21.15.134:3300/0 conn(0x7f14c815b0b0 0x7f14c815b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:41.042 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.035+0000 7f14cd8fc640 1 -- 172.21.15.86:0/835535173 >> v2:172.21.15.134:3300/0 conn(0x7f14c815b0b0 msgr2=0x7f14c815b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:41.042 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.035+0000 7f14cd8fc640 1 --2- 172.21.15.86:0/835535173 >> v2:172.21.15.134:3300/0 conn(0x7f14c815b0b0 0x7f14c815b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:41.042 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.035+0000 7f14cd8fc640 1 -- 172.21.15.86:0/835535173 >> v1:172.21.15.86:6789/0 conn(0x7f14c8155350 legacy=0x7f14c80cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:41.042 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.035+0000 7f14cd8fc640 1 -- 172.21.15.86:0/835535173 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14c80ccf70 con 0x7f14c80cda50 2024-04-25T12:21:41.042 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.035+0000 7f14ce8fe640 1 --2- 172.21.15.86:0/835535173 >> v2:172.21.15.134:3300/0 conn(0x7f14c815b0b0 0x7f14c815b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:21:41.043 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.039+0000 7f14cd8fc640 1 --2- 172.21.15.86:0/835535173 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14c80cda50 0x7f14c80c59c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f14c80b44e0 tx=0x7f14b801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28e1a5c4490de3e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:41.044 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.039+0000 7f14cd0fb640 1 -- 172.21.15.86:0/835535173 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b80b5070 con 0x7f14c80cda50 2024-04-25T12:21:41.044 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.039+0000 7f14cd0fb640 1 -- 172.21.15.86:0/835535173 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14b80a8a10 con 0x7f14c80cda50 2024-04-25T12:21:41.044 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.039+0000 7f14cd0fb640 1 -- 172.21.15.86:0/835535173 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b80a8de0 con 0x7f14c80cda50 2024-04-25T12:21:41.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.039+0000 7f14d0361640 1 -- 172.21.15.86:0/835535173 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14c80cda50 msgr2=0x7f14c80c59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:41.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.039+0000 7f14d0361640 1 --2- 172.21.15.86:0/835535173 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14c80cda50 0x7f14c80c59c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f14c80b44e0 tx=0x7f14b801ed10 comp rx=0 tx=0).stop 2024-04-25T12:21:41.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.039+0000 7f14d0361640 1 -- 172.21.15.86:0/835535173 shutdown_connections 2024-04-25T12:21:41.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.039+0000 7f14d0361640 1 --2- 172.21.15.86:0/835535173 >> v2:172.21.15.134:3300/0 conn(0x7f14c815b0b0 0x7f14c815b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:41.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.039+0000 7f14d0361640 1 --2- 172.21.15.86:0/835535173 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14c80cda50 0x7f14c80c59c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:41.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.039+0000 7f14d0361640 1 -- 172.21.15.86:0/835535173 >> 172.21.15.86:0/835535173 conn(0x7f14c806cc30 msgr2=0x7f14c806d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:41.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.039+0000 7f14d0361640 1 -- 172.21.15.86:0/835535173 shutdown_connections 2024-04-25T12:21:41.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.039+0000 7f14d0361640 1 -- 172.21.15.86:0/835535173 wait complete. 2024-04-25T12:21:41.048 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.039+0000 7f14d0361640 1 Processor -- start 2024-04-25T12:21:41.048 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.039+0000 7f14d0361640 1 -- start start 2024-04-25T12:21:41.048 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.039+0000 7f14d0361640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f14c80cda50 0x7f14c814b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:41.048 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.039+0000 7f14d0361640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14c8155350 0x7f14c81e5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:41.048 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.039+0000 7f14d0361640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14c815b0b0 0x7f14c814a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:41.048 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.039+0000 7f14d0361640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f14c8155730 con 0x7f14c8155350 2024-04-25T12:21:41.049 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.039+0000 7f14d0361640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f14c80cd530 con 0x7f14c815b0b0 2024-04-25T12:21:41.049 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.039+0000 7f14d0361640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f14c815e860 con 0x7f14c80cda50 2024-04-25T12:21:41.049 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.039+0000 7f14cd8fc640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14c8155350 0x7f14c81e5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:41.049 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.039+0000 7f14cd8fc640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14c8155350 0x7f14c81e5a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:45970/0 (socket says 172.21.15.86:45970) 2024-04-25T12:21:41.049 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.039+0000 7f14cd8fc640 1 -- 172.21.15.86:0/2289895959 learned_addr learned my addr 172.21.15.86:0/2289895959 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:41.049 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.039+0000 7f14cd8fc640 1 -- 172.21.15.86:0/2289895959 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f14c80cda50 msgr2=0x7f14c814b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:41.049 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.039+0000 7f14ce0fd640 1 --2- 172.21.15.86:0/2289895959 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f14c80cda50 0x7f14c814b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:41.049 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.043+0000 7f14cd8fc640 1 --2- 172.21.15.86:0/2289895959 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f14c80cda50 0x7f14c814b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:41.049 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.043+0000 7f14ce8fe640 1 --2- 172.21.15.86:0/2289895959 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14c815b0b0 0x7f14c814a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:41.049 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.043+0000 7f14cd8fc640 1 -- 172.21.15.86:0/2289895959 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14c815b0b0 msgr2=0x7f14c814a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:41.049 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.043+0000 7f14cd8fc640 1 --2- 172.21.15.86:0/2289895959 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14c815b0b0 0x7f14c814a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:41.050 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.043+0000 7f14cd8fc640 1 -- 172.21.15.86:0/2289895959 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14c815e5b0 con 0x7f14c8155350 2024-04-25T12:21:41.050 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.043+0000 7f14ce0fd640 1 --2- 172.21.15.86:0/2289895959 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f14c80cda50 0x7f14c814b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:21:41.050 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.043+0000 7f14cd8fc640 1 --2- 172.21.15.86:0/2289895959 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14c8155350 0x7f14c81e5a80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f14b801b920 tx=0x7f14b801bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:41.050 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.043+0000 7f14beffd640 1 -- 172.21.15.86:0/2289895959 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b80b5070 con 0x7f14c8155350 2024-04-25T12:21:41.050 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.043+0000 7f14beffd640 1 -- 172.21.15.86:0/2289895959 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14b80b0c50 con 0x7f14c8155350 2024-04-25T12:21:41.050 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.043+0000 7f14d0361640 1 -- 172.21.15.86:0/2289895959 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14c815a490 con 0x7f14c8155350 2024-04-25T12:21:41.050 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.043+0000 7f14beffd640 1 -- 172.21.15.86:0/2289895959 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b80bb410 con 0x7f14c8155350 2024-04-25T12:21:41.050 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.043+0000 7f14d0361640 1 -- 172.21.15.86:0/2289895959 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14c81e4a30 con 0x7f14c8155350 2024-04-25T12:21:41.050 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.043+0000 7f14d0361640 1 -- 172.21.15.86:0/2289895959 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14c8075df0 con 0x7f14c8155350 2024-04-25T12:21:41.050 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.043+0000 7f14beffd640 1 -- 172.21.15.86:0/2289895959 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f14b80c2060 con 0x7f14c8155350 2024-04-25T12:21:41.051 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.043+0000 7f14beffd640 1 --2- 172.21.15.86:0/2289895959 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f14ac068380 0x7f14ac06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:41.051 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.043+0000 7f14beffd640 1 -- 172.21.15.86:0/2289895959 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f14b8123ee0 con 0x7f14c8155350 2024-04-25T12:21:41.051 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.043+0000 7f14ce0fd640 1 --2- 172.21.15.86:0/2289895959 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f14ac068380 0x7f14ac06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:41.051 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.043+0000 7f14ce0fd640 1 --2- 172.21.15.86:0/2289895959 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f14ac068380 0x7f14ac06a840 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f14c4007fd0 tx=0x7f14c4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:41.053 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.047+0000 7f14beffd640 1 -- 172.21.15.86:0/2289895959 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f14b8018870 con 0x7f14c8155350 2024-04-25T12:21:41.225 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.219+0000 7f14d0361640 1 -- 172.21.15.86:0/2289895959 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f14c80cad80 con 0x7f14c8155350 2024-04-25T12:21:41.226 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.219+0000 7f14beffd640 1 -- 172.21.15.86:0/2289895959 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f14b80f41f0 con 0x7f14c8155350 2024-04-25T12:21:41.226 INFO:teuthology.orchestra.run.smithi086.stderr:listed 0 entries 2024-04-25T12:21:41.228 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.223+0000 7f14d0361640 1 -- 172.21.15.86:0/2289895959 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f14ac068380 msgr2=0x7f14ac06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:41.228 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.223+0000 7f14d0361640 1 --2- 172.21.15.86:0/2289895959 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f14ac068380 0x7f14ac06a840 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f14c4007fd0 tx=0x7f14c4009040 comp rx=0 tx=0).stop 2024-04-25T12:21:41.228 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.223+0000 7f14d0361640 1 -- 172.21.15.86:0/2289895959 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14c8155350 msgr2=0x7f14c81e5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:41.228 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.223+0000 7f14d0361640 1 --2- 172.21.15.86:0/2289895959 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14c8155350 0x7f14c81e5a80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f14b801b920 tx=0x7f14b801bab0 comp rx=0 tx=0).stop 2024-04-25T12:21:41.228 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.223+0000 7f14d0361640 1 -- 172.21.15.86:0/2289895959 shutdown_connections 2024-04-25T12:21:41.229 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.223+0000 7f14d0361640 1 --2- 172.21.15.86:0/2289895959 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14c815b0b0 0x7f14c814a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:41.229 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.223+0000 7f14d0361640 1 --2- 172.21.15.86:0/2289895959 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f14ac068380 0x7f14ac06a840 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:41.229 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.223+0000 7f14d0361640 1 --2- 172.21.15.86:0/2289895959 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14c8155350 0x7f14c81e5a80 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:41.229 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.223+0000 7f14d0361640 1 --2- 172.21.15.86:0/2289895959 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f14c80cda50 0x7f14c814b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:41.229 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.223+0000 7f14d0361640 1 -- 172.21.15.86:0/2289895959 >> 172.21.15.86:0/2289895959 conn(0x7f14c806cc30 msgr2=0x7f14c81e6890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:41.229 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.223+0000 7f14d0361640 1 -- 172.21.15.86:0/2289895959 shutdown_connections 2024-04-25T12:21:41.229 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.223+0000 7f14d0361640 1 -- 172.21.15.86:0/2289895959 wait complete. 2024-04-25T12:21:41.244 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-04-25T12:21:41.244 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T12:21:41.250 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T12:21:41.418 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.411+0000 7f82b077b640 1 Processor -- start 2024-04-25T12:21:41.418 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.411+0000 7f82b077b640 1 -- start start 2024-04-25T12:21:41.420 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.415+0000 7f82b077b640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f82a80c8630 0x7f82a8151b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:41.421 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.415+0000 7f82b077b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f82a80c8a70 0x7f82a8152080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:41.421 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.415+0000 7f82b077b640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82a815b740 con 0x7f82a80c8250 2024-04-25T12:21:41.421 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.415+0000 7f82b077b640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f82a80c6490 con 0x7f82a80c8a70 2024-04-25T12:21:41.421 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.415+0000 7f82b077b640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f82a81525c0 con 0x7f82a80c8630 2024-04-25T12:21:41.421 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.415+0000 7f82ae517640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f82a80c8250 0x7f82a80c39e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:53100/0 (socket says 172.21.15.86:53100) 2024-04-25T12:21:41.421 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.415+0000 7f82ae517640 1 -- 172.21.15.86:0/3405119807 learned_addr learned my addr 172.21.15.86:0/3405119807 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-04-25T12:21:41.421 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.415+0000 7f82ad515640 1 -- 172.21.15.86:0/3405119807 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 605234554 0 0) 0x7f82a815b740 con 0x7f82a80c8250 2024-04-25T12:21:41.421 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.415+0000 7f82add16640 1 --2- 172.21.15.86:0/3405119807 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f82a80c8630 0x7f82a8151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:41.421 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.415+0000 7f82ad515640 1 -- 172.21.15.86:0/3405119807 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8290005740 con 0x7f82a80c8250 2024-04-25T12:21:41.421 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.415+0000 7f82aed18640 1 --2- 172.21.15.86:0/3405119807 >> v2:172.21.15.134:3300/0 conn(0x7f82a80c8a70 0x7f82a8152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:41.421 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.415+0000 7f82ad515640 1 -- 172.21.15.86:0/3405119807 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2082858832 0 0) 0x7f8290005740 con 0x7f82a80c8250 2024-04-25T12:21:41.421 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.415+0000 7f82ad515640 1 -- 172.21.15.86:0/3405119807 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f82a80c8630 msgr2=0x7f82a8151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:41.421 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.415+0000 7f82ad515640 1 --2- 172.21.15.86:0/3405119807 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f82a80c8630 0x7f82a8151b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:41.422 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.415+0000 7f82ad515640 1 -- 172.21.15.86:0/3405119807 >> v2:172.21.15.134:3300/0 conn(0x7f82a80c8a70 msgr2=0x7f82a8152080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:41.422 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.415+0000 7f82ad515640 1 --2- 172.21.15.86:0/3405119807 >> v2:172.21.15.134:3300/0 conn(0x7f82a80c8a70 0x7f82a8152080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:41.422 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.415+0000 7f82ad515640 1 -- 172.21.15.86:0/3405119807 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82a80c40f0 con 0x7f82a80c8250 2024-04-25T12:21:41.422 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.415+0000 7f82ad515640 1 -- 172.21.15.86:0/3405119807 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1387950573 0 0) 0x7f82a0001680 con 0x7f82a80c8250 2024-04-25T12:21:41.422 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.415+0000 7f82ad515640 1 -- 172.21.15.86:0/3405119807 >> v1:172.21.15.86:6789/0 conn(0x7f82a80c8250 legacy=0x7f82a80c39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:41.422 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.415+0000 7f82ad515640 1 --2- 172.21.15.86:0/3405119807 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8290005bd0 0x7f8290005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:41.422 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.415+0000 7f82ad515640 1 --2- 172.21.15.86:0/3405119807 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f82a80c8630 0x7f8290006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:41.422 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.415+0000 7f82ad515640 1 --2- 172.21.15.86:0/3405119807 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8290006f60 0x7f82900073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:41.422 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.415+0000 7f82ad515640 1 -- 172.21.15.86:0/3405119807 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f82a80c6490 con 0x7f8290005bd0 2024-04-25T12:21:41.422 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.415+0000 7f82ad515640 1 -- 172.21.15.86:0/3405119807 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f82a81525c0 con 0x7f8290006f60 2024-04-25T12:21:41.423 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.415+0000 7f82ad515640 1 -- 172.21.15.86:0/3405119807 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f829000dc90 con 0x7f82a80c8630 2024-04-25T12:21:41.423 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.415+0000 7f82aed18640 1 --2- 172.21.15.86:0/3405119807 >> v2:172.21.15.134:3300/0 conn(0x7f82a80c8a70 0x7f82a8152080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:21:41.423 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.415+0000 7f82ae517640 1 --2- 172.21.15.86:0/3405119807 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8290005bd0 0x7f8290005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:41.423 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.415+0000 7f82add16640 1 --2- 172.21.15.86:0/3405119807 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f82a80c8630 0x7f8290006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:41.423 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.415+0000 7f82ae517640 1 -- 172.21.15.86:0/3405119807 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f82a80c8630 msgr2=0x7f8290006a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:41.423 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.415+0000 7f82ae517640 1 --2- 172.21.15.86:0/3405119807 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f82a80c8630 0x7f8290006a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:41.423 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.415+0000 7f82ae517640 1 -- 172.21.15.86:0/3405119807 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8290006f60 msgr2=0x7f82900073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:41.423 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.415+0000 7f82ae517640 1 --2- 172.21.15.86:0/3405119807 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8290006f60 0x7f82900073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:41.423 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.415+0000 7f82ae517640 1 -- 172.21.15.86:0/3405119807 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8290005740 con 0x7f8290005bd0 2024-04-25T12:21:41.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.415+0000 7f82ae517640 1 --2- 172.21.15.86:0/3405119807 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8290005bd0 0x7f8290005ff0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f82a000c240 tx=0x7f82a001cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8e4ab6175cf3987 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:41.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.415+0000 7f82ad515640 1 -- 172.21.15.86:0/3405119807 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82a0007d20 con 0x7f8290005bd0 2024-04-25T12:21:41.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.415+0000 7f82ad515640 1 -- 172.21.15.86:0/3405119807 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82a00a9070 con 0x7f8290005bd0 2024-04-25T12:21:41.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.415+0000 7f82ad515640 1 -- 172.21.15.86:0/3405119807 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82a0005d60 con 0x7f8290005bd0 2024-04-25T12:21:41.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.419+0000 7f82b077b640 1 -- 172.21.15.86:0/3405119807 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8290005bd0 msgr2=0x7f8290005ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:41.427 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.419+0000 7f82b077b640 1 --2- 172.21.15.86:0/3405119807 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8290005bd0 0x7f8290005ff0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f82a000c240 tx=0x7f82a001cc80 comp rx=0 tx=0).stop 2024-04-25T12:21:41.427 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.419+0000 7f82aed18640 1 -- 172.21.15.86:0/3405119807 reap_dead start 2024-04-25T12:21:41.427 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.419+0000 7f82b077b640 1 -- 172.21.15.86:0/3405119807 shutdown_connections 2024-04-25T12:21:41.427 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.419+0000 7f82b077b640 1 -- 172.21.15.86:0/3405119807 >> 172.21.15.86:0/3405119807 conn(0x7f82a806b9d0 msgr2=0x7f82a806bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:41.427 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.419+0000 7f82b077b640 1 -- 172.21.15.86:0/3405119807 shutdown_connections 2024-04-25T12:21:41.427 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.419+0000 7f82b077b640 1 -- 172.21.15.86:0/3405119807 wait complete. 2024-04-25T12:21:41.427 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.419+0000 7f82b077b640 1 Processor -- start 2024-04-25T12:21:41.427 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.419+0000 7f82b077b640 1 -- start start 2024-04-25T12:21:41.427 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.419+0000 7f82b077b640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8290005bd0 0x7f82a80cb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:41.427 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.419+0000 7f82b077b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82a81554e0 0x7f82a8147ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:41.427 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.419+0000 7f82b077b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82a815c6e0 0x7f82a8148430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:41.427 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.419+0000 7f82b077b640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f82a80721a0 con 0x7f82a815c6e0 2024-04-25T12:21:41.427 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.419+0000 7f82b077b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f82a80c58c0 con 0x7f82a81554e0 2024-04-25T12:21:41.427 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.419+0000 7f82b077b640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f82a815b400 con 0x7f8290005bd0 2024-04-25T12:21:41.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.419+0000 7f82aed18640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82a815c6e0 0x7f82a8148430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:41.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.419+0000 7f82aed18640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82a815c6e0 0x7f82a8148430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:45990/0 (socket says 172.21.15.86:45990) 2024-04-25T12:21:41.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.419+0000 7f82aed18640 1 -- 172.21.15.86:0/1795471959 learned_addr learned my addr 172.21.15.86:0/1795471959 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:41.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.419+0000 7f82ae517640 1 --2- 172.21.15.86:0/1795471959 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8290005bd0 0x7f82a80cb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:41.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.419+0000 7f82add16640 1 --2- 172.21.15.86:0/1795471959 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82a81554e0 0x7f82a8147ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:41.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.419+0000 7f82aed18640 1 -- 172.21.15.86:0/1795471959 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8290005bd0 msgr2=0x7f82a80cb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:41.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.419+0000 7f82aed18640 1 --2- 172.21.15.86:0/1795471959 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8290005bd0 0x7f82a80cb6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:41.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.419+0000 7f82aed18640 1 -- 172.21.15.86:0/1795471959 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82a81554e0 msgr2=0x7f82a8147ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:41.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.419+0000 7f82aed18640 1 --2- 172.21.15.86:0/1795471959 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82a81554e0 0x7f82a8147ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:41.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.419+0000 7f82aed18640 1 -- 172.21.15.86:0/1795471959 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82a815dfa0 con 0x7f82a815c6e0 2024-04-25T12:21:41.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.419+0000 7f82aed18640 1 --2- 172.21.15.86:0/1795471959 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82a815c6e0 0x7f82a8148430 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f82a8072550 tx=0x7f829800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:41.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.419+0000 7f82a6ffd640 1 -- 172.21.15.86:0/1795471959 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f829801a070 con 0x7f82a815c6e0 2024-04-25T12:21:41.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.419+0000 7f82a6ffd640 1 -- 172.21.15.86:0/1795471959 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f829800de50 con 0x7f82a815c6e0 2024-04-25T12:21:41.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.419+0000 7f82b077b640 1 -- 172.21.15.86:0/1795471959 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82a815e540 con 0x7f82a815c6e0 2024-04-25T12:21:41.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.419+0000 7f82a6ffd640 1 -- 172.21.15.86:0/1795471959 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8298003be0 con 0x7f82a815c6e0 2024-04-25T12:21:41.429 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.419+0000 7f82b077b640 1 -- 172.21.15.86:0/1795471959 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82a8152840 con 0x7f82a815c6e0 2024-04-25T12:21:41.429 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.419+0000 7f82b077b640 1 -- 172.21.15.86:0/1795471959 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82a8075df0 con 0x7f82a815c6e0 2024-04-25T12:21:41.429 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.423+0000 7f82a6ffd640 1 -- 172.21.15.86:0/1795471959 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f829801d070 con 0x7f82a815c6e0 2024-04-25T12:21:41.429 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.423+0000 7f82a6ffd640 1 --2- 172.21.15.86:0/1795471959 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f8294068380 0x7f829406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:41.430 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.423+0000 7f82a6ffd640 1 -- 172.21.15.86:0/1795471959 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f82980869c0 con 0x7f82a815c6e0 2024-04-25T12:21:41.430 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.423+0000 7f82ae517640 1 --2- 172.21.15.86:0/1795471959 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f8294068380 0x7f829406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:41.430 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.423+0000 7f82ae517640 1 --2- 172.21.15.86:0/1795471959 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f8294068380 0x7f829406a840 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f82a00ab000 tx=0x7f82a00a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:41.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.427+0000 7f82a6ffd640 1 -- 172.21.15.86:0/1795471959 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8298088e20 con 0x7f82a815c6e0 2024-04-25T12:21:41.580 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.575+0000 7f82b077b640 1 -- 172.21.15.86:0/1795471959 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f82a8071e50 con 0x7f82a815c6e0 2024-04-25T12:21:41.582 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.575+0000 7f82a6ffd640 1 -- 172.21.15.86:0/1795471959 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18514 (secure 0 0 0) 0x7f8298010070 con 0x7f82a815c6e0 2024-04-25T12:21:41.582 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:21:41.582 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":24,"fsid":"f2ef5c0c-9576-4650-b4f7-6cb14247f62a","created":"2024-04-25T12:20:59.241733+0000","modified":"2024-04-25T12:21:28.541128+0000","last_up_change":"2024-04-25T12:21:10.939617+0000","last_in_change":"2024-04-25T12:21:01.534145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T12:21:11.839922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T12:21:21.854040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T12:21:22.406060+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T12:21:26.152386+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1f713f00-ef9f-4a6f-a620-38a8a1f8a822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6801","nonce":2812764579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6803","nonce":2812764579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6807","nonce":2812764579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6805","nonce":2812764579}]},"public_addr":"172.21.15.86:6801/2812764579","cluster_addr":"172.21.15.86:6803/2812764579","heartbeat_back_addr":"172.21.15.86:6807/2812764579","heartbeat_front_addr":"172.21.15.86:6805/2812764579","state":["exists","up"]},{"osd":1,"uuid":"baf6606d-a556-4fbe-a930-855e04ff1534","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6809","nonce":467966038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6811","nonce":467966038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6815","nonce":467966038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6813","nonce":467966038}]},"public_addr":"172.21.15.86:6809/467966038","cluster_addr":"172.21.15.86:6811/467966038","heartbeat_back_addr":"172.21.15.86:6815/467966038","heartbeat_front_addr":"172.21.15.86:6813/467966038","state":["exists","up"]},{"osd":2,"uuid":"c983d68e-6d60-434f-aed6-108420c5dd09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6817","nonce":3279762843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6820","nonce":3279762843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6825","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6827","nonce":3279762843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6824","nonce":3279762843}]},"public_addr":"172.21.15.86:6817/3279762843","cluster_addr":"172.21.15.86:6820/3279762843","heartbeat_back_addr":"172.21.15.86:6827/3279762843","heartbeat_front_addr":"172.21.15.86:6824/3279762843","state":["exists","up"]},{"osd":3,"uuid":"e77657bb-45aa-43bf-ab41-c7377eb495ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6821","nonce":2861354413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6826","nonce":2861354413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6831","nonce":2861354413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6829","nonce":2861354413}]},"public_addr":"172.21.15.86:6821/2861354413","cluster_addr":"172.21.15.86:6826/2861354413","heartbeat_back_addr":"172.21.15.86:6831/2861354413","heartbeat_front_addr":"172.21.15.86:6829/2861354413","state":["exists","up"]},{"osd":4,"uuid":"252bd300-d75a-4b00-be4b-27e6b51de4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6802","nonce":1872913602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6805","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6808","nonce":1872913602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6815","nonce":1872913602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6813","nonce":1872913602}]},"public_addr":"172.21.15.134:6802/1872913602","cluster_addr":"172.21.15.134:6808/1872913602","heartbeat_back_addr":"172.21.15.134:6815/1872913602","heartbeat_front_addr":"172.21.15.134:6813/1872913602","state":["exists","up"]},{"osd":5,"uuid":"4135da3f-7427-4409-a48e-78bd8a7b46ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6801","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6803","nonce":2261413981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6806","nonce":2261413981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6812","nonce":2261413981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6809","nonce":2261413981}]},"public_addr":"172.21.15.134:6803/2261413981","cluster_addr":"172.21.15.134:6806/2261413981","heartbeat_back_addr":"172.21.15.134:6812/2261413981","heartbeat_front_addr":"172.21.15.134:6809/2261413981","state":["exists","up"]},{"osd":6,"uuid":"b6e7a5f1-fa7e-497d-abac-a19994d26820","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6825","nonce":2841082767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6827","nonce":2841082767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6831","nonce":2841082767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6829","nonce":2841082767}]},"public_addr":"172.21.15.134:6825/2841082767","cluster_addr":"172.21.15.134:6827/2841082767","heartbeat_back_addr":"172.21.15.134:6831/2841082767","heartbeat_front_addr":"172.21.15.134:6829/2841082767","state":["exists","up"]},{"osd":7,"uuid":"c5597e50-1962-4103-9124-dd7bceb8ac97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6817","nonce":1277404274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6819","nonce":1277404274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6823","nonce":1277404274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6821","nonce":1277404274}]},"public_addr":"172.21.15.134:6817/1277404274","cluster_addr":"172.21.15.134:6819/1277404274","heartbeat_back_addr":"172.21.15.134:6823/1277404274","heartbeat_front_addr":"172.21.15.134:6821/1277404274","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.018125+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.157958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.113619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.136904+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.844514+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.872629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.775339+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.822867+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T12:21:41.584 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.579+0000 7f82b077b640 1 -- 172.21.15.86:0/1795471959 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f8294068380 msgr2=0x7f829406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:41.584 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.579+0000 7f82b077b640 1 --2- 172.21.15.86:0/1795471959 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f8294068380 0x7f829406a840 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f82a00ab000 tx=0x7f82a00a7070 comp rx=0 tx=0).stop 2024-04-25T12:21:41.584 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.579+0000 7f82b077b640 1 -- 172.21.15.86:0/1795471959 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82a815c6e0 msgr2=0x7f82a8148430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:41.584 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.579+0000 7f82b077b640 1 --2- 172.21.15.86:0/1795471959 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82a815c6e0 0x7f82a8148430 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f82a8072550 tx=0x7f829800d4a0 comp rx=0 tx=0).stop 2024-04-25T12:21:41.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.579+0000 7f82b077b640 1 -- 172.21.15.86:0/1795471959 shutdown_connections 2024-04-25T12:21:41.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.579+0000 7f82b077b640 1 --2- 172.21.15.86:0/1795471959 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f8294068380 0x7f829406a840 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:41.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.579+0000 7f82b077b640 1 --2- 172.21.15.86:0/1795471959 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82a815c6e0 0x7f82a8148430 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:41.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.579+0000 7f82b077b640 1 --2- 172.21.15.86:0/1795471959 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82a81554e0 0x7f82a8147ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:41.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.579+0000 7f82b077b640 1 --2- 172.21.15.86:0/1795471959 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8290005bd0 0x7f82a80cb6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:41.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.579+0000 7f82b077b640 1 -- 172.21.15.86:0/1795471959 >> 172.21.15.86:0/1795471959 conn(0x7f82a806b9d0 msgr2=0x7f82a814c050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:41.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.579+0000 7f82b077b640 1 -- 172.21.15.86:0/1795471959 shutdown_connections 2024-04-25T12:21:41.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.579+0000 7f82b077b640 1 -- 172.21.15.86:0/1795471959 wait complete. 2024-04-25T12:21:41.600 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T12:21:11.839922+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T12:21:21.854040+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T12:21:22.406060+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T12:21:26.152386+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T12:21:41.600 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T12:21:41.718 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.711+0000 7f39bbf09640 1 Processor -- start 2024-04-25T12:21:41.718 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.711+0000 7f39bbf09640 1 -- start start 2024-04-25T12:21:41.719 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.715+0000 7f39bbf09640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39b414ffa0 0x7f39b406f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:41.719 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.715+0000 7f39bbf09640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f39b4074100 0x7f39b40c7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:41.719 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.715+0000 7f39bbf09640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39b40c5d70 con 0x7f39b414fbc0 2024-04-25T12:21:41.719 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.715+0000 7f39bbf09640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f39b40c6050 con 0x7f39b4074100 2024-04-25T12:21:41.719 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.715+0000 7f39bbf09640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f39b40c6330 con 0x7f39b414ffa0 2024-04-25T12:21:41.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.715+0000 7f39b94a4640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39b414ffa0 0x7f39b406f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:41.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.715+0000 7f39ba4a6640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f39b4074100 0x7f39b40c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:41.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.715+0000 7f39b94a4640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39b414ffa0 0x7f39b406f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.86:33890/0 (socket says 172.21.15.86:33890) 2024-04-25T12:21:41.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.715+0000 7f39b94a4640 1 -- 172.21.15.86:0/981281685 learned_addr learned my addr 172.21.15.86:0/981281685 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:41.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.715+0000 7f39b94a4640 1 -- 172.21.15.86:0/981281685 >> v2:172.21.15.134:3300/0 conn(0x7f39b4074100 msgr2=0x7f39b40c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:41.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.715+0000 7f39b94a4640 1 --2- 172.21.15.86:0/981281685 >> v2:172.21.15.134:3300/0 conn(0x7f39b4074100 0x7f39b40c7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:41.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.715+0000 7f39b94a4640 1 -- 172.21.15.86:0/981281685 >> v1:172.21.15.134:6789/0 conn(0x7f39b414fbc0 legacy=0x7f39b40c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:41.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.715+0000 7f39b94a4640 1 -- 172.21.15.86:0/981281685 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39b40c6610 con 0x7f39b414ffa0 2024-04-25T12:21:41.722 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.715+0000 7f39b94a4640 1 --2- 172.21.15.86:0/981281685 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39b414ffa0 0x7f39b406f700 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f39a4009870 tx=0x7f39a401c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18ba184ae039c1b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:41.722 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.719+0000 7f39b8ca3640 1 -- 172.21.15.86:0/981281685 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a40a9640 con 0x7f39b414ffa0 2024-04-25T12:21:41.722 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.719+0000 7f39b8ca3640 1 -- 172.21.15.86:0/981281685 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39a40a97e0 con 0x7f39b414ffa0 2024-04-25T12:21:41.722 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.719+0000 7f39b8ca3640 1 -- 172.21.15.86:0/981281685 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a40a9bb0 con 0x7f39b414ffa0 2024-04-25T12:21:41.723 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.719+0000 7f39bbf09640 1 -- 172.21.15.86:0/981281685 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39b414ffa0 msgr2=0x7f39b406f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:41.723 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.719+0000 7f39bbf09640 1 --2- 172.21.15.86:0/981281685 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39b414ffa0 0x7f39b406f700 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f39a4009870 tx=0x7f39a401c560 comp rx=0 tx=0).stop 2024-04-25T12:21:41.723 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.719+0000 7f39bbf09640 1 -- 172.21.15.86:0/981281685 shutdown_connections 2024-04-25T12:21:41.723 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.719+0000 7f39bbf09640 1 --2- 172.21.15.86:0/981281685 >> v2:172.21.15.134:3300/0 conn(0x7f39b4074100 0x7f39b40c7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:41.724 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.719+0000 7f39bbf09640 1 --2- 172.21.15.86:0/981281685 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39b414ffa0 0x7f39b406f700 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:41.724 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.719+0000 7f39bbf09640 1 -- 172.21.15.86:0/981281685 >> 172.21.15.86:0/981281685 conn(0x7f39b406b9d0 msgr2=0x7f39b406bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:41.724 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.719+0000 7f39bbf09640 1 -- 172.21.15.86:0/981281685 shutdown_connections 2024-04-25T12:21:41.724 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.719+0000 7f39bbf09640 1 -- 172.21.15.86:0/981281685 wait complete. 2024-04-25T12:21:41.724 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.719+0000 7f39bbf09640 1 Processor -- start 2024-04-25T12:21:41.724 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.719+0000 7f39bbf09640 1 -- start start 2024-04-25T12:21:41.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.719+0000 7f39bbf09640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39b4074100 0x7f39b414b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:41.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.719+0000 7f39bbf09640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f39b414fbc0 0x7f39b4151290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:41.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.719+0000 7f39bbf09640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39b414ffa0 0x7f39b4141c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:41.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.719+0000 7f39bbf09640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f39b40c8ab0 con 0x7f39b4074100 2024-04-25T12:21:41.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.719+0000 7f39bbf09640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f39b40c8930 con 0x7f39b414fbc0 2024-04-25T12:21:41.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.719+0000 7f39bbf09640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f39b4166090 con 0x7f39b414ffa0 2024-04-25T12:21:41.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.719+0000 7f39b9ca5640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39b4074100 0x7f39b414b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:41.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.719+0000 7f39b9ca5640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39b4074100 0x7f39b414b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:46006/0 (socket says 172.21.15.86:46006) 2024-04-25T12:21:41.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.719+0000 7f39b9ca5640 1 -- 172.21.15.86:0/434772849 learned_addr learned my addr 172.21.15.86:0/434772849 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:41.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.719+0000 7f39ba4a6640 1 --2- 172.21.15.86:0/434772849 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39b414ffa0 0x7f39b4141c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:41.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.719+0000 7f39b94a4640 1 --2- 172.21.15.86:0/434772849 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f39b414fbc0 0x7f39b4151290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:41.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.719+0000 7f39b9ca5640 1 -- 172.21.15.86:0/434772849 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39b414ffa0 msgr2=0x7f39b4141c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:41.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.719+0000 7f39b9ca5640 1 --2- 172.21.15.86:0/434772849 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39b414ffa0 0x7f39b4141c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:41.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.719+0000 7f39b9ca5640 1 -- 172.21.15.86:0/434772849 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f39b414fbc0 msgr2=0x7f39b4151290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:41.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.719+0000 7f39b9ca5640 1 --2- 172.21.15.86:0/434772849 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f39b414fbc0 0x7f39b4151290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:41.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.719+0000 7f39b9ca5640 1 -- 172.21.15.86:0/434772849 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39b415d1a0 con 0x7f39b4074100 2024-04-25T12:21:41.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.719+0000 7f39b9ca5640 1 --2- 172.21.15.86:0/434772849 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39b4074100 0x7f39b414b720 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f39b000c450 tx=0x7f39b000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:41.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.719+0000 7f39aa7fc640 1 -- 172.21.15.86:0/434772849 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b0016020 con 0x7f39b4074100 2024-04-25T12:21:41.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.719+0000 7f39aa7fc640 1 -- 172.21.15.86:0/434772849 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39b00052d0 con 0x7f39b4074100 2024-04-25T12:21:41.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.719+0000 7f39bbf09640 1 -- 172.21.15.86:0/434772849 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39b41f2ef0 con 0x7f39b4074100 2024-04-25T12:21:41.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.719+0000 7f39aa7fc640 1 -- 172.21.15.86:0/434772849 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b0007260 con 0x7f39b4074100 2024-04-25T12:21:41.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.719+0000 7f39bbf09640 1 -- 172.21.15.86:0/434772849 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39b415cec0 con 0x7f39b4074100 2024-04-25T12:21:41.729 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.723+0000 7f39bbf09640 1 -- 172.21.15.86:0/434772849 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39b4075df0 con 0x7f39b4074100 2024-04-25T12:21:41.729 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.723+0000 7f39aa7fc640 1 -- 172.21.15.86:0/434772849 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f39b0007400 con 0x7f39b4074100 2024-04-25T12:21:41.729 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.723+0000 7f39aa7fc640 1 --2- 172.21.15.86:0/434772849 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f3998068380 0x7f399806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:41.729 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.723+0000 7f39aa7fc640 1 -- 172.21.15.86:0/434772849 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f39b0086690 con 0x7f39b4074100 2024-04-25T12:21:41.729 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.723+0000 7f39b94a4640 1 --2- 172.21.15.86:0/434772849 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f3998068380 0x7f399806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:41.729 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.723+0000 7f39b94a4640 1 --2- 172.21.15.86:0/434772849 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f3998068380 0x7f399806a840 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f39a40ae000 tx=0x7f39a4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:41.732 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.727+0000 7f39aa7fc640 1 -- 172.21.15.86:0/434772849 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f39b0020020 con 0x7f39b4074100 2024-04-25T12:21:41.881 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.875+0000 7f39bbf09640 1 -- 172.21.15.86:0/434772849 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f39b40c7df0 con 0x7f39b4074100 2024-04-25T12:21:41.882 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.875+0000 7f39aa7fc640 1 -- 172.21.15.86:0/434772849 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7f39b415d1a0 con 0x7f39b4074100 2024-04-25T12:21:41.882 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 1 2024-04-25T12:21:41.884 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.879+0000 7f39bbf09640 1 -- 172.21.15.86:0/434772849 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f3998068380 msgr2=0x7f399806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:41.885 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.879+0000 7f39bbf09640 1 --2- 172.21.15.86:0/434772849 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f3998068380 0x7f399806a840 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f39a40ae000 tx=0x7f39a4009040 comp rx=0 tx=0).stop 2024-04-25T12:21:41.885 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.879+0000 7f39bbf09640 1 -- 172.21.15.86:0/434772849 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39b4074100 msgr2=0x7f39b414b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:41.885 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.879+0000 7f39bbf09640 1 --2- 172.21.15.86:0/434772849 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39b4074100 0x7f39b414b720 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f39b000c450 tx=0x7f39b000c910 comp rx=0 tx=0).stop 2024-04-25T12:21:41.885 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.879+0000 7f39bbf09640 1 -- 172.21.15.86:0/434772849 shutdown_connections 2024-04-25T12:21:41.885 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.879+0000 7f39bbf09640 1 --2- 172.21.15.86:0/434772849 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39b414ffa0 0x7f39b4141c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:41.885 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.879+0000 7f39bbf09640 1 --2- 172.21.15.86:0/434772849 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f39b414fbc0 0x7f39b4151290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:41.885 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.879+0000 7f39bbf09640 1 --2- 172.21.15.86:0/434772849 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f3998068380 0x7f399806a840 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:41.885 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.879+0000 7f39bbf09640 1 --2- 172.21.15.86:0/434772849 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39b4074100 0x7f39b414b720 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:41.885 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.879+0000 7f39bbf09640 1 -- 172.21.15.86:0/434772849 >> 172.21.15.86:0/434772849 conn(0x7f39b406b9d0 msgr2=0x7f39b414e030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:41.885 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.879+0000 7f39bbf09640 1 -- 172.21.15.86:0/434772849 shutdown_connections 2024-04-25T12:21:41.885 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:41.879+0000 7f39bbf09640 1 -- 172.21.15.86:0/434772849 wait complete. 2024-04-25T12:21:41.899 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T12:21:42.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.003+0000 7f0b9cd23640 1 Processor -- start 2024-04-25T12:21:42.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.003+0000 7f0b9cd23640 1 -- start start 2024-04-25T12:21:42.011 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.007+0000 7f0b9cd23640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0b9814ffa0 0x7f0b9806f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:42.011 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.007+0000 7f0b9cd23640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0b98074100 0x7f0b980c7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:42.011 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.007+0000 7f0b9cd23640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b980c5d70 con 0x7f0b9814fbc0 2024-04-25T12:21:42.011 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.007+0000 7f0b9cd23640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f0b980c6050 con 0x7f0b98074100 2024-04-25T12:21:42.012 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.007+0000 7f0b9cd23640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f0b980c6330 con 0x7f0b9814ffa0 2024-04-25T12:21:42.012 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.007+0000 7f0b96d9d640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0b98074100 0x7f0b980c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:42.012 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.007+0000 7f0b96d9d640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0b98074100 0x7f0b980c7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:46022/0 (socket says 172.21.15.86:46022) 2024-04-25T12:21:42.012 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.007+0000 7f0b96d9d640 1 -- 172.21.15.86:0/2500558262 learned_addr learned my addr 172.21.15.86:0/2500558262 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:42.012 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.007+0000 7f0b95d9b640 1 --2- 172.21.15.86:0/2500558262 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0b9814ffa0 0x7f0b9806f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:42.012 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.007+0000 7f0b96d9d640 1 -- 172.21.15.86:0/2500558262 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0b9814ffa0 msgr2=0x7f0b9806f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:42.012 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.007+0000 7f0b96d9d640 1 --2- 172.21.15.86:0/2500558262 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0b9814ffa0 0x7f0b9806f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:42.012 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.007+0000 7f0b96d9d640 1 -- 172.21.15.86:0/2500558262 >> v1:172.21.15.134:6789/0 conn(0x7f0b9814fbc0 legacy=0x7f0b980c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:42.012 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.007+0000 7f0b96d9d640 1 -- 172.21.15.86:0/2500558262 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b980c6610 con 0x7f0b98074100 2024-04-25T12:21:42.013 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.007+0000 7f0b96d9d640 1 --2- 172.21.15.86:0/2500558262 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b98074100 0x7f0b980c7250 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0b90009e50 tx=0x7f0b9001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c642745d50d8131 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:42.014 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.007+0000 7f0b9559a640 1 -- 172.21.15.86:0/2500558262 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b900a5890 con 0x7f0b98074100 2024-04-25T12:21:42.014 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.007+0000 7f0b9559a640 1 -- 172.21.15.86:0/2500558262 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b900a5a30 con 0x7f0b98074100 2024-04-25T12:21:42.014 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.007+0000 7f0b9559a640 1 -- 172.21.15.86:0/2500558262 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b900a5e00 con 0x7f0b98074100 2024-04-25T12:21:42.014 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.007+0000 7f0b9cd23640 1 -- 172.21.15.86:0/2500558262 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b98074100 msgr2=0x7f0b980c7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:42.014 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.007+0000 7f0b9cd23640 1 --2- 172.21.15.86:0/2500558262 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b98074100 0x7f0b980c7250 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0b90009e50 tx=0x7f0b9001c9f0 comp rx=0 tx=0).stop 2024-04-25T12:21:42.015 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.007+0000 7f0b9cd23640 1 -- 172.21.15.86:0/2500558262 shutdown_connections 2024-04-25T12:21:42.015 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.007+0000 7f0b9cd23640 1 --2- 172.21.15.86:0/2500558262 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b98074100 0x7f0b980c7250 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:42.015 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.007+0000 7f0b9cd23640 1 --2- 172.21.15.86:0/2500558262 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0b9814ffa0 0x7f0b9806f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:42.015 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.007+0000 7f0b9cd23640 1 -- 172.21.15.86:0/2500558262 >> 172.21.15.86:0/2500558262 conn(0x7f0b9806b9d0 msgr2=0x7f0b9806bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:42.015 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.007+0000 7f0b9cd23640 1 -- 172.21.15.86:0/2500558262 shutdown_connections 2024-04-25T12:21:42.015 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.007+0000 7f0b9cd23640 1 -- 172.21.15.86:0/2500558262 wait complete. 2024-04-25T12:21:42.015 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.011+0000 7f0b9cd23640 1 Processor -- start 2024-04-25T12:21:42.015 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.011+0000 7f0b9cd23640 1 -- start start 2024-04-25T12:21:42.018 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.011+0000 7f0b9cd23640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0b98074100 0x7f0b9815c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:42.018 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.011+0000 7f0b9cd23640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b9814fbc0 0x7f0b9815cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:42.018 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.011+0000 7f0b9cd23640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b9814ffa0 0x7f0b981f3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:42.018 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.011+0000 7f0b9cd23640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f0b980c8ab0 con 0x7f0b9814fbc0 2024-04-25T12:21:42.018 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.011+0000 7f0b9cd23640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0b980c8930 con 0x7f0b9814ffa0 2024-04-25T12:21:42.018 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.011+0000 7f0b9cd23640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f0b98166090 con 0x7f0b98074100 2024-04-25T12:21:42.018 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.011+0000 7f0b95d9b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b9814fbc0 0x7f0b9815cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:42.018 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.011+0000 7f0b95d9b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b9814fbc0 0x7f0b9815cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:46034/0 (socket says 172.21.15.86:46034) 2024-04-25T12:21:42.018 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.011+0000 7f0b95d9b640 1 -- 172.21.15.86:0/1946141745 learned_addr learned my addr 172.21.15.86:0/1946141745 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:42.018 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.011+0000 7f0b96d9d640 1 --2- 172.21.15.86:0/1946141745 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b9814ffa0 0x7f0b981f3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:42.018 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.011+0000 7f0b95d9b640 1 -- 172.21.15.86:0/1946141745 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0b98074100 msgr2=0x7f0b9815c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:42.018 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.011+0000 7f0b9659c640 1 --2- 172.21.15.86:0/1946141745 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0b98074100 0x7f0b9815c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:42.019 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.011+0000 7f0b95d9b640 1 --2- 172.21.15.86:0/1946141745 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0b98074100 0x7f0b9815c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:42.019 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.011+0000 7f0b95d9b640 1 -- 172.21.15.86:0/1946141745 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b9814ffa0 msgr2=0x7f0b981f3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:42.019 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.011+0000 7f0b95d9b640 1 --2- 172.21.15.86:0/1946141745 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b9814ffa0 0x7f0b981f3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:42.019 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.011+0000 7f0b95d9b640 1 -- 172.21.15.86:0/1946141745 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b9815b3d0 con 0x7f0b9814fbc0 2024-04-25T12:21:42.019 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.011+0000 7f0b96d9d640 1 --2- 172.21.15.86:0/1946141745 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b9814ffa0 0x7f0b981f3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:21:42.019 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.011+0000 7f0b9659c640 1 --2- 172.21.15.86:0/1946141745 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0b98074100 0x7f0b9815c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:21:42.019 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.011+0000 7f0b95d9b640 1 --2- 172.21.15.86:0/1946141745 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b9814fbc0 0x7f0b9815cfb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c00d5f0 tx=0x7f0b8c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:42.019 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.011+0000 7f0b86ffd640 1 -- 172.21.15.86:0/1946141745 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b8c0125f0 con 0x7f0b9814fbc0 2024-04-25T12:21:42.019 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.011+0000 7f0b86ffd640 1 -- 172.21.15.86:0/1946141745 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b8c019070 con 0x7f0b9814fbc0 2024-04-25T12:21:42.019 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.011+0000 7f0b86ffd640 1 -- 172.21.15.86:0/1946141745 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b8c0129b0 con 0x7f0b9814fbc0 2024-04-25T12:21:42.019 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.011+0000 7f0b9cd23640 1 -- 172.21.15.86:0/1946141745 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b98149ac0 con 0x7f0b9814fbc0 2024-04-25T12:21:42.019 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.011+0000 7f0b9cd23640 1 -- 172.21.15.86:0/1946141745 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b9815c1a0 con 0x7f0b9814fbc0 2024-04-25T12:21:42.019 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.011+0000 7f0b9cd23640 1 -- 172.21.15.86:0/1946141745 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b98075df0 con 0x7f0b9814fbc0 2024-04-25T12:21:42.020 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.011+0000 7f0b86ffd640 1 -- 172.21.15.86:0/1946141745 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0b8c012b50 con 0x7f0b9814fbc0 2024-04-25T12:21:42.020 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.015+0000 7f0b86ffd640 1 --2- 172.21.15.86:0/1946141745 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f0b78068380 0x7f0b7806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:42.020 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.015+0000 7f0b86ffd640 1 -- 172.21.15.86:0/1946141745 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0b8c0871c0 con 0x7f0b9814fbc0 2024-04-25T12:21:42.020 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.015+0000 7f0b9659c640 1 --2- 172.21.15.86:0/1946141745 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f0b78068380 0x7f0b7806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:42.020 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.015+0000 7f0b9659c640 1 --2- 172.21.15.86:0/1946141745 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f0b78068380 0x7f0b7806a840 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0b88003e40 tx=0x7f0b88009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:42.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.019+0000 7f0b86ffd640 1 -- 172.21.15.86:0/1946141745 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0b8c0573b0 con 0x7f0b9814fbc0 2024-04-25T12:21:42.185 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.179+0000 7f0b9cd23640 1 -- 172.21.15.86:0/1946141745 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f0b980c7df0 con 0x7f0b9814fbc0 2024-04-25T12:21:42.186 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.179+0000 7f0b86ffd640 1 -- 172.21.15.86:0/1946141745 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7f0b8c056cb0 con 0x7f0b9814fbc0 2024-04-25T12:21:42.186 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 32 2024-04-25T12:21:42.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.183+0000 7f0b9cd23640 1 -- 172.21.15.86:0/1946141745 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f0b78068380 msgr2=0x7f0b7806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:42.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.183+0000 7f0b9cd23640 1 --2- 172.21.15.86:0/1946141745 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f0b78068380 0x7f0b7806a840 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0b88003e40 tx=0x7f0b88009040 comp rx=0 tx=0).stop 2024-04-25T12:21:42.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.183+0000 7f0b9cd23640 1 -- 172.21.15.86:0/1946141745 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b9814fbc0 msgr2=0x7f0b9815cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:42.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.183+0000 7f0b9cd23640 1 --2- 172.21.15.86:0/1946141745 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b9814fbc0 0x7f0b9815cfb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c00d5f0 tx=0x7f0b8c00dab0 comp rx=0 tx=0).stop 2024-04-25T12:21:42.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.183+0000 7f0b9cd23640 1 -- 172.21.15.86:0/1946141745 shutdown_connections 2024-04-25T12:21:42.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.183+0000 7f0b9cd23640 1 --2- 172.21.15.86:0/1946141745 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b9814ffa0 0x7f0b981f3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:42.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.183+0000 7f0b9cd23640 1 --2- 172.21.15.86:0/1946141745 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f0b78068380 0x7f0b7806a840 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:42.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.183+0000 7f0b9cd23640 1 --2- 172.21.15.86:0/1946141745 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b9814fbc0 0x7f0b9815cfb0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:42.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.183+0000 7f0b9cd23640 1 --2- 172.21.15.86:0/1946141745 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0b98074100 0x7f0b9815c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:42.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.183+0000 7f0b9cd23640 1 -- 172.21.15.86:0/1946141745 >> 172.21.15.86:0/1946141745 conn(0x7f0b9806b9d0 msgr2=0x7f0b9806e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:42.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.183+0000 7f0b9cd23640 1 -- 172.21.15.86:0/1946141745 shutdown_connections 2024-04-25T12:21:42.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.183+0000 7f0b9cd23640 1 -- 172.21.15.86:0/1946141745 wait complete. 2024-04-25T12:21:42.205 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T12:21:42.330 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.327+0000 7f70ee05d640 1 Processor -- start 2024-04-25T12:21:42.331 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.327+0000 7f70ee05d640 1 -- start start 2024-04-25T12:21:42.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.327+0000 7f70ee05d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f70e8152270 0x7f70e81587b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:42.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.327+0000 7f70ee05d640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f70e806d690 0x7f70e806cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:42.333 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.327+0000 7f70ee05d640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70e80c81e0 con 0x7f70e806d020 2024-04-25T12:21:42.333 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.327+0000 7f70ee05d640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f70e80c84c0 con 0x7f70e806d690 2024-04-25T12:21:42.333 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.327+0000 7f70ee05d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f70e80c87a0 con 0x7f70e8152270 2024-04-25T12:21:42.333 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.327+0000 7f70dffff640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f70e806d690 0x7f70e806cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:42.333 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.327+0000 7f70dffff640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f70e806d690 0x7f70e806cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:46044/0 (socket says 172.21.15.86:46044) 2024-04-25T12:21:42.333 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.327+0000 7f70dffff640 1 -- 172.21.15.86:0/4208912787 learned_addr learned my addr 172.21.15.86:0/4208912787 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:42.333 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.327+0000 7f70e77fe640 1 --2- 172.21.15.86:0/4208912787 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f70e8152270 0x7f70e81587b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:42.333 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.327+0000 7f70dffff640 1 -- 172.21.15.86:0/4208912787 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f70e8152270 msgr2=0x7f70e81587b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:42.333 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.327+0000 7f70dffff640 1 --2- 172.21.15.86:0/4208912787 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f70e8152270 0x7f70e81587b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:42.333 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.327+0000 7f70dffff640 1 -- 172.21.15.86:0/4208912787 >> v1:172.21.15.134:6789/0 conn(0x7f70e806d020 legacy=0x7f70e8072700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:42.333 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.327+0000 7f70dffff640 1 -- 172.21.15.86:0/4208912787 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70e80c8a80 con 0x7f70e806d690 2024-04-25T12:21:42.334 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.327+0000 7f70dffff640 1 --2- 172.21.15.86:0/4208912787 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f70e806d690 0x7f70e806cae0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f70d0009870 tx=0x7f70d001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70f78ce8d4abb279 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:42.334 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.331+0000 7f70e6ffd640 1 -- 172.21.15.86:0/4208912787 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d00b0070 con 0x7f70e806d690 2024-04-25T12:21:42.335 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.331+0000 7f70e6ffd640 1 -- 172.21.15.86:0/4208912787 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70d00ab600 con 0x7f70e806d690 2024-04-25T12:21:42.335 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.331+0000 7f70e6ffd640 1 -- 172.21.15.86:0/4208912787 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d00ab9d0 con 0x7f70e806d690 2024-04-25T12:21:42.335 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.331+0000 7f70ee05d640 1 -- 172.21.15.86:0/4208912787 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f70e806d690 msgr2=0x7f70e806cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:42.335 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.331+0000 7f70ee05d640 1 --2- 172.21.15.86:0/4208912787 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f70e806d690 0x7f70e806cae0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f70d0009870 tx=0x7f70d001c490 comp rx=0 tx=0).stop 2024-04-25T12:21:42.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.331+0000 7f70ee05d640 1 -- 172.21.15.86:0/4208912787 shutdown_connections 2024-04-25T12:21:42.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.331+0000 7f70ee05d640 1 --2- 172.21.15.86:0/4208912787 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f70e806d690 0x7f70e806cae0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:42.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.331+0000 7f70ee05d640 1 --2- 172.21.15.86:0/4208912787 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f70e8152270 0x7f70e81587b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:42.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.331+0000 7f70ee05d640 1 -- 172.21.15.86:0/4208912787 >> 172.21.15.86:0/4208912787 conn(0x7f70e80ca0d0 msgr2=0x7f70e80ca4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:42.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.331+0000 7f70ee05d640 1 -- 172.21.15.86:0/4208912787 shutdown_connections 2024-04-25T12:21:42.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.331+0000 7f70ee05d640 1 -- 172.21.15.86:0/4208912787 wait complete. 2024-04-25T12:21:42.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.331+0000 7f70ee05d640 1 Processor -- start 2024-04-25T12:21:42.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.331+0000 7f70ee05d640 1 -- start start 2024-04-25T12:21:42.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.331+0000 7f70ee05d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f70e806d020 0x7f70e806bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:42.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.331+0000 7f70ee05d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70e806d690 0x7f70e8159980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:42.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.331+0000 7f70ee05d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f70e8152270 0x7f70e8159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:42.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.331+0000 7f70ee05d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f70e8165080 con 0x7f70e8152270 2024-04-25T12:21:42.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.331+0000 7f70ee05d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f70e8164f00 con 0x7f70e806d690 2024-04-25T12:21:42.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.331+0000 7f70ee05d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f70e8165200 con 0x7f70e806d020 2024-04-25T12:21:42.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.331+0000 7f70e7fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f70e8152270 0x7f70e8159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:42.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.331+0000 7f70e7fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f70e8152270 0x7f70e8159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:46050/0 (socket says 172.21.15.86:46050) 2024-04-25T12:21:42.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.331+0000 7f70e7fff640 1 -- 172.21.15.86:0/381930884 learned_addr learned my addr 172.21.15.86:0/381930884 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:42.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.331+0000 7f70e77fe640 1 --2- 172.21.15.86:0/381930884 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f70e806d020 0x7f70e806bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:42.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.331+0000 7f70dffff640 1 --2- 172.21.15.86:0/381930884 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70e806d690 0x7f70e8159980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:42.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.331+0000 7f70e7fff640 1 -- 172.21.15.86:0/381930884 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f70e806d020 msgr2=0x7f70e806bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:42.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.331+0000 7f70e7fff640 1 --2- 172.21.15.86:0/381930884 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f70e806d020 0x7f70e806bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:42.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.331+0000 7f70e7fff640 1 -- 172.21.15.86:0/381930884 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70e806d690 msgr2=0x7f70e8159980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:42.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.331+0000 7f70e7fff640 1 --2- 172.21.15.86:0/381930884 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70e806d690 0x7f70e8159980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:42.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.331+0000 7f70e7fff640 1 -- 172.21.15.86:0/381930884 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70e81510b0 con 0x7f70e8152270 2024-04-25T12:21:42.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.331+0000 7f70e7fff640 1 --2- 172.21.15.86:0/381930884 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f70e8152270 0x7f70e8159ec0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f70e000b9c0 tx=0x7f70e000be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:42.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.331+0000 7f70e4ff9640 1 -- 172.21.15.86:0/381930884 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e0019070 con 0x7f70e8152270 2024-04-25T12:21:42.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.331+0000 7f70e4ff9640 1 -- 172.21.15.86:0/381930884 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70e000cba0 con 0x7f70e8152270 2024-04-25T12:21:42.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.331+0000 7f70ee05d640 1 -- 172.21.15.86:0/381930884 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70e8151320 con 0x7f70e8152270 2024-04-25T12:21:42.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.331+0000 7f70e4ff9640 1 -- 172.21.15.86:0/381930884 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e0014440 con 0x7f70e8152270 2024-04-25T12:21:42.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.331+0000 7f70ee05d640 1 -- 172.21.15.86:0/381930884 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70e81518e0 con 0x7f70e8152270 2024-04-25T12:21:42.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.335+0000 7f70ee05d640 1 -- 172.21.15.86:0/381930884 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70e8075df0 con 0x7f70e8152270 2024-04-25T12:21:42.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.335+0000 7f70e4ff9640 1 -- 172.21.15.86:0/381930884 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f70e001c070 con 0x7f70e8152270 2024-04-25T12:21:42.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.335+0000 7f70e4ff9640 1 --2- 172.21.15.86:0/381930884 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f70c8068380 0x7f70c806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:42.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.335+0000 7f70e4ff9640 1 -- 172.21.15.86:0/381930884 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f70e0086a50 con 0x7f70e8152270 2024-04-25T12:21:42.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.335+0000 7f70e77fe640 1 --2- 172.21.15.86:0/381930884 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f70c8068380 0x7f70c806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:42.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.335+0000 7f70e77fe640 1 --2- 172.21.15.86:0/381930884 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f70c8068380 0x7f70c806a840 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f70d800b930 tx=0x7f70d8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:42.344 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.339+0000 7f70e4ff9640 1 -- 172.21.15.86:0/381930884 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f70e0056d60 con 0x7f70e8152270 2024-04-25T12:21:42.493 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.487+0000 7f70ee05d640 1 -- 172.21.15.86:0/381930884 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f70e806dd50 con 0x7f70e8152270 2024-04-25T12:21:42.494 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.487+0000 7f70e4ff9640 1 -- 172.21.15.86:0/381930884 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7f70e0056660 con 0x7f70e8152270 2024-04-25T12:21:42.494 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 64 2024-04-25T12:21:42.496 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.491+0000 7f70ee05d640 1 -- 172.21.15.86:0/381930884 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f70c8068380 msgr2=0x7f70c806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:42.497 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.491+0000 7f70ee05d640 1 --2- 172.21.15.86:0/381930884 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f70c8068380 0x7f70c806a840 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f70d800b930 tx=0x7f70d8008040 comp rx=0 tx=0).stop 2024-04-25T12:21:42.497 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.491+0000 7f70ee05d640 1 -- 172.21.15.86:0/381930884 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f70e8152270 msgr2=0x7f70e8159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:42.497 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.491+0000 7f70ee05d640 1 --2- 172.21.15.86:0/381930884 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f70e8152270 0x7f70e8159ec0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f70e000b9c0 tx=0x7f70e000be80 comp rx=0 tx=0).stop 2024-04-25T12:21:42.497 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.491+0000 7f70ee05d640 1 -- 172.21.15.86:0/381930884 shutdown_connections 2024-04-25T12:21:42.497 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.491+0000 7f70ee05d640 1 --2- 172.21.15.86:0/381930884 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f70c8068380 0x7f70c806a840 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:42.497 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.491+0000 7f70ee05d640 1 --2- 172.21.15.86:0/381930884 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f70e8152270 0x7f70e8159ec0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:42.497 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.491+0000 7f70ee05d640 1 --2- 172.21.15.86:0/381930884 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70e806d690 0x7f70e8159980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:42.497 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.491+0000 7f70ee05d640 1 --2- 172.21.15.86:0/381930884 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f70e806d020 0x7f70e806bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:42.497 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.491+0000 7f70ee05d640 1 -- 172.21.15.86:0/381930884 >> 172.21.15.86:0/381930884 conn(0x7f70e80ca0d0 msgr2=0x7f70e806fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:42.497 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.491+0000 7f70ee05d640 1 -- 172.21.15.86:0/381930884 shutdown_connections 2024-04-25T12:21:42.497 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.491+0000 7f70ee05d640 1 -- 172.21.15.86:0/381930884 wait complete. 2024-04-25T12:21:42.512 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T12:21:42.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.627+0000 7f8fd90bb640 1 Processor -- start 2024-04-25T12:21:42.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.627+0000 7f8fd90bb640 1 -- start start 2024-04-25T12:21:42.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.627+0000 7f8fd90bb640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8fd40c8250 0x7f8fd40c39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:42.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.627+0000 7f8fd90bb640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8fd40c8630 0x7f8fd4151b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:42.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.627+0000 7f8fd90bb640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fd415b740 con 0x7f8fd40c8a70 2024-04-25T12:21:42.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.627+0000 7f8fd90bb640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f8fd40c6490 con 0x7f8fd40c8250 2024-04-25T12:21:42.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.627+0000 7f8fd90bb640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f8fd40c58c0 con 0x7f8fd40c8630 2024-04-25T12:21:42.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.627+0000 7f8fd2d9d640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8fd40c8250 0x7f8fd40c39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:42.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.627+0000 7f8fd2d9d640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8fd40c8250 0x7f8fd40c39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37178/0 (socket says 172.21.15.86:37178) 2024-04-25T12:21:42.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.627+0000 7f8fd2d9d640 1 -- 172.21.15.86:0/1393783815 learned_addr learned my addr 172.21.15.86:0/1393783815 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:42.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.631+0000 7f8fd259c640 1 --2- 172.21.15.86:0/1393783815 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8fd40c8630 0x7f8fd4151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:42.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.631+0000 7f8fd2d9d640 1 -- 172.21.15.86:0/1393783815 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8fd40c8630 msgr2=0x7f8fd4151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:42.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.631+0000 7f8fd2d9d640 1 --2- 172.21.15.86:0/1393783815 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8fd40c8630 0x7f8fd4151b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:42.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.631+0000 7f8fd2d9d640 1 -- 172.21.15.86:0/1393783815 >> v1:172.21.15.134:6789/0 conn(0x7f8fd40c8a70 legacy=0x7f8fd4152080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:42.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.631+0000 7f8fd2d9d640 1 -- 172.21.15.86:0/1393783815 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fd40c5b60 con 0x7f8fd40c8250 2024-04-25T12:21:42.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.631+0000 7f8fd2d9d640 1 --2- 172.21.15.86:0/1393783815 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8fd40c8250 0x7f8fd40c39e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8fc40098a0 tx=0x7f8fc401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=978b482e94350fee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:42.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.631+0000 7f8fd1d9b640 1 -- 172.21.15.86:0/1393783815 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc40b0070 con 0x7f8fd40c8250 2024-04-25T12:21:42.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.631+0000 7f8fd1d9b640 1 -- 172.21.15.86:0/1393783815 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fc40ab600 con 0x7f8fd40c8250 2024-04-25T12:21:42.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.631+0000 7f8fd1d9b640 1 -- 172.21.15.86:0/1393783815 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc40ab9d0 con 0x7f8fd40c8250 2024-04-25T12:21:42.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.631+0000 7f8fd90bb640 1 -- 172.21.15.86:0/1393783815 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8fd40c8250 msgr2=0x7f8fd40c39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:42.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.631+0000 7f8fd90bb640 1 --2- 172.21.15.86:0/1393783815 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8fd40c8250 0x7f8fd40c39e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8fc40098a0 tx=0x7f8fc401c470 comp rx=0 tx=0).stop 2024-04-25T12:21:42.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.631+0000 7f8fd90bb640 1 -- 172.21.15.86:0/1393783815 shutdown_connections 2024-04-25T12:21:42.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.631+0000 7f8fd90bb640 1 --2- 172.21.15.86:0/1393783815 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8fd40c8630 0x7f8fd4151b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:42.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.631+0000 7f8fd90bb640 1 --2- 172.21.15.86:0/1393783815 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8fd40c8250 0x7f8fd40c39e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:42.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.631+0000 7f8fd90bb640 1 -- 172.21.15.86:0/1393783815 >> 172.21.15.86:0/1393783815 conn(0x7f8fd406b9d0 msgr2=0x7f8fd406bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:42.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.631+0000 7f8fd90bb640 1 -- 172.21.15.86:0/1393783815 shutdown_connections 2024-04-25T12:21:42.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.631+0000 7f8fd90bb640 1 -- 172.21.15.86:0/1393783815 wait complete. 2024-04-25T12:21:42.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.635+0000 7f8fd90bb640 1 Processor -- start 2024-04-25T12:21:42.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.635+0000 7f8fd90bb640 1 -- start start 2024-04-25T12:21:42.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.635+0000 7f8fd90bb640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8fd40c8250 0x7f8fd41f4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:42.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.635+0000 7f8fd90bb640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8fd40c8630 0x7f8fd41f20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:42.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.635+0000 7f8fd90bb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8fd40c8a70 0x7f8fd4145860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:42.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.635+0000 7f8fd90bb640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f8fd40c6920 con 0x7f8fd40c8630 2024-04-25T12:21:42.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.635+0000 7f8fd90bb640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8fd415b400 con 0x7f8fd40c8a70 2024-04-25T12:21:42.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.635+0000 7f8fd90bb640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f8fd40681d0 con 0x7f8fd40c8250 2024-04-25T12:21:42.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.635+0000 7f8fd259c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8fd40c8630 0x7f8fd41f20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:42.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.635+0000 7f8fd259c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8fd40c8630 0x7f8fd41f20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37192/0 (socket says 172.21.15.86:37192) 2024-04-25T12:21:42.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.635+0000 7f8fd259c640 1 -- 172.21.15.86:0/2200790804 learned_addr learned my addr 172.21.15.86:0/2200790804 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:42.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.635+0000 7f8fd2d9d640 1 --2- 172.21.15.86:0/2200790804 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8fd40c8250 0x7f8fd41f4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:42.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.635+0000 7f8fd359e640 1 --2- 172.21.15.86:0/2200790804 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8fd40c8a70 0x7f8fd4145860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:42.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.635+0000 7f8fd259c640 1 -- 172.21.15.86:0/2200790804 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8fd40c8250 msgr2=0x7f8fd41f4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:42.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.635+0000 7f8fd259c640 1 --2- 172.21.15.86:0/2200790804 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8fd40c8250 0x7f8fd41f4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:42.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.635+0000 7f8fd259c640 1 -- 172.21.15.86:0/2200790804 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8fd40c8a70 msgr2=0x7f8fd4145860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:42.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.635+0000 7f8fd259c640 1 --2- 172.21.15.86:0/2200790804 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8fd40c8a70 0x7f8fd4145860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:42.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.635+0000 7f8fd259c640 1 -- 172.21.15.86:0/2200790804 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fd41f52d0 con 0x7f8fd40c8630 2024-04-25T12:21:42.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.635+0000 7f8fd359e640 1 --2- 172.21.15.86:0/2200790804 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8fd40c8a70 0x7f8fd4145860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:21:42.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.635+0000 7f8fd259c640 1 --2- 172.21.15.86:0/2200790804 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8fd40c8630 0x7f8fd41f20e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc00d830 tx=0x7f8fbc00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:42.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.635+0000 7f8fcb7fe640 1 -- 172.21.15.86:0/2200790804 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fbc00b6c0 con 0x7f8fd40c8630 2024-04-25T12:21:42.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.635+0000 7f8fcb7fe640 1 -- 172.21.15.86:0/2200790804 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fbc019070 con 0x7f8fd40c8630 2024-04-25T12:21:42.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.635+0000 7f8fd90bb640 1 -- 172.21.15.86:0/2200790804 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fd41f55b0 con 0x7f8fd40c8630 2024-04-25T12:21:42.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.635+0000 7f8fcb7fe640 1 -- 172.21.15.86:0/2200790804 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fbc00ba60 con 0x7f8fd40c8630 2024-04-25T12:21:42.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.635+0000 7f8fd90bb640 1 -- 172.21.15.86:0/2200790804 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fd4145060 con 0x7f8fd40c8630 2024-04-25T12:21:42.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.635+0000 7f8fd90bb640 1 -- 172.21.15.86:0/2200790804 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fd41f5ad0 con 0x7f8fd40c8630 2024-04-25T12:21:42.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.635+0000 7f8fcb7fe640 1 -- 172.21.15.86:0/2200790804 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8fbc01e460 con 0x7f8fd40c8630 2024-04-25T12:21:42.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.635+0000 7f8fcb7fe640 1 --2- 172.21.15.86:0/2200790804 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f8fb4068380 0x7f8fb406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:42.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.639+0000 7f8fcb7fe640 1 -- 172.21.15.86:0/2200790804 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f8fbc087490 con 0x7f8fd40c8630 2024-04-25T12:21:42.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.639+0000 7f8fd2d9d640 1 --2- 172.21.15.86:0/2200790804 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f8fb4068380 0x7f8fb406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:42.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.639+0000 7f8fd2d9d640 1 --2- 172.21.15.86:0/2200790804 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f8fb4068380 0x7f8fb406a840 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8fc40ad000 tx=0x7f8fc4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:42.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.643+0000 7f8fcb7fe640 1 -- 172.21.15.86:0/2200790804 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8fd41f5ad0 con 0x7f8fd40c8630 2024-04-25T12:21:42.808 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.803+0000 7f8fd90bb640 1 -- 172.21.15.86:0/2200790804 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f8fd4075df0 con 0x7f8fd40c8630 2024-04-25T12:21:42.809 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.803+0000 7f8fcb7fe640 1 -- 172.21.15.86:0/2200790804 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) ==== 103+0+11 (secure 0 0 0) 0x7f8fbc057680 con 0x7f8fd40c8630 2024-04-25T12:21:42.809 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 32 2024-04-25T12:21:42.811 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.807+0000 7f8fd90bb640 1 -- 172.21.15.86:0/2200790804 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f8fb4068380 msgr2=0x7f8fb406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:42.811 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.807+0000 7f8fd90bb640 1 --2- 172.21.15.86:0/2200790804 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f8fb4068380 0x7f8fb406a840 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8fc40ad000 tx=0x7f8fc4008040 comp rx=0 tx=0).stop 2024-04-25T12:21:42.811 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.807+0000 7f8fd90bb640 1 -- 172.21.15.86:0/2200790804 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8fd40c8630 msgr2=0x7f8fd41f20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:42.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.807+0000 7f8fd90bb640 1 --2- 172.21.15.86:0/2200790804 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8fd40c8630 0x7f8fd41f20e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc00d830 tx=0x7f8fbc00dcf0 comp rx=0 tx=0).stop 2024-04-25T12:21:42.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.807+0000 7f8fd90bb640 1 -- 172.21.15.86:0/2200790804 shutdown_connections 2024-04-25T12:21:42.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.807+0000 7f8fd90bb640 1 --2- 172.21.15.86:0/2200790804 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8fd40c8a70 0x7f8fd4145860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:42.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.807+0000 7f8fd90bb640 1 --2- 172.21.15.86:0/2200790804 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f8fb4068380 0x7f8fb406a840 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:42.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.807+0000 7f8fd90bb640 1 --2- 172.21.15.86:0/2200790804 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8fd40c8630 0x7f8fd41f20e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:42.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.807+0000 7f8fd90bb640 1 --2- 172.21.15.86:0/2200790804 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8fd40c8250 0x7f8fd41f4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:42.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.807+0000 7f8fd90bb640 1 -- 172.21.15.86:0/2200790804 >> 172.21.15.86:0/2200790804 conn(0x7f8fd406b9d0 msgr2=0x7f8fd414e320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:42.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.807+0000 7f8fd90bb640 1 -- 172.21.15.86:0/2200790804 shutdown_connections 2024-04-25T12:21:42.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.807+0000 7f8fd90bb640 1 -- 172.21.15.86:0/2200790804 wait complete. 2024-04-25T12:21:42.828 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T12:21:42.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.943+0000 7f8a5b36c640 1 Processor -- start 2024-04-25T12:21:42.950 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.943+0000 7f8a5b36c640 1 -- start start 2024-04-25T12:21:42.951 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.947+0000 7f8a5b36c640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8a54152140 0x7f8a54072f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:42.951 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.947+0000 7f8a5b36c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8a540c7800 0x7f8a5415b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:42.951 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.947+0000 7f8a5b36c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8a5415b930 0x7f8a54157e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:42.952 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.947+0000 7f8a5b36c640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f8a540c0790 con 0x7f8a54152140 2024-04-25T12:21:42.952 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.947+0000 7f8a5b36c640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f8a54072a70 con 0x7f8a540c7800 2024-04-25T12:21:42.952 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.947+0000 7f8a5b36c640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f8a5406cc30 con 0x7f8a5415b930 2024-04-25T12:21:42.952 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.947+0000 7f8a59108640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8a54152140 0x7f8a54072f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:42.952 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.947+0000 7f8a59108640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8a54152140 0x7f8a54072f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37208/0 (socket says 172.21.15.86:37208) 2024-04-25T12:21:42.952 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.947+0000 7f8a59108640 1 -- 172.21.15.86:0/1337878534 learned_addr learned my addr 172.21.15.86:0/1337878534 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:42.952 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.947+0000 7f8a59909640 1 --2- 172.21.15.86:0/1337878534 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8a5415b930 0x7f8a54157e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:42.952 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.947+0000 7f8a58907640 1 --2- 172.21.15.86:0/1337878534 >> v2:172.21.15.134:3300/0 conn(0x7f8a540c7800 0x7f8a5415b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:42.952 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.947+0000 7f8a59108640 1 -- 172.21.15.86:0/1337878534 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8a5415b930 msgr2=0x7f8a54157e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:42.952 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.947+0000 7f8a59108640 1 --2- 172.21.15.86:0/1337878534 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8a5415b930 0x7f8a54157e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:42.952 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.947+0000 7f8a59108640 1 -- 172.21.15.86:0/1337878534 >> v2:172.21.15.134:3300/0 conn(0x7f8a540c7800 msgr2=0x7f8a5415b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:42.952 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.947+0000 7f8a59108640 1 --2- 172.21.15.86:0/1337878534 >> v2:172.21.15.134:3300/0 conn(0x7f8a540c7800 0x7f8a5415b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:42.952 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.947+0000 7f8a59108640 1 -- 172.21.15.86:0/1337878534 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a540c09e0 con 0x7f8a54152140 2024-04-25T12:21:42.952 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.947+0000 7f8a58907640 1 --2- 172.21.15.86:0/1337878534 >> v2:172.21.15.134:3300/0 conn(0x7f8a540c7800 0x7f8a5415b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:21:42.953 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.947+0000 7f8a59108640 1 --2- 172.21.15.86:0/1337878534 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8a54152140 0x7f8a54072f00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8a540b3250 tx=0x7f8a5001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad2dc6abfbe8308c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:42.953 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.947+0000 7f8a4bfff640 1 -- 172.21.15.86:0/1337878534 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a500b0070 con 0x7f8a54152140 2024-04-25T12:21:42.953 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.947+0000 7f8a4bfff640 1 -- 172.21.15.86:0/1337878534 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a500ab600 con 0x7f8a54152140 2024-04-25T12:21:42.953 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.947+0000 7f8a4bfff640 1 -- 172.21.15.86:0/1337878534 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a500ab9d0 con 0x7f8a54152140 2024-04-25T12:21:42.954 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.947+0000 7f8a5b36c640 1 -- 172.21.15.86:0/1337878534 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8a54152140 msgr2=0x7f8a54072f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:42.954 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.947+0000 7f8a5b36c640 1 --2- 172.21.15.86:0/1337878534 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8a54152140 0x7f8a54072f00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8a540b3250 tx=0x7f8a5001c490 comp rx=0 tx=0).stop 2024-04-25T12:21:42.954 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.947+0000 7f8a5b36c640 1 -- 172.21.15.86:0/1337878534 shutdown_connections 2024-04-25T12:21:42.955 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.947+0000 7f8a5b36c640 1 --2- 172.21.15.86:0/1337878534 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8a5415b930 0x7f8a54157e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:42.955 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.947+0000 7f8a5b36c640 1 --2- 172.21.15.86:0/1337878534 >> v2:172.21.15.134:3300/0 conn(0x7f8a540c7800 0x7f8a5415b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:42.955 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.947+0000 7f8a5b36c640 1 --2- 172.21.15.86:0/1337878534 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8a54152140 0x7f8a54072f00 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:42.955 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.947+0000 7f8a5b36c640 1 -- 172.21.15.86:0/1337878534 >> 172.21.15.86:0/1337878534 conn(0x7f8a5406f280 msgr2=0x7f8a5406f690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:42.955 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.947+0000 7f8a5b36c640 1 -- 172.21.15.86:0/1337878534 shutdown_connections 2024-04-25T12:21:42.955 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.947+0000 7f8a5b36c640 1 -- 172.21.15.86:0/1337878534 wait complete. 2024-04-25T12:21:42.955 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.951+0000 7f8a5b36c640 1 Processor -- start 2024-04-25T12:21:42.955 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.951+0000 7f8a5b36c640 1 -- start start 2024-04-25T12:21:42.957 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.951+0000 7f8a5b36c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8a540c7800 0x7f8a54149b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:42.957 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.951+0000 7f8a5b36c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8a54152140 0x7f8a541517d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:42.957 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.951+0000 7f8a5b36c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a5415b930 0x7f8a5415a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:42.957 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.951+0000 7f8a5b36c640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f8a5406e4e0 con 0x7f8a54152140 2024-04-25T12:21:42.957 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.951+0000 7f8a5b36c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8a54152520 con 0x7f8a5415b930 2024-04-25T12:21:42.958 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.951+0000 7f8a5b36c640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f8a5406e660 con 0x7f8a540c7800 2024-04-25T12:21:42.958 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.951+0000 7f8a58907640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8a54152140 0x7f8a541517d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:42.958 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.951+0000 7f8a58907640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8a54152140 0x7f8a541517d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37210/0 (socket says 172.21.15.86:37210) 2024-04-25T12:21:42.958 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.951+0000 7f8a58907640 1 -- 172.21.15.86:0/3021099086 learned_addr learned my addr 172.21.15.86:0/3021099086 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:42.958 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.951+0000 7f8a59108640 1 --2- 172.21.15.86:0/3021099086 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8a540c7800 0x7f8a54149b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:42.958 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.951+0000 7f8a59909640 1 --2- 172.21.15.86:0/3021099086 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a5415b930 0x7f8a5415a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:42.958 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.951+0000 7f8a58907640 1 -- 172.21.15.86:0/3021099086 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8a540c7800 msgr2=0x7f8a54149b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:42.958 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.951+0000 7f8a58907640 1 --2- 172.21.15.86:0/3021099086 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8a540c7800 0x7f8a54149b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:42.958 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.951+0000 7f8a58907640 1 -- 172.21.15.86:0/3021099086 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a5415b930 msgr2=0x7f8a5415a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:42.958 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.951+0000 7f8a58907640 1 --2- 172.21.15.86:0/3021099086 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a5415b930 0x7f8a5415a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:42.958 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.951+0000 7f8a58907640 1 -- 172.21.15.86:0/3021099086 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a541f20c0 con 0x7f8a54152140 2024-04-25T12:21:42.958 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.951+0000 7f8a58907640 1 --2- 172.21.15.86:0/3021099086 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8a54152140 0x7f8a541517d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8a4400c820 tx=0x7f8a4400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:42.958 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.951+0000 7f8a49ffb640 1 -- 172.21.15.86:0/3021099086 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a44015070 con 0x7f8a54152140 2024-04-25T12:21:42.958 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.951+0000 7f8a49ffb640 1 -- 172.21.15.86:0/3021099086 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a44007a30 con 0x7f8a54152140 2024-04-25T12:21:42.958 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.951+0000 7f8a5b36c640 1 -- 172.21.15.86:0/3021099086 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a541f23a0 con 0x7f8a54152140 2024-04-25T12:21:42.959 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.951+0000 7f8a49ffb640 1 -- 172.21.15.86:0/3021099086 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a44007e00 con 0x7f8a54152140 2024-04-25T12:21:42.959 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.951+0000 7f8a5b36c640 1 -- 172.21.15.86:0/3021099086 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a541f2960 con 0x7f8a54152140 2024-04-25T12:21:42.959 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.951+0000 7f8a5b36c640 1 -- 172.21.15.86:0/3021099086 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a54075df0 con 0x7f8a54152140 2024-04-25T12:21:42.960 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.951+0000 7f8a49ffb640 1 -- 172.21.15.86:0/3021099086 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8a44018070 con 0x7f8a54152140 2024-04-25T12:21:42.960 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.955+0000 7f8a49ffb640 1 --2- 172.21.15.86:0/3021099086 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f8a38068380 0x7f8a3806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:42.960 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.955+0000 7f8a59108640 1 --2- 172.21.15.86:0/3021099086 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f8a38068380 0x7f8a3806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:42.960 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.955+0000 7f8a49ffb640 1 -- 172.21.15.86:0/3021099086 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f8a44086d20 con 0x7f8a54152140 2024-04-25T12:21:42.960 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.955+0000 7f8a59108640 1 --2- 172.21.15.86:0/3021099086 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f8a38068380 0x7f8a3806a840 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8a54069b80 tx=0x7f8a50008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:42.963 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:42.959+0000 7f8a49ffb640 1 -- 172.21.15.86:0/3021099086 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8a44056e80 con 0x7f8a54152140 2024-04-25T12:21:43.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:43.127+0000 7f8a5b36c640 1 -- 172.21.15.86:0/3021099086 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f8a541f2b30 con 0x7f8a54152140 2024-04-25T12:21:43.132 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:43.127+0000 7f8a49ffb640 1 -- 172.21.15.86:0/3021099086 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f8a44056780 con 0x7f8a54152140 2024-04-25T12:21:43.132 INFO:teuthology.orchestra.run.smithi086.stderr:listed 0 entries 2024-04-25T12:21:43.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:43.127+0000 7f8a5b36c640 1 -- 172.21.15.86:0/3021099086 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f8a38068380 msgr2=0x7f8a3806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:43.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:43.127+0000 7f8a5b36c640 1 --2- 172.21.15.86:0/3021099086 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f8a38068380 0x7f8a3806a840 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8a54069b80 tx=0x7f8a50008040 comp rx=0 tx=0).stop 2024-04-25T12:21:43.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:43.127+0000 7f8a5b36c640 1 -- 172.21.15.86:0/3021099086 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8a54152140 msgr2=0x7f8a541517d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:43.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:43.127+0000 7f8a5b36c640 1 --2- 172.21.15.86:0/3021099086 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8a54152140 0x7f8a541517d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8a4400c820 tx=0x7f8a4400cce0 comp rx=0 tx=0).stop 2024-04-25T12:21:43.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:43.127+0000 7f8a5b36c640 1 -- 172.21.15.86:0/3021099086 shutdown_connections 2024-04-25T12:21:43.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:43.127+0000 7f8a5b36c640 1 --2- 172.21.15.86:0/3021099086 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a5415b930 0x7f8a5415a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:43.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:43.127+0000 7f8a5b36c640 1 --2- 172.21.15.86:0/3021099086 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f8a38068380 0x7f8a3806a840 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:43.135 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:43.127+0000 7f8a5b36c640 1 --2- 172.21.15.86:0/3021099086 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8a54152140 0x7f8a541517d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:43.135 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:43.127+0000 7f8a5b36c640 1 --2- 172.21.15.86:0/3021099086 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8a540c7800 0x7f8a54149b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:43.135 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:43.127+0000 7f8a5b36c640 1 -- 172.21.15.86:0/3021099086 >> 172.21.15.86:0/3021099086 conn(0x7f8a5406f280 msgr2=0x7f8a5406c1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:43.135 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:43.127+0000 7f8a5b36c640 1 -- 172.21.15.86:0/3021099086 shutdown_connections 2024-04-25T12:21:43.135 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:43.127+0000 7f8a5b36c640 1 -- 172.21.15.86:0/3021099086 wait complete. 2024-04-25T12:21:43.150 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi086.front.sepia.ceph.com... 2024-04-25T12:21:43.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:21:43.151 DEBUG:teuthology.orchestra.run.smithi086:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-04-25T12:21:43.174 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi086.stderr:ceph-fuse[33944]: fuse finished with error 0 and tester_r 0 2024-04-25T12:21:43.175 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T12:21:49.277 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi086.front.sepia.ceph.com 2024-04-25T12:21:49.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:21:49.277 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-04-25T12:21:49.296 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T12:21:49.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.463+0000 7f21627ce640 1 Processor -- start 2024-04-25T12:21:49.470 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.463+0000 7f21627ce640 1 -- start start 2024-04-25T12:21:49.470 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.463+0000 7f21627ce640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f215c14fbc0 0x7f215c06f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:49.470 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.463+0000 7f21627ce640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f215c074100 0x7f215c0c7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:49.471 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.463+0000 7f21627ce640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f215c0c5d70 con 0x7f215c14ffa0 2024-04-25T12:21:49.471 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.463+0000 7f21627ce640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f215c0c6050 con 0x7f215c074100 2024-04-25T12:21:49.471 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.463+0000 7f21627ce640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f215c0c6330 con 0x7f215c14fbc0 2024-04-25T12:21:49.472 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.467+0000 7f215bfff640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f215c14fbc0 0x7f215c06f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:49.472 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.467+0000 7f2160d6b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f215c074100 0x7f215c0c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:49.472 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.467+0000 7f215bfff640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f215c14fbc0 0x7f215c06f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.86:42576/0 (socket says 172.21.15.86:42576) 2024-04-25T12:21:49.472 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.467+0000 7f2160d6b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f215c074100 0x7f215c0c7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.86:53762/0 (socket says 172.21.15.86:53762) 2024-04-25T12:21:49.472 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.467+0000 7f215bfff640 1 -- 172.21.15.86:0/2201871950 learned_addr learned my addr 172.21.15.86:0/2201871950 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:49.472 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.467+0000 7f21537fe640 1 --1- 172.21.15.86:0/2201871950 >> v1:172.21.15.134:6789/0 conn(0x7f215c14ffa0 0x7f215c0c8220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.86:41828/0 (socket says 172.21.15.86:41828) 2024-04-25T12:21:49.472 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.467+0000 7f2160d6b640 1 -- 172.21.15.86:0/2201871950 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f215c14fbc0 msgr2=0x7f215c06f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:49.472 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.467+0000 7f2160d6b640 1 --2- 172.21.15.86:0/2201871950 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f215c14fbc0 0x7f215c06f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:49.472 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.467+0000 7f2160d6b640 1 -- 172.21.15.86:0/2201871950 >> v1:172.21.15.134:6789/0 conn(0x7f215c14ffa0 legacy=0x7f215c0c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:49.472 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.467+0000 7f2160d6b640 1 -- 172.21.15.86:0/2201871950 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f215c0c6610 con 0x7f215c074100 2024-04-25T12:21:49.472 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.467+0000 7f215bfff640 1 --2- 172.21.15.86:0/2201871950 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f215c14fbc0 0x7f215c06f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T12:21:49.474 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.467+0000 7f2160d6b640 1 --2- 172.21.15.86:0/2201871950 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f215c074100 0x7f215c0c7250 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2154009d90 tx=0x7f215401c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9f884786da2c048 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:49.475 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.467+0000 7f215b7fe640 1 -- 172.21.15.86:0/2201871950 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21540b2070 con 0x7f215c074100 2024-04-25T12:21:49.475 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.467+0000 7f215b7fe640 1 -- 172.21.15.86:0/2201871950 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21540a5a50 con 0x7f215c074100 2024-04-25T12:21:49.475 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.467+0000 7f215b7fe640 1 -- 172.21.15.86:0/2201871950 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21540a5e20 con 0x7f215c074100 2024-04-25T12:21:49.475 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.471+0000 7f21627ce640 1 -- 172.21.15.86:0/2201871950 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f215c074100 msgr2=0x7f215c0c7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:49.475 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.471+0000 7f21627ce640 1 --2- 172.21.15.86:0/2201871950 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f215c074100 0x7f215c0c7250 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2154009d90 tx=0x7f215401c970 comp rx=0 tx=0).stop 2024-04-25T12:21:49.475 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.471+0000 7f21627ce640 1 -- 172.21.15.86:0/2201871950 shutdown_connections 2024-04-25T12:21:49.475 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.471+0000 7f21627ce640 1 --2- 172.21.15.86:0/2201871950 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f215c074100 0x7f215c0c7250 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:49.475 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.471+0000 7f21627ce640 1 --2- 172.21.15.86:0/2201871950 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f215c14fbc0 0x7f215c06f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:49.476 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.471+0000 7f21627ce640 1 -- 172.21.15.86:0/2201871950 >> 172.21.15.86:0/2201871950 conn(0x7f215c06b9d0 msgr2=0x7f215c06bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:49.476 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.471+0000 7f21627ce640 1 -- 172.21.15.86:0/2201871950 shutdown_connections 2024-04-25T12:21:49.476 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.471+0000 7f21627ce640 1 -- 172.21.15.86:0/2201871950 wait complete. 2024-04-25T12:21:49.476 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.471+0000 7f21627ce640 1 Processor -- start 2024-04-25T12:21:49.476 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.471+0000 7f21627ce640 1 -- start start 2024-04-25T12:21:49.478 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.471+0000 7f21627ce640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f215c074100 0x7f215c152ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:49.478 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.471+0000 7f21627ce640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f215c14fbc0 0x7f215c13ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:49.478 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.471+0000 7f21627ce640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f215c14ffa0 0x7f215c1f5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:49.479 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.471+0000 7f21627ce640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f215c0c8ab0 con 0x7f215c14ffa0 2024-04-25T12:21:49.479 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.471+0000 7f21627ce640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f215c0c8930 con 0x7f215c14fbc0 2024-04-25T12:21:49.479 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.471+0000 7f21627ce640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f215c166090 con 0x7f215c074100 2024-04-25T12:21:49.479 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.471+0000 7f2160d6b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f215c14ffa0 0x7f215c1f5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:49.479 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.471+0000 7f2160d6b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f215c14ffa0 0x7f215c1f5610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37214/0 (socket says 172.21.15.86:37214) 2024-04-25T12:21:49.479 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.471+0000 7f2160d6b640 1 -- 172.21.15.86:0/1360391339 learned_addr learned my addr 172.21.15.86:0/1360391339 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:49.479 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.471+0000 7f215bfff640 1 --2- 172.21.15.86:0/1360391339 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f215c074100 0x7f215c152ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:49.479 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.471+0000 7f21537fe640 1 --2- 172.21.15.86:0/1360391339 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f215c14fbc0 0x7f215c13ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:49.479 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.471+0000 7f2160d6b640 1 -- 172.21.15.86:0/1360391339 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f215c074100 msgr2=0x7f215c152ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:49.479 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.471+0000 7f2160d6b640 1 --2- 172.21.15.86:0/1360391339 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f215c074100 0x7f215c152ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:49.479 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.471+0000 7f2160d6b640 1 -- 172.21.15.86:0/1360391339 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f215c14fbc0 msgr2=0x7f215c13ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:49.479 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.471+0000 7f2160d6b640 1 --2- 172.21.15.86:0/1360391339 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f215c14fbc0 0x7f215c13ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:49.479 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.471+0000 7f2160d6b640 1 -- 172.21.15.86:0/1360391339 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f215c14e750 con 0x7f215c14ffa0 2024-04-25T12:21:49.480 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.471+0000 7f2160d6b640 1 --2- 172.21.15.86:0/1360391339 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f215c14ffa0 0x7f215c1f5610 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f21540b0040 tx=0x7f2154019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:49.480 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.471+0000 7f21597fa640 1 -- 172.21.15.86:0/1360391339 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21540b2050 con 0x7f215c14ffa0 2024-04-25T12:21:49.480 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.471+0000 7f21597fa640 1 -- 172.21.15.86:0/1360391339 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21540be070 con 0x7f215c14ffa0 2024-04-25T12:21:49.480 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.471+0000 7f21627ce640 1 -- 172.21.15.86:0/1360391339 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f215c146320 con 0x7f215c14ffa0 2024-04-25T12:21:49.480 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.471+0000 7f21597fa640 1 -- 172.21.15.86:0/1360391339 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2154009450 con 0x7f215c14ffa0 2024-04-25T12:21:49.480 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.471+0000 7f21627ce640 1 -- 172.21.15.86:0/1360391339 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f215c1f60e0 con 0x7f215c14ffa0 2024-04-25T12:21:49.480 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.471+0000 7f21627ce640 1 -- 172.21.15.86:0/1360391339 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f215c075df0 con 0x7f215c14ffa0 2024-04-25T12:21:49.481 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.475+0000 7f21597fa640 1 -- 172.21.15.86:0/1360391339 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f21540b9450 con 0x7f215c14ffa0 2024-04-25T12:21:49.481 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.475+0000 7f21597fa640 1 --2- 172.21.15.86:0/1360391339 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f213c0683b0 0x7f213c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:49.481 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.475+0000 7f21597fa640 1 -- 172.21.15.86:0/1360391339 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f2154121ab0 con 0x7f215c14ffa0 2024-04-25T12:21:49.481 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.475+0000 7f215bfff640 1 --2- 172.21.15.86:0/1360391339 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f213c0683b0 0x7f213c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:49.481 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.475+0000 7f215bfff640 1 --2- 172.21.15.86:0/1360391339 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f213c0683b0 0x7f213c06a870 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f214c009af0 tx=0x7f214c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:49.484 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.479+0000 7f21597fa640 1 -- 172.21.15.86:0/1360391339 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f21540c7020 con 0x7f215c14ffa0 2024-04-25T12:21:49.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.639+0000 7f21627ce640 1 -- 172.21.15.86:0/1360391339 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f215c06f800 con 0x7f215c14ffa0 2024-04-25T12:21:49.649 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.643+0000 7f21597fa640 1 -- 172.21.15.86:0/1360391339 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18514 (secure 0 0 0) 0x7f2154016560 con 0x7f215c14ffa0 2024-04-25T12:21:49.649 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:21:49.649 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":24,"fsid":"f2ef5c0c-9576-4650-b4f7-6cb14247f62a","created":"2024-04-25T12:20:59.241733+0000","modified":"2024-04-25T12:21:28.541128+0000","last_up_change":"2024-04-25T12:21:10.939617+0000","last_in_change":"2024-04-25T12:21:01.534145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T12:21:11.839922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T12:21:21.854040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T12:21:22.406060+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T12:21:26.152386+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1f713f00-ef9f-4a6f-a620-38a8a1f8a822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6801","nonce":2812764579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6803","nonce":2812764579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6807","nonce":2812764579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6805","nonce":2812764579}]},"public_addr":"172.21.15.86:6801/2812764579","cluster_addr":"172.21.15.86:6803/2812764579","heartbeat_back_addr":"172.21.15.86:6807/2812764579","heartbeat_front_addr":"172.21.15.86:6805/2812764579","state":["exists","up"]},{"osd":1,"uuid":"baf6606d-a556-4fbe-a930-855e04ff1534","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6809","nonce":467966038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6811","nonce":467966038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6815","nonce":467966038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6813","nonce":467966038}]},"public_addr":"172.21.15.86:6809/467966038","cluster_addr":"172.21.15.86:6811/467966038","heartbeat_back_addr":"172.21.15.86:6815/467966038","heartbeat_front_addr":"172.21.15.86:6813/467966038","state":["exists","up"]},{"osd":2,"uuid":"c983d68e-6d60-434f-aed6-108420c5dd09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6817","nonce":3279762843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6820","nonce":3279762843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6825","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6827","nonce":3279762843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6824","nonce":3279762843}]},"public_addr":"172.21.15.86:6817/3279762843","cluster_addr":"172.21.15.86:6820/3279762843","heartbeat_back_addr":"172.21.15.86:6827/3279762843","heartbeat_front_addr":"172.21.15.86:6824/3279762843","state":["exists","up"]},{"osd":3,"uuid":"e77657bb-45aa-43bf-ab41-c7377eb495ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6821","nonce":2861354413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6826","nonce":2861354413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6831","nonce":2861354413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6829","nonce":2861354413}]},"public_addr":"172.21.15.86:6821/2861354413","cluster_addr":"172.21.15.86:6826/2861354413","heartbeat_back_addr":"172.21.15.86:6831/2861354413","heartbeat_front_addr":"172.21.15.86:6829/2861354413","state":["exists","up"]},{"osd":4,"uuid":"252bd300-d75a-4b00-be4b-27e6b51de4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6802","nonce":1872913602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6805","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6808","nonce":1872913602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6815","nonce":1872913602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6813","nonce":1872913602}]},"public_addr":"172.21.15.134:6802/1872913602","cluster_addr":"172.21.15.134:6808/1872913602","heartbeat_back_addr":"172.21.15.134:6815/1872913602","heartbeat_front_addr":"172.21.15.134:6813/1872913602","state":["exists","up"]},{"osd":5,"uuid":"4135da3f-7427-4409-a48e-78bd8a7b46ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6801","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6803","nonce":2261413981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6806","nonce":2261413981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6812","nonce":2261413981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6809","nonce":2261413981}]},"public_addr":"172.21.15.134:6803/2261413981","cluster_addr":"172.21.15.134:6806/2261413981","heartbeat_back_addr":"172.21.15.134:6812/2261413981","heartbeat_front_addr":"172.21.15.134:6809/2261413981","state":["exists","up"]},{"osd":6,"uuid":"b6e7a5f1-fa7e-497d-abac-a19994d26820","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6825","nonce":2841082767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6827","nonce":2841082767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6831","nonce":2841082767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6829","nonce":2841082767}]},"public_addr":"172.21.15.134:6825/2841082767","cluster_addr":"172.21.15.134:6827/2841082767","heartbeat_back_addr":"172.21.15.134:6831/2841082767","heartbeat_front_addr":"172.21.15.134:6829/2841082767","state":["exists","up"]},{"osd":7,"uuid":"c5597e50-1962-4103-9124-dd7bceb8ac97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6817","nonce":1277404274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6819","nonce":1277404274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6823","nonce":1277404274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6821","nonce":1277404274}]},"public_addr":"172.21.15.134:6817/1277404274","cluster_addr":"172.21.15.134:6819/1277404274","heartbeat_back_addr":"172.21.15.134:6823/1277404274","heartbeat_front_addr":"172.21.15.134:6821/1277404274","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.018125+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.157958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.113619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.136904+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.844514+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.872629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.775339+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.822867+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T12:21:49.651 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.647+0000 7f21627ce640 1 -- 172.21.15.86:0/1360391339 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f213c0683b0 msgr2=0x7f213c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:49.651 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.647+0000 7f21627ce640 1 --2- 172.21.15.86:0/1360391339 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f213c0683b0 0x7f213c06a870 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f214c009af0 tx=0x7f214c008040 comp rx=0 tx=0).stop 2024-04-25T12:21:49.652 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.647+0000 7f21627ce640 1 -- 172.21.15.86:0/1360391339 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f215c14ffa0 msgr2=0x7f215c1f5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:49.652 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.647+0000 7f21627ce640 1 --2- 172.21.15.86:0/1360391339 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f215c14ffa0 0x7f215c1f5610 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f21540b0040 tx=0x7f2154019710 comp rx=0 tx=0).stop 2024-04-25T12:21:49.652 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.647+0000 7f21627ce640 1 -- 172.21.15.86:0/1360391339 shutdown_connections 2024-04-25T12:21:49.652 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.647+0000 7f21627ce640 1 --2- 172.21.15.86:0/1360391339 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f213c0683b0 0x7f213c06a870 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:49.652 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.647+0000 7f21627ce640 1 --2- 172.21.15.86:0/1360391339 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f215c14ffa0 0x7f215c1f5610 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:49.652 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.647+0000 7f21627ce640 1 --2- 172.21.15.86:0/1360391339 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f215c14fbc0 0x7f215c13ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:49.652 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.647+0000 7f21627ce640 1 --2- 172.21.15.86:0/1360391339 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f215c074100 0x7f215c152ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:49.652 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.647+0000 7f21627ce640 1 -- 172.21.15.86:0/1360391339 >> 172.21.15.86:0/1360391339 conn(0x7f215c06b9d0 msgr2=0x7f215c06ed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:49.652 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.647+0000 7f21627ce640 1 -- 172.21.15.86:0/1360391339 shutdown_connections 2024-04-25T12:21:49.652 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.647+0000 7f21627ce640 1 -- 172.21.15.86:0/1360391339 wait complete. 2024-04-25T12:21:49.669 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T12:21:49.793 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.787+0000 7f0d8f436640 1 Processor -- start 2024-04-25T12:21:49.793 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.787+0000 7f0d8f436640 1 -- start start 2024-04-25T12:21:49.795 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.787+0000 7f0d8f436640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0d8814ffa0 0x7f0d8806f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:49.795 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.787+0000 7f0d8f436640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0d88074100 0x7f0d880c7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:49.795 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.787+0000 7f0d8f436640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d880c5d70 con 0x7f0d8814fbc0 2024-04-25T12:21:49.795 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.787+0000 7f0d8f436640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f0d880c6050 con 0x7f0d88074100 2024-04-25T12:21:49.795 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.787+0000 7f0d8f436640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f0d880c6330 con 0x7f0d8814ffa0 2024-04-25T12:21:49.795 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.787+0000 7f0d8d9d3640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0d88074100 0x7f0d880c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:49.795 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.787+0000 7f0d8d9d3640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0d88074100 0x7f0d880c7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37224/0 (socket says 172.21.15.86:37224) 2024-04-25T12:21:49.795 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.787+0000 7f0d8d9d3640 1 -- 172.21.15.86:0/3274908681 learned_addr learned my addr 172.21.15.86:0/3274908681 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:49.795 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.787+0000 7f0d8c9d1640 1 --2- 172.21.15.86:0/3274908681 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0d8814ffa0 0x7f0d8806f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:49.795 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.787+0000 7f0d8d9d3640 1 -- 172.21.15.86:0/3274908681 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0d8814ffa0 msgr2=0x7f0d8806f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:49.796 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.787+0000 7f0d8d9d3640 1 --2- 172.21.15.86:0/3274908681 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0d8814ffa0 0x7f0d8806f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:49.796 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.787+0000 7f0d8d9d3640 1 -- 172.21.15.86:0/3274908681 >> v1:172.21.15.134:6789/0 conn(0x7f0d8814fbc0 legacy=0x7f0d880c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:49.796 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.787+0000 7f0d8d9d3640 1 -- 172.21.15.86:0/3274908681 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d880c6610 con 0x7f0d88074100 2024-04-25T12:21:49.797 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.791+0000 7f0d8d9d3640 1 --2- 172.21.15.86:0/3274908681 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d88074100 0x7f0d880c7250 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0d80009870 tx=0x7f0d8001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b3fa40271530dd3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:49.797 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.791+0000 7f0d7ffff640 1 -- 172.21.15.86:0/3274908681 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d800aa660 con 0x7f0d88074100 2024-04-25T12:21:49.797 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.791+0000 7f0d7ffff640 1 -- 172.21.15.86:0/3274908681 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d800af070 con 0x7f0d88074100 2024-04-25T12:21:49.797 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.791+0000 7f0d7ffff640 1 -- 172.21.15.86:0/3274908681 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d800aaa20 con 0x7f0d88074100 2024-04-25T12:21:49.798 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.791+0000 7f0d8f436640 1 -- 172.21.15.86:0/3274908681 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d88074100 msgr2=0x7f0d880c7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:49.798 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.791+0000 7f0d8f436640 1 --2- 172.21.15.86:0/3274908681 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d88074100 0x7f0d880c7250 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0d80009870 tx=0x7f0d8001c520 comp rx=0 tx=0).stop 2024-04-25T12:21:49.798 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.791+0000 7f0d8f436640 1 -- 172.21.15.86:0/3274908681 shutdown_connections 2024-04-25T12:21:49.798 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.791+0000 7f0d8f436640 1 --2- 172.21.15.86:0/3274908681 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d88074100 0x7f0d880c7250 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:49.798 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.791+0000 7f0d8f436640 1 --2- 172.21.15.86:0/3274908681 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0d8814ffa0 0x7f0d8806f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:49.798 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.791+0000 7f0d8f436640 1 -- 172.21.15.86:0/3274908681 >> 172.21.15.86:0/3274908681 conn(0x7f0d8806b9d0 msgr2=0x7f0d8806bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:49.798 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.791+0000 7f0d8f436640 1 -- 172.21.15.86:0/3274908681 shutdown_connections 2024-04-25T12:21:49.798 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.791+0000 7f0d8f436640 1 -- 172.21.15.86:0/3274908681 wait complete. 2024-04-25T12:21:49.799 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.795+0000 7f0d8f436640 1 Processor -- start 2024-04-25T12:21:49.799 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.795+0000 7f0d8f436640 1 -- start start 2024-04-25T12:21:49.801 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.795+0000 7f0d8f436640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d88074100 0x7f0d88152e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:49.801 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.795+0000 7f0d8f436640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d8814fbc0 0x7f0d88147020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:49.801 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.795+0000 7f0d8f436640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0d8814ffa0 0x7f0d88140de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:49.801 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.795+0000 7f0d8f436640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f0d880c8ab0 con 0x7f0d88074100 2024-04-25T12:21:49.801 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.795+0000 7f0d8f436640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0d880c8930 con 0x7f0d8814fbc0 2024-04-25T12:21:49.802 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.795+0000 7f0d8f436640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f0d88166090 con 0x7f0d8814ffa0 2024-04-25T12:21:49.802 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.795+0000 7f0d8d1d2640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d88074100 0x7f0d88152e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:49.802 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.795+0000 7f0d8d1d2640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d88074100 0x7f0d88152e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37228/0 (socket says 172.21.15.86:37228) 2024-04-25T12:21:49.802 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.795+0000 7f0d8d1d2640 1 -- 172.21.15.86:0/1195928347 learned_addr learned my addr 172.21.15.86:0/1195928347 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:49.802 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.795+0000 7f0d8c9d1640 1 --2- 172.21.15.86:0/1195928347 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d8814fbc0 0x7f0d88147020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:49.802 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.795+0000 7f0d8d9d3640 1 --2- 172.21.15.86:0/1195928347 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0d8814ffa0 0x7f0d88140de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:49.802 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.795+0000 7f0d8d1d2640 1 -- 172.21.15.86:0/1195928347 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0d8814ffa0 msgr2=0x7f0d88140de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:49.802 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.795+0000 7f0d8d1d2640 1 --2- 172.21.15.86:0/1195928347 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0d8814ffa0 0x7f0d88140de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:49.802 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.795+0000 7f0d8d1d2640 1 -- 172.21.15.86:0/1195928347 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d8814fbc0 msgr2=0x7f0d88147020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:49.802 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.795+0000 7f0d8d1d2640 1 --2- 172.21.15.86:0/1195928347 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d8814fbc0 0x7f0d88147020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:49.802 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.795+0000 7f0d8d1d2640 1 -- 172.21.15.86:0/1195928347 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d88149a20 con 0x7f0d88074100 2024-04-25T12:21:49.802 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.795+0000 7f0d8d1d2640 1 --2- 172.21.15.86:0/1195928347 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d88074100 0x7f0d88152e00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0d8400c7f0 tx=0x7f0d8400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:49.802 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.795+0000 7f0d7dffb640 1 -- 172.21.15.86:0/1195928347 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d84016020 con 0x7f0d88074100 2024-04-25T12:21:49.803 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.795+0000 7f0d7dffb640 1 -- 172.21.15.86:0/1195928347 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d8400aa50 con 0x7f0d88074100 2024-04-25T12:21:49.803 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.795+0000 7f0d8f436640 1 -- 172.21.15.86:0/1195928347 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d88146e00 con 0x7f0d88074100 2024-04-25T12:21:49.803 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.795+0000 7f0d7dffb640 1 -- 172.21.15.86:0/1195928347 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d8400ae40 con 0x7f0d88074100 2024-04-25T12:21:49.803 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.795+0000 7f0d8f436640 1 -- 172.21.15.86:0/1195928347 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d88149f70 con 0x7f0d88074100 2024-04-25T12:21:49.804 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.795+0000 7f0d8f436640 1 -- 172.21.15.86:0/1195928347 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d88075df0 con 0x7f0d88074100 2024-04-25T12:21:49.804 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.795+0000 7f0d7dffb640 1 -- 172.21.15.86:0/1195928347 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0d84019020 con 0x7f0d88074100 2024-04-25T12:21:49.804 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.799+0000 7f0d7dffb640 1 --2- 172.21.15.86:0/1195928347 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f0d6c0683b0 0x7f0d6c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:49.804 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.799+0000 7f0d7dffb640 1 -- 172.21.15.86:0/1195928347 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0d84086db0 con 0x7f0d88074100 2024-04-25T12:21:49.804 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.799+0000 7f0d8c9d1640 1 --2- 172.21.15.86:0/1195928347 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f0d6c0683b0 0x7f0d6c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:49.804 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.799+0000 7f0d8c9d1640 1 --2- 172.21.15.86:0/1195928347 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f0d6c0683b0 0x7f0d6c06a870 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0d8806ebf0 tx=0x7f0d78008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:49.807 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.803+0000 7f0d7dffb640 1 -- 172.21.15.86:0/1195928347 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0d84020030 con 0x7f0d88074100 2024-04-25T12:21:49.969 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.963+0000 7f0d8f436640 1 -- 172.21.15.86:0/1195928347 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0d880c7df0 con 0x7f0d88074100 2024-04-25T12:21:49.972 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.967+0000 7f0d7dffb640 1 -- 172.21.15.86:0/1195928347 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18514 (secure 0 0 0) 0x7f0d84056fa0 con 0x7f0d88074100 2024-04-25T12:21:49.972 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:21:49.973 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":24,"fsid":"f2ef5c0c-9576-4650-b4f7-6cb14247f62a","created":"2024-04-25T12:20:59.241733+0000","modified":"2024-04-25T12:21:28.541128+0000","last_up_change":"2024-04-25T12:21:10.939617+0000","last_in_change":"2024-04-25T12:21:01.534145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T12:21:11.839922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T12:21:21.854040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T12:21:22.406060+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T12:21:26.152386+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1f713f00-ef9f-4a6f-a620-38a8a1f8a822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6801","nonce":2812764579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6803","nonce":2812764579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6807","nonce":2812764579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6805","nonce":2812764579}]},"public_addr":"172.21.15.86:6801/2812764579","cluster_addr":"172.21.15.86:6803/2812764579","heartbeat_back_addr":"172.21.15.86:6807/2812764579","heartbeat_front_addr":"172.21.15.86:6805/2812764579","state":["exists","up"]},{"osd":1,"uuid":"baf6606d-a556-4fbe-a930-855e04ff1534","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6809","nonce":467966038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6811","nonce":467966038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6815","nonce":467966038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6813","nonce":467966038}]},"public_addr":"172.21.15.86:6809/467966038","cluster_addr":"172.21.15.86:6811/467966038","heartbeat_back_addr":"172.21.15.86:6815/467966038","heartbeat_front_addr":"172.21.15.86:6813/467966038","state":["exists","up"]},{"osd":2,"uuid":"c983d68e-6d60-434f-aed6-108420c5dd09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6817","nonce":3279762843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6820","nonce":3279762843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6825","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6827","nonce":3279762843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6824","nonce":3279762843}]},"public_addr":"172.21.15.86:6817/3279762843","cluster_addr":"172.21.15.86:6820/3279762843","heartbeat_back_addr":"172.21.15.86:6827/3279762843","heartbeat_front_addr":"172.21.15.86:6824/3279762843","state":["exists","up"]},{"osd":3,"uuid":"e77657bb-45aa-43bf-ab41-c7377eb495ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6821","nonce":2861354413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6826","nonce":2861354413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6831","nonce":2861354413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6829","nonce":2861354413}]},"public_addr":"172.21.15.86:6821/2861354413","cluster_addr":"172.21.15.86:6826/2861354413","heartbeat_back_addr":"172.21.15.86:6831/2861354413","heartbeat_front_addr":"172.21.15.86:6829/2861354413","state":["exists","up"]},{"osd":4,"uuid":"252bd300-d75a-4b00-be4b-27e6b51de4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6802","nonce":1872913602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6805","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6808","nonce":1872913602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6815","nonce":1872913602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6813","nonce":1872913602}]},"public_addr":"172.21.15.134:6802/1872913602","cluster_addr":"172.21.15.134:6808/1872913602","heartbeat_back_addr":"172.21.15.134:6815/1872913602","heartbeat_front_addr":"172.21.15.134:6813/1872913602","state":["exists","up"]},{"osd":5,"uuid":"4135da3f-7427-4409-a48e-78bd8a7b46ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6801","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6803","nonce":2261413981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6806","nonce":2261413981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6812","nonce":2261413981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6809","nonce":2261413981}]},"public_addr":"172.21.15.134:6803/2261413981","cluster_addr":"172.21.15.134:6806/2261413981","heartbeat_back_addr":"172.21.15.134:6812/2261413981","heartbeat_front_addr":"172.21.15.134:6809/2261413981","state":["exists","up"]},{"osd":6,"uuid":"b6e7a5f1-fa7e-497d-abac-a19994d26820","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6825","nonce":2841082767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6827","nonce":2841082767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6831","nonce":2841082767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6829","nonce":2841082767}]},"public_addr":"172.21.15.134:6825/2841082767","cluster_addr":"172.21.15.134:6827/2841082767","heartbeat_back_addr":"172.21.15.134:6831/2841082767","heartbeat_front_addr":"172.21.15.134:6829/2841082767","state":["exists","up"]},{"osd":7,"uuid":"c5597e50-1962-4103-9124-dd7bceb8ac97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6817","nonce":1277404274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6819","nonce":1277404274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6823","nonce":1277404274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6821","nonce":1277404274}]},"public_addr":"172.21.15.134:6817/1277404274","cluster_addr":"172.21.15.134:6819/1277404274","heartbeat_back_addr":"172.21.15.134:6823/1277404274","heartbeat_front_addr":"172.21.15.134:6821/1277404274","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.018125+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.157958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.113619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.136904+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.844514+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.872629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.775339+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.822867+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T12:21:49.975 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.967+0000 7f0d8f436640 1 -- 172.21.15.86:0/1195928347 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f0d6c0683b0 msgr2=0x7f0d6c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:49.975 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.967+0000 7f0d8f436640 1 --2- 172.21.15.86:0/1195928347 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f0d6c0683b0 0x7f0d6c06a870 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0d8806ebf0 tx=0x7f0d78008040 comp rx=0 tx=0).stop 2024-04-25T12:21:49.975 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.967+0000 7f0d8f436640 1 -- 172.21.15.86:0/1195928347 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d88074100 msgr2=0x7f0d88152e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:49.975 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.967+0000 7f0d8f436640 1 --2- 172.21.15.86:0/1195928347 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d88074100 0x7f0d88152e00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0d8400c7f0 tx=0x7f0d8400ccb0 comp rx=0 tx=0).stop 2024-04-25T12:21:49.975 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.967+0000 7f0d8f436640 1 -- 172.21.15.86:0/1195928347 shutdown_connections 2024-04-25T12:21:49.975 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.967+0000 7f0d8f436640 1 --2- 172.21.15.86:0/1195928347 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0d8814ffa0 0x7f0d88140de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:49.975 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.967+0000 7f0d8f436640 1 --2- 172.21.15.86:0/1195928347 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d8814fbc0 0x7f0d88147020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:49.975 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.967+0000 7f0d8f436640 1 --2- 172.21.15.86:0/1195928347 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f0d6c0683b0 0x7f0d6c06a870 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:49.975 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.967+0000 7f0d8f436640 1 --2- 172.21.15.86:0/1195928347 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d88074100 0x7f0d88152e00 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:49.975 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.967+0000 7f0d8f436640 1 -- 172.21.15.86:0/1195928347 >> 172.21.15.86:0/1195928347 conn(0x7f0d8806b9d0 msgr2=0x7f0d8806e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:49.975 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.967+0000 7f0d8f436640 1 -- 172.21.15.86:0/1195928347 shutdown_connections 2024-04-25T12:21:49.975 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:49.967+0000 7f0d8f436640 1 -- 172.21.15.86:0/1195928347 wait complete. 2024-04-25T12:21:49.991 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T12:21:50.122 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:50.115+0000 7f3321e12640 1 Processor -- start 2024-04-25T12:21:50.122 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:50.115+0000 7f3321e12640 1 -- start start 2024-04-25T12:21:50.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:50.119+0000 7f3321e12640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f331c14fbc0 0x7f331c06f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:50.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:50.119+0000 7f3321e12640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f331c14ffa0 0x7f331c0c8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:50.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:50.119+0000 7f3321e12640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f331c0c5d70 con 0x7f331c074100 2024-04-25T12:21:50.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:50.119+0000 7f3321e12640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f331c0c6050 con 0x7f331c14fbc0 2024-04-25T12:21:50.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:50.119+0000 7f3321e12640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f331c0c6330 con 0x7f331c14ffa0 2024-04-25T12:21:50.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:50.119+0000 7f331b7fe640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f331c14fbc0 0x7f331c06f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:50.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:50.119+0000 7f331bfff640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f331c074100 0x7f331c0c7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:60970/0 (socket says 172.21.15.86:60970) 2024-04-25T12:21:50.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:50.119+0000 7f331b7fe640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f331c14fbc0 0x7f331c06f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37232/0 (socket says 172.21.15.86:37232) 2024-04-25T12:21:50.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:50.119+0000 7f331bfff640 1 -- 172.21.15.86:0/1489457085 learned_addr learned my addr 172.21.15.86:0/1489457085 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-04-25T12:21:50.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:50.119+0000 7f331affd640 1 --2- 172.21.15.86:0/1489457085 >> v2:172.21.15.134:3300/0 conn(0x7f331c14ffa0 0x7f331c0c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:50.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:50.119+0000 7f331b7fe640 1 -- 172.21.15.86:0/1489457085 >> v2:172.21.15.134:3300/0 conn(0x7f331c14ffa0 msgr2=0x7f331c0c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:50.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:50.119+0000 7f331b7fe640 1 --2- 172.21.15.86:0/1489457085 >> v2:172.21.15.134:3300/0 conn(0x7f331c14ffa0 0x7f331c0c8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:50.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:50.119+0000 7f331b7fe640 1 -- 172.21.15.86:0/1489457085 >> v1:172.21.15.86:6789/0 conn(0x7f331c074100 legacy=0x7f331c0c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:50.125 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:50.119+0000 7f331a7fc640 1 -- 172.21.15.86:0/1489457085 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1496399536 0 0) 0x7f331c0c5d70 con 0x7f331c074100 2024-04-25T12:21:50.125 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:50.119+0000 7f331b7fe640 1 -- 172.21.15.86:0/1489457085 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f331c0c6610 con 0x7f331c14fbc0 2024-04-25T12:21:50.126 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:50.119+0000 7f331b7fe640 1 --2- 172.21.15.86:0/1489457085 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f331c14fbc0 0x7f331c06f700 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f330c009d90 tx=0x7f330c01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a75466f88f19a629 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:50.126 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:50.119+0000 7f331a7fc640 1 -- 172.21.15.86:0/1489457085 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f330c0b2070 con 0x7f331c14fbc0 2024-04-25T12:21:50.126 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:50.119+0000 7f331a7fc640 1 -- 172.21.15.86:0/1489457085 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f330c0a5a10 con 0x7f331c14fbc0 2024-04-25T12:21:50.126 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:50.119+0000 7f331a7fc640 1 -- 172.21.15.86:0/1489457085 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f330c0a5de0 con 0x7f331c14fbc0 2024-04-25T12:21:50.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:50.119+0000 7f3321e12640 1 -- 172.21.15.86:0/1489457085 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f331c14fbc0 msgr2=0x7f331c06f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:50.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:50.119+0000 7f3321e12640 1 --2- 172.21.15.86:0/1489457085 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f331c14fbc0 0x7f331c06f700 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f330c009d90 tx=0x7f330c01c930 comp rx=0 tx=0).stop 2024-04-25T12:21:50.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:50.119+0000 7f3321e12640 1 -- 172.21.15.86:0/1489457085 shutdown_connections 2024-04-25T12:21:50.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:50.119+0000 7f3321e12640 1 --2- 172.21.15.86:0/1489457085 >> v2:172.21.15.134:3300/0 conn(0x7f331c14ffa0 0x7f331c0c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:50.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:50.119+0000 7f3321e12640 1 --2- 172.21.15.86:0/1489457085 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f331c14fbc0 0x7f331c06f700 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:50.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:50.119+0000 7f3321e12640 1 -- 172.21.15.86:0/1489457085 >> 172.21.15.86:0/1489457085 conn(0x7f331c06b9d0 msgr2=0x7f331c06bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:50.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:50.123+0000 7f3321e12640 1 -- 172.21.15.86:0/1489457085 shutdown_connections 2024-04-25T12:21:50.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:50.123+0000 7f3321e12640 1 -- 172.21.15.86:0/1489457085 wait complete. 2024-04-25T12:21:50.128 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:50.123+0000 7f3321e12640 1 Processor -- start 2024-04-25T12:21:50.128 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:50.123+0000 7f3321e12640 1 -- start start 2024-04-25T12:21:50.130 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:50.123+0000 7f3321e12640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f331c074100 0x7f331c14e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:50.130 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:50.123+0000 7f3321e12640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f331c14fbc0 0x7f331c1f7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:50.130 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:50.123+0000 7f3321e12640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f331c14ffa0 0x7f331c1f45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:50.130 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:50.123+0000 7f3321e12640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f331c166420 con 0x7f331c14ffa0 2024-04-25T12:21:50.130 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:50.123+0000 7f3321e12640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f331c1662a0 con 0x7f331c14fbc0 2024-04-25T12:21:50.130 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:50.123+0000 7f3321e12640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f331c1665a0 con 0x7f331c074100 2024-04-25T12:21:50.130 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:50.123+0000 7f331bfff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f331c14ffa0 0x7f331c1f45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:50.130 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:50.123+0000 7f331bfff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f331c14ffa0 0x7f331c1f45c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37244/0 (socket says 172.21.15.86:37244) 2024-04-25T12:21:50.130 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:50.123+0000 7f331bfff640 1 -- 172.21.15.86:0/2063068629 learned_addr learned my addr 172.21.15.86:0/2063068629 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:50.130 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:50.123+0000 7f331b7fe640 1 --2- 172.21.15.86:0/2063068629 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f331c074100 0x7f331c14e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:50.130 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:50.123+0000 7f331affd640 1 --2- 172.21.15.86:0/2063068629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f331c14fbc0 0x7f331c1f7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:50.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:50.123+0000 7f331bfff640 1 -- 172.21.15.86:0/2063068629 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f331c074100 msgr2=0x7f331c14e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:50.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:50.123+0000 7f331bfff640 1 --2- 172.21.15.86:0/2063068629 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f331c074100 0x7f331c14e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:50.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:50.123+0000 7f331bfff640 1 -- 172.21.15.86:0/2063068629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f331c14fbc0 msgr2=0x7f331c1f7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:50.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:50.123+0000 7f331bfff640 1 --2- 172.21.15.86:0/2063068629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f331c14fbc0 0x7f331c1f7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:50.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:50.123+0000 7f331bfff640 1 -- 172.21.15.86:0/2063068629 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f331c1f75d0 con 0x7f331c14ffa0 2024-04-25T12:21:50.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:50.123+0000 7f331b7fe640 1 --2- 172.21.15.86:0/2063068629 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f331c074100 0x7f331c14e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:21:50.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:50.123+0000 7f331bfff640 1 --2- 172.21.15.86:0/2063068629 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f331c14ffa0 0x7f331c1f45c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f331400c480 tx=0x7f331400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:50.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:50.123+0000 7f3313fff640 1 -- 172.21.15.86:0/2063068629 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3314018070 con 0x7f331c14ffa0 2024-04-25T12:21:50.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:50.123+0000 7f3313fff640 1 -- 172.21.15.86:0/2063068629 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33140074e0 con 0x7f331c14ffa0 2024-04-25T12:21:50.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:50.123+0000 7f3321e12640 1 -- 172.21.15.86:0/2063068629 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f331c14a2b0 con 0x7f331c14ffa0 2024-04-25T12:21:50.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:50.123+0000 7f3313fff640 1 -- 172.21.15.86:0/2063068629 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3314004a30 con 0x7f331c14ffa0 2024-04-25T12:21:50.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:50.123+0000 7f3321e12640 1 -- 172.21.15.86:0/2063068629 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f331c14a870 con 0x7f331c14ffa0 2024-04-25T12:21:50.132 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:50.123+0000 7f3321e12640 1 -- 172.21.15.86:0/2063068629 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f331c075df0 con 0x7f331c14ffa0 2024-04-25T12:21:50.132 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:50.127+0000 7f3313fff640 1 -- 172.21.15.86:0/2063068629 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f331401b070 con 0x7f331c14ffa0 2024-04-25T12:21:50.132 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:50.127+0000 7f3313fff640 1 --2- 172.21.15.86:0/2063068629 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f32fc068380 0x7f32fc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:50.132 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:50.127+0000 7f331b7fe640 1 --2- 172.21.15.86:0/2063068629 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f32fc068380 0x7f32fc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:50.133 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:50.127+0000 7f3313fff640 1 -- 172.21.15.86:0/2063068629 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f3314085fd0 con 0x7f331c14ffa0 2024-04-25T12:21:50.133 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:50.127+0000 7f331b7fe640 1 --2- 172.21.15.86:0/2063068629 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f32fc068380 0x7f32fc06a840 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f330c0af000 tx=0x7f330c0a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:50.136 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:50.131+0000 7f3313fff640 1 -- 172.21.15.86:0/2063068629 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3314056250 con 0x7f331c14ffa0 2024-04-25T12:21:50.329 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:50.323+0000 7f3321e12640 1 -- 172.21.15.86:0/2063068629 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f331c0c7df0 con 0x7f331c14ffa0 2024-04-25T12:21:51.249 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.243+0000 7f3313fff640 1 -- 172.21.15.86:0/2063068629 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) ==== 118+0+0 (secure 0 0 0) 0x7f3314007e20 con 0x7f331c14ffa0 2024-04-25T12:21:51.253 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.247+0000 7f3321e12640 1 -- 172.21.15.86:0/2063068629 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f32fc068380 msgr2=0x7f32fc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:51.253 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.247+0000 7f3321e12640 1 --2- 172.21.15.86:0/2063068629 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f32fc068380 0x7f32fc06a840 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f330c0af000 tx=0x7f330c0a7070 comp rx=0 tx=0).stop 2024-04-25T12:21:51.253 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.247+0000 7f3321e12640 1 -- 172.21.15.86:0/2063068629 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f331c14ffa0 msgr2=0x7f331c1f45c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:51.253 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.247+0000 7f3321e12640 1 --2- 172.21.15.86:0/2063068629 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f331c14ffa0 0x7f331c1f45c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f331400c480 tx=0x7f331400c940 comp rx=0 tx=0).stop 2024-04-25T12:21:51.254 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.247+0000 7f3321e12640 1 -- 172.21.15.86:0/2063068629 shutdown_connections 2024-04-25T12:21:51.254 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.247+0000 7f3321e12640 1 --2- 172.21.15.86:0/2063068629 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f32fc068380 0x7f32fc06a840 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:51.254 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.247+0000 7f3321e12640 1 --2- 172.21.15.86:0/2063068629 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f331c14ffa0 0x7f331c1f45c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:51.254 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.247+0000 7f3321e12640 1 --2- 172.21.15.86:0/2063068629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f331c14fbc0 0x7f331c1f7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:51.254 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.247+0000 7f3321e12640 1 --2- 172.21.15.86:0/2063068629 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f331c074100 0x7f331c14e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:51.254 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.247+0000 7f3321e12640 1 -- 172.21.15.86:0/2063068629 >> 172.21.15.86:0/2063068629 conn(0x7f331c06b9d0 msgr2=0x7f331c162dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:51.254 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.247+0000 7f3321e12640 1 -- 172.21.15.86:0/2063068629 shutdown_connections 2024-04-25T12:21:51.254 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.247+0000 7f3321e12640 1 -- 172.21.15.86:0/2063068629 wait complete. 2024-04-25T12:21:51.276 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300} 2024-04-25T12:21:51.276 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2024-04-25T12:21:51.402 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.395+0000 7fc84c85d640 1 Processor -- start 2024-04-25T12:21:51.402 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.395+0000 7fc84c85d640 1 -- start start 2024-04-25T12:21:51.404 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.399+0000 7fc84c85d640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc84814fbc0 0x7fc84806f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:51.404 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.399+0000 7fc84c85d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc84814ffa0 0x7fc8480c8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:51.404 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.399+0000 7fc84c85d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc848074100 0x7fc8480c8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:51.404 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.399+0000 7fc84c85d640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7fc8480c5d70 con 0x7fc84814fbc0 2024-04-25T12:21:51.404 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.399+0000 7fc84c85d640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fc8480c6050 con 0x7fc848074100 2024-04-25T12:21:51.404 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.399+0000 7fc84c85d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fc8480c6330 con 0x7fc84814ffa0 2024-04-25T12:21:51.404 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.399+0000 7fc84659c640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc84814fbc0 0x7fc84806f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:51.404 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.399+0000 7fc84659c640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc84814fbc0 0x7fc84806f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37254/0 (socket says 172.21.15.86:37254) 2024-04-25T12:21:51.404 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.399+0000 7fc84659c640 1 -- 172.21.15.86:0/3194879499 learned_addr learned my addr 172.21.15.86:0/3194879499 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:51.404 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.399+0000 7fc846d9d640 1 --2- 172.21.15.86:0/3194879499 >> v2:172.21.15.134:3300/0 conn(0x7fc848074100 0x7fc8480c8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:51.404 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.399+0000 7fc83ffff640 1 --2- 172.21.15.86:0/3194879499 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc84814ffa0 0x7fc8480c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:51.404 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.399+0000 7fc84659c640 1 -- 172.21.15.86:0/3194879499 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc84814ffa0 msgr2=0x7fc8480c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:51.404 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.399+0000 7fc84659c640 1 --2- 172.21.15.86:0/3194879499 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc84814ffa0 0x7fc8480c8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:51.405 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.399+0000 7fc84659c640 1 -- 172.21.15.86:0/3194879499 >> v2:172.21.15.134:3300/0 conn(0x7fc848074100 msgr2=0x7fc8480c8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:51.405 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.399+0000 7fc84659c640 1 --2- 172.21.15.86:0/3194879499 >> v2:172.21.15.134:3300/0 conn(0x7fc848074100 0x7fc8480c8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:51.405 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.399+0000 7fc84659c640 1 -- 172.21.15.86:0/3194879499 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8480c6610 con 0x7fc84814fbc0 2024-04-25T12:21:51.406 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.399+0000 7fc84659c640 1 --2- 172.21.15.86:0/3194879499 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc84814fbc0 0x7fc84806f700 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc8480744e0 tx=0x7fc83801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e919b7e18a8b4cec server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:51.406 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.399+0000 7fc845d9b640 1 -- 172.21.15.86:0/3194879499 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8380aa660 con 0x7fc84814fbc0 2024-04-25T12:21:51.406 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.399+0000 7fc845d9b640 1 -- 172.21.15.86:0/3194879499 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8380af070 con 0x7fc84814fbc0 2024-04-25T12:21:51.406 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.399+0000 7fc845d9b640 1 -- 172.21.15.86:0/3194879499 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8380aaa20 con 0x7fc84814fbc0 2024-04-25T12:21:51.407 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.399+0000 7fc84c85d640 1 -- 172.21.15.86:0/3194879499 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc84814fbc0 msgr2=0x7fc84806f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:51.407 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.399+0000 7fc84c85d640 1 --2- 172.21.15.86:0/3194879499 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc84814fbc0 0x7fc84806f700 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc8480744e0 tx=0x7fc83801c520 comp rx=0 tx=0).stop 2024-04-25T12:21:51.407 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.399+0000 7fc84c85d640 1 -- 172.21.15.86:0/3194879499 shutdown_connections 2024-04-25T12:21:51.407 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.399+0000 7fc84c85d640 1 --2- 172.21.15.86:0/3194879499 >> v2:172.21.15.134:3300/0 conn(0x7fc848074100 0x7fc8480c8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:51.407 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.399+0000 7fc84c85d640 1 --2- 172.21.15.86:0/3194879499 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc84814ffa0 0x7fc8480c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:51.407 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.399+0000 7fc84c85d640 1 --2- 172.21.15.86:0/3194879499 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc84814fbc0 0x7fc84806f700 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:51.407 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.399+0000 7fc84c85d640 1 -- 172.21.15.86:0/3194879499 >> 172.21.15.86:0/3194879499 conn(0x7fc84806b9d0 msgr2=0x7fc84806bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:51.407 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.399+0000 7fc84c85d640 1 -- 172.21.15.86:0/3194879499 shutdown_connections 2024-04-25T12:21:51.407 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.399+0000 7fc84c85d640 1 -- 172.21.15.86:0/3194879499 wait complete. 2024-04-25T12:21:51.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.403+0000 7fc84c85d640 1 Processor -- start 2024-04-25T12:21:51.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.403+0000 7fc84c85d640 1 -- start start 2024-04-25T12:21:51.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.403+0000 7fc84c85d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc848074100 0x7fc848151220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:51.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.403+0000 7fc84c85d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc84814fbc0 0x7fc8480c44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:51.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.403+0000 7fc84c85d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc84814ffa0 0x7fc848162400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:51.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.403+0000 7fc84c85d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc8481592e0 con 0x7fc848074100 2024-04-25T12:21:51.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.403+0000 7fc84c85d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc848159160 con 0x7fc84814fbc0 2024-04-25T12:21:51.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.403+0000 7fc84c85d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fc848159460 con 0x7fc84814ffa0 2024-04-25T12:21:51.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.403+0000 7fc84659c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc848074100 0x7fc848151220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:51.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.403+0000 7fc84659c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc848074100 0x7fc848151220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37268/0 (socket says 172.21.15.86:37268) 2024-04-25T12:21:51.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.403+0000 7fc84659c640 1 -- 172.21.15.86:0/367990139 learned_addr learned my addr 172.21.15.86:0/367990139 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:51.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.403+0000 7fc846d9d640 1 --2- 172.21.15.86:0/367990139 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc84814ffa0 0x7fc848162400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:51.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.403+0000 7fc83ffff640 1 --2- 172.21.15.86:0/367990139 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc84814fbc0 0x7fc8480c44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:51.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.403+0000 7fc84659c640 1 -- 172.21.15.86:0/367990139 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc84814ffa0 msgr2=0x7fc848162400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:51.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.403+0000 7fc84659c640 1 --2- 172.21.15.86:0/367990139 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc84814ffa0 0x7fc848162400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:51.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.403+0000 7fc84659c640 1 -- 172.21.15.86:0/367990139 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc84814fbc0 msgr2=0x7fc8480c44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:51.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.403+0000 7fc84659c640 1 --2- 172.21.15.86:0/367990139 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc84814fbc0 0x7fc8480c44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:51.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.403+0000 7fc84659c640 1 -- 172.21.15.86:0/367990139 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8480c3d40 con 0x7fc848074100 2024-04-25T12:21:51.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.403+0000 7fc83ffff640 1 --2- 172.21.15.86:0/367990139 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc84814fbc0 0x7fc8480c44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:21:51.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.403+0000 7fc84659c640 1 --2- 172.21.15.86:0/367990139 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc848074100 0x7fc848151220 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc8380ac040 tx=0x7fc83801ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:51.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.403+0000 7fc83effd640 1 -- 172.21.15.86:0/367990139 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8380bd5f0 con 0x7fc848074100 2024-04-25T12:21:51.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.403+0000 7fc83effd640 1 -- 172.21.15.86:0/367990139 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8380bd7b0 con 0x7fc848074100 2024-04-25T12:21:51.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.403+0000 7fc84c85d640 1 -- 172.21.15.86:0/367990139 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc848150460 con 0x7fc848074100 2024-04-25T12:21:51.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.403+0000 7fc83effd640 1 -- 172.21.15.86:0/367990139 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8380bdba0 con 0x7fc848074100 2024-04-25T12:21:51.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.403+0000 7fc84c85d640 1 -- 172.21.15.86:0/367990139 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc848150a20 con 0x7fc848074100 2024-04-25T12:21:51.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.403+0000 7fc84c85d640 1 -- 172.21.15.86:0/367990139 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc848075df0 con 0x7fc848074100 2024-04-25T12:21:51.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.407+0000 7fc83effd640 1 -- 172.21.15.86:0/367990139 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc8380b33f0 con 0x7fc848074100 2024-04-25T12:21:51.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.407+0000 7fc83effd640 1 --2- 172.21.15.86:0/367990139 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fc828068380 0x7fc82806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:51.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.407+0000 7fc83effd640 1 -- 172.21.15.86:0/367990139 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fc838121b70 con 0x7fc848074100 2024-04-25T12:21:51.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.407+0000 7fc83ffff640 1 --2- 172.21.15.86:0/367990139 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fc828068380 0x7fc82806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:51.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.407+0000 7fc83ffff640 1 --2- 172.21.15.86:0/367990139 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fc828068380 0x7fc82806a840 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc8481f1b10 tx=0x7fc830008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:51.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.411+0000 7fc83effd640 1 -- 172.21.15.86:0/367990139 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc8380c3060 con 0x7fc848074100 2024-04-25T12:21:51.614 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:51.607+0000 7fc84c85d640 1 -- 172.21.15.86:0/367990139 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7fc8480c7df0 con 0x7fc848074100 2024-04-25T12:21:52.258 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.251+0000 7fc83effd640 1 -- 172.21.15.86:0/367990139 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v9) ==== 105+0+0 (secure 0 0 0) 0x7fc838016110 con 0x7fc848074100 2024-04-25T12:21:52.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.255+0000 7fc84c85d640 1 -- 172.21.15.86:0/367990139 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fc828068380 msgr2=0x7fc82806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:52.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.255+0000 7fc84c85d640 1 --2- 172.21.15.86:0/367990139 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fc828068380 0x7fc82806a840 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc8481f1b10 tx=0x7fc830008040 comp rx=0 tx=0).stop 2024-04-25T12:21:52.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.255+0000 7fc84c85d640 1 -- 172.21.15.86:0/367990139 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc848074100 msgr2=0x7fc848151220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:52.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.255+0000 7fc84c85d640 1 --2- 172.21.15.86:0/367990139 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc848074100 0x7fc848151220 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc8380ac040 tx=0x7fc83801ad60 comp rx=0 tx=0).stop 2024-04-25T12:21:52.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.255+0000 7fc84c85d640 1 -- 172.21.15.86:0/367990139 shutdown_connections 2024-04-25T12:21:52.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.255+0000 7fc84c85d640 1 --2- 172.21.15.86:0/367990139 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc84814ffa0 0x7fc848162400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:52.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.255+0000 7fc84c85d640 1 --2- 172.21.15.86:0/367990139 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc84814fbc0 0x7fc8480c44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:52.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.255+0000 7fc84c85d640 1 --2- 172.21.15.86:0/367990139 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fc828068380 0x7fc82806a840 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:52.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.255+0000 7fc84c85d640 1 --2- 172.21.15.86:0/367990139 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc848074100 0x7fc848151220 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:52.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.255+0000 7fc84c85d640 1 -- 172.21.15.86:0/367990139 >> 172.21.15.86:0/367990139 conn(0x7fc84806b9d0 msgr2=0x7fc84806c380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:52.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.255+0000 7fc84c85d640 1 -- 172.21.15.86:0/367990139 shutdown_connections 2024-04-25T12:21:52.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.255+0000 7fc84c85d640 1 -- 172.21.15.86:0/367990139 wait complete. 2024-04-25T12:21:52.284 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T12:21:52.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.407+0000 7fa22c048640 1 Processor -- start 2024-04-25T12:21:52.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.407+0000 7fa22c048640 1 -- start start 2024-04-25T12:21:52.414 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.407+0000 7fa22c048640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa2240c8630 0x7fa224151b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:52.414 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.407+0000 7fa22c048640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa22415b740 con 0x7fa2240c8a70 2024-04-25T12:21:52.415 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.407+0000 7fa22c048640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2240c40f0 con 0x7fa2240c8250 2024-04-25T12:21:52.415 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.407+0000 7fa22c048640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7fa2240c6490 con 0x7fa2240c8630 2024-04-25T12:21:52.415 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.407+0000 7fa2295e3640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa2240c8630 0x7fa224151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:52.415 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.407+0000 7fa2295e3640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa2240c8630 0x7fa224151b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37282/0 (socket says 172.21.15.86:37282) 2024-04-25T12:21:52.415 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.407+0000 7fa2295e3640 1 -- 172.21.15.86:0/1984226303 learned_addr learned my addr 172.21.15.86:0/1984226303 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:52.415 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.407+0000 7fa22a5e5640 1 --1- 172.21.15.86:0/1984226303 >> v1:172.21.15.86:6789/0 conn(0x7fa2240c8a70 0x7fa224152080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:60974/0 (socket says 172.21.15.86:60974) 2024-04-25T12:21:52.415 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.407+0000 7fa2295e3640 1 -- 172.21.15.86:0/1984226303 >> v1:172.21.15.134:6789/0 conn(0x7fa2240c8250 legacy=0x7fa2240c39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:52.415 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.407+0000 7fa2295e3640 1 -- 172.21.15.86:0/1984226303 >> v1:172.21.15.86:6789/0 conn(0x7fa2240c8a70 legacy=0x7fa224152080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:52.415 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.407+0000 7fa2295e3640 1 -- 172.21.15.86:0/1984226303 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2240c58c0 con 0x7fa2240c8630 2024-04-25T12:21:52.417 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.411+0000 7fa2295e3640 1 --2- 172.21.15.86:0/1984226303 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2240c8630 0x7fa224151b40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa220009870 tx=0x7fa22001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39c81c871a72543d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:52.417 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.411+0000 7fa228de2640 1 -- 172.21.15.86:0/1984226303 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2200b0070 con 0x7fa2240c8630 2024-04-25T12:21:52.417 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.411+0000 7fa228de2640 1 -- 172.21.15.86:0/1984226303 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2200ab600 con 0x7fa2240c8630 2024-04-25T12:21:52.417 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.411+0000 7fa228de2640 1 -- 172.21.15.86:0/1984226303 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2200ab9d0 con 0x7fa2240c8630 2024-04-25T12:21:52.418 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.411+0000 7fa22c048640 1 -- 172.21.15.86:0/1984226303 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2240c8630 msgr2=0x7fa224151b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:52.418 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.411+0000 7fa22c048640 1 --2- 172.21.15.86:0/1984226303 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2240c8630 0x7fa224151b40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa220009870 tx=0x7fa22001c490 comp rx=0 tx=0).stop 2024-04-25T12:21:52.418 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.411+0000 7fa22c048640 1 -- 172.21.15.86:0/1984226303 shutdown_connections 2024-04-25T12:21:52.418 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.411+0000 7fa22c048640 1 --2- 172.21.15.86:0/1984226303 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2240c8630 0x7fa224151b40 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:52.418 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.411+0000 7fa22c048640 1 -- 172.21.15.86:0/1984226303 >> 172.21.15.86:0/1984226303 conn(0x7fa22406b9d0 msgr2=0x7fa22406bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:52.418 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.411+0000 7fa22c048640 1 -- 172.21.15.86:0/1984226303 shutdown_connections 2024-04-25T12:21:52.418 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.411+0000 7fa22c048640 1 -- 172.21.15.86:0/1984226303 wait complete. 2024-04-25T12:21:52.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.411+0000 7fa22c048640 1 Processor -- start 2024-04-25T12:21:52.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.415+0000 7fa22c048640 1 -- start start 2024-04-25T12:21:52.421 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.415+0000 7fa22c048640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2240c8250 0x7fa2241f0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:52.421 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.415+0000 7fa22c048640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2240c8630 0x7fa2240cb590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:52.421 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.415+0000 7fa22c048640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa2240c8a70 0x7fa224152c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:52.421 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.415+0000 7fa22c048640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa22415b400 con 0x7fa2240c8630 2024-04-25T12:21:52.421 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.415+0000 7fa22c048640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa2240721a0 con 0x7fa2240c8250 2024-04-25T12:21:52.421 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.415+0000 7fa22c048640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fa2240c6920 con 0x7fa2240c8a70 2024-04-25T12:21:52.421 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.415+0000 7fa2295e3640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2240c8630 0x7fa2240cb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:52.421 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.415+0000 7fa2295e3640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2240c8630 0x7fa2240cb590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37292/0 (socket says 172.21.15.86:37292) 2024-04-25T12:21:52.421 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.415+0000 7fa2295e3640 1 -- 172.21.15.86:0/971828041 learned_addr learned my addr 172.21.15.86:0/971828041 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:52.421 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.415+0000 7fa229de4640 1 --2- 172.21.15.86:0/971828041 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2240c8250 0x7fa2241f0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:52.421 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.415+0000 7fa22a5e5640 1 --2- 172.21.15.86:0/971828041 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa2240c8a70 0x7fa224152c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:52.422 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.415+0000 7fa2295e3640 1 -- 172.21.15.86:0/971828041 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa2240c8a70 msgr2=0x7fa224152c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:52.422 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.415+0000 7fa2295e3640 1 --2- 172.21.15.86:0/971828041 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa2240c8a70 0x7fa224152c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:52.422 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.415+0000 7fa2295e3640 1 -- 172.21.15.86:0/971828041 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2240c8250 msgr2=0x7fa2241f0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:52.422 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.415+0000 7fa2295e3640 1 --2- 172.21.15.86:0/971828041 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2240c8250 0x7fa2241f0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:52.422 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.415+0000 7fa2295e3640 1 -- 172.21.15.86:0/971828041 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa22406d710 con 0x7fa2240c8630 2024-04-25T12:21:52.422 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.415+0000 7fa22a5e5640 1 --2- 172.21.15.86:0/971828041 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa2240c8a70 0x7fa224152c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:21:52.422 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.415+0000 7fa2295e3640 1 --2- 172.21.15.86:0/971828041 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2240c8630 0x7fa2240cb590 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa2200ae040 tx=0x7fa220019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:52.422 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.415+0000 7fa21a7fc640 1 -- 172.21.15.86:0/971828041 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2200b0040 con 0x7fa2240c8630 2024-04-25T12:21:52.422 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.415+0000 7fa21a7fc640 1 -- 172.21.15.86:0/971828041 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2200b9070 con 0x7fa2240c8630 2024-04-25T12:21:52.422 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.415+0000 7fa22c048640 1 -- 172.21.15.86:0/971828041 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa22414cfe0 con 0x7fa2240c8630 2024-04-25T12:21:52.422 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.415+0000 7fa21a7fc640 1 -- 172.21.15.86:0/971828041 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2200b4880 con 0x7fa2240c8630 2024-04-25T12:21:52.422 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.415+0000 7fa22c048640 1 -- 172.21.15.86:0/971828041 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa22414d5a0 con 0x7fa2240c8630 2024-04-25T12:21:52.423 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.415+0000 7fa22c048640 1 -- 172.21.15.86:0/971828041 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa224075df0 con 0x7fa2240c8630 2024-04-25T12:21:52.423 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.415+0000 7fa21a7fc640 1 -- 172.21.15.86:0/971828041 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa2200ab4c0 con 0x7fa2240c8630 2024-04-25T12:21:52.423 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.415+0000 7fa21a7fc640 1 --2- 172.21.15.86:0/971828041 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fa208068380 0x7fa20806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:52.423 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.415+0000 7fa229de4640 1 --2- 172.21.15.86:0/971828041 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fa208068380 0x7fa20806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:52.423 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.415+0000 7fa21a7fc640 1 -- 172.21.15.86:0/971828041 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa220120ba0 con 0x7fa2240c8630 2024-04-25T12:21:52.424 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.419+0000 7fa229de4640 1 --2- 172.21.15.86:0/971828041 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fa208068380 0x7fa20806a840 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa214004e30 tx=0x7fa214009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:52.427 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.423+0000 7fa21a7fc640 1 -- 172.21.15.86:0/971828041 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa220016110 con 0x7fa2240c8630 2024-04-25T12:21:52.618 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:52.611+0000 7fa22c048640 1 -- 172.21.15.86:0/971828041 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fa224071e50 con 0x7fa2240c8630 2024-04-25T12:21:52.890 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T12:21:52.893 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T12:21:53.282 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.274+0000 7fa21a7fc640 1 -- 172.21.15.86:0/971828041 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v11) ==== 122+0+0 (secure 0 0 0) 0x7fa220120030 con 0x7fa2240c8630 2024-04-25T12:21:53.285 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.278+0000 7fa22c048640 1 -- 172.21.15.86:0/971828041 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fa208068380 msgr2=0x7fa20806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:53.286 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.278+0000 7fa22c048640 1 --2- 172.21.15.86:0/971828041 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fa208068380 0x7fa20806a840 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa214004e30 tx=0x7fa214009040 comp rx=0 tx=0).stop 2024-04-25T12:21:53.286 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.278+0000 7fa22c048640 1 -- 172.21.15.86:0/971828041 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2240c8630 msgr2=0x7fa2240cb590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:53.286 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.278+0000 7fa22c048640 1 --2- 172.21.15.86:0/971828041 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2240c8630 0x7fa2240cb590 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa2200ae040 tx=0x7fa220019230 comp rx=0 tx=0).stop 2024-04-25T12:21:53.286 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.278+0000 7fa22c048640 1 -- 172.21.15.86:0/971828041 shutdown_connections 2024-04-25T12:21:53.286 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.278+0000 7fa22c048640 1 --2- 172.21.15.86:0/971828041 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa2240c8a70 0x7fa224152c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:53.286 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.278+0000 7fa22c048640 1 --2- 172.21.15.86:0/971828041 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fa208068380 0x7fa20806a840 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:53.286 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.278+0000 7fa22c048640 1 --2- 172.21.15.86:0/971828041 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2240c8630 0x7fa2240cb590 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:53.286 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.278+0000 7fa22c048640 1 --2- 172.21.15.86:0/971828041 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2240c8250 0x7fa2241f0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:53.286 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.278+0000 7fa22c048640 1 -- 172.21.15.86:0/971828041 >> 172.21.15.86:0/971828041 conn(0x7fa22406b9d0 msgr2=0x7fa22414f230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:53.286 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.278+0000 7fa22c048640 1 -- 172.21.15.86:0/971828041 shutdown_connections 2024-04-25T12:21:53.286 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.278+0000 7fa22c048640 1 -- 172.21.15.86:0/971828041 wait complete. 2024-04-25T12:21:53.305 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-04-25T12:21:53.434 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.426+0000 7f27dc95d640 1 Processor -- start 2024-04-25T12:21:53.434 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.426+0000 7f27dc95d640 1 -- start start 2024-04-25T12:21:53.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.430+0000 7f27dc95d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f27d814ffa0 0x7f27d806f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:53.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.430+0000 7f27dc95d640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f27d8074100 0x7f27d80c7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:53.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.430+0000 7f27dc95d640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27d80c5d70 con 0x7f27d814fbc0 2024-04-25T12:21:53.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.430+0000 7f27dc95d640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f27d80c6050 con 0x7f27d8074100 2024-04-25T12:21:53.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.430+0000 7f27dc95d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f27d80c6330 con 0x7f27d814ffa0 2024-04-25T12:21:53.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.430+0000 7f27d6d9d640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f27d8074100 0x7f27d80c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:53.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.430+0000 7f27d6d9d640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f27d8074100 0x7f27d80c7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:59126/0 (socket says 172.21.15.86:59126) 2024-04-25T12:21:53.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.430+0000 7f27d6d9d640 1 -- 172.21.15.86:0/3374207935 learned_addr learned my addr 172.21.15.86:0/3374207935 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:53.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.430+0000 7f27d5d9b640 1 --2- 172.21.15.86:0/3374207935 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f27d814ffa0 0x7f27d806f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:53.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.430+0000 7f27d6d9d640 1 -- 172.21.15.86:0/3374207935 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f27d814ffa0 msgr2=0x7f27d806f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:53.437 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.430+0000 7f27d6d9d640 1 --2- 172.21.15.86:0/3374207935 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f27d814ffa0 0x7f27d806f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:53.437 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.430+0000 7f27d6d9d640 1 -- 172.21.15.86:0/3374207935 >> v1:172.21.15.134:6789/0 conn(0x7f27d814fbc0 legacy=0x7f27d80c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:53.437 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.430+0000 7f27d6d9d640 1 -- 172.21.15.86:0/3374207935 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27d80c6610 con 0x7f27d8074100 2024-04-25T12:21:53.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.430+0000 7f27d6d9d640 1 --2- 172.21.15.86:0/3374207935 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27d8074100 0x7f27d80c7250 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f27c8009870 tx=0x7f27c801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=693b3d8bbb9fe102 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:53.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.430+0000 7f27d559a640 1 -- 172.21.15.86:0/3374207935 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c80a9640 con 0x7f27d8074100 2024-04-25T12:21:53.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.430+0000 7f27d559a640 1 -- 172.21.15.86:0/3374207935 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27c80a97e0 con 0x7f27d8074100 2024-04-25T12:21:53.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.430+0000 7f27d559a640 1 -- 172.21.15.86:0/3374207935 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c80a9bb0 con 0x7f27d8074100 2024-04-25T12:21:53.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.430+0000 7f27dc95d640 1 -- 172.21.15.86:0/3374207935 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27d8074100 msgr2=0x7f27d80c7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:53.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.430+0000 7f27dc95d640 1 --2- 172.21.15.86:0/3374207935 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27d8074100 0x7f27d80c7250 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f27c8009870 tx=0x7f27c801c560 comp rx=0 tx=0).stop 2024-04-25T12:21:53.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.430+0000 7f27dc95d640 1 -- 172.21.15.86:0/3374207935 shutdown_connections 2024-04-25T12:21:53.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.430+0000 7f27dc95d640 1 --2- 172.21.15.86:0/3374207935 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27d8074100 0x7f27d80c7250 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:53.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.430+0000 7f27dc95d640 1 --2- 172.21.15.86:0/3374207935 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f27d814ffa0 0x7f27d806f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:53.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.430+0000 7f27dc95d640 1 -- 172.21.15.86:0/3374207935 >> 172.21.15.86:0/3374207935 conn(0x7f27d806b9d0 msgr2=0x7f27d806bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:53.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.430+0000 7f27dc95d640 1 -- 172.21.15.86:0/3374207935 shutdown_connections 2024-04-25T12:21:53.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.430+0000 7f27dc95d640 1 -- 172.21.15.86:0/3374207935 wait complete. 2024-04-25T12:21:53.442 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.434+0000 7f27dc95d640 1 Processor -- start 2024-04-25T12:21:53.442 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.434+0000 7f27dc95d640 1 -- start start 2024-04-25T12:21:53.442 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.434+0000 7f27dc95d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27d8074100 0x7f27d80c43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:53.442 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.434+0000 7f27dc95d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f27d814fbc0 0x7f27d8161a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:53.442 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.434+0000 7f27dc95d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27d814ffa0 0x7f27d8142e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:53.442 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.434+0000 7f27dc95d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f27d80c8ab0 con 0x7f27d8074100 2024-04-25T12:21:53.442 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.434+0000 7f27dc95d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f27d80c8930 con 0x7f27d814ffa0 2024-04-25T12:21:53.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.434+0000 7f27dc95d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f27d8166090 con 0x7f27d814fbc0 2024-04-25T12:21:53.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.434+0000 7f27d659c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27d8074100 0x7f27d80c43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:53.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.434+0000 7f27d659c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27d8074100 0x7f27d80c43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:59134/0 (socket says 172.21.15.86:59134) 2024-04-25T12:21:53.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.434+0000 7f27d659c640 1 -- 172.21.15.86:0/3317073904 learned_addr learned my addr 172.21.15.86:0/3317073904 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:53.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.434+0000 7f27d5d9b640 1 --2- 172.21.15.86:0/3317073904 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f27d814fbc0 0x7f27d8161a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:53.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.434+0000 7f27d6d9d640 1 --2- 172.21.15.86:0/3317073904 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27d814ffa0 0x7f27d8142e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:53.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.434+0000 7f27d659c640 1 -- 172.21.15.86:0/3317073904 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f27d814fbc0 msgr2=0x7f27d8161a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:53.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.434+0000 7f27d659c640 1 --2- 172.21.15.86:0/3317073904 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f27d814fbc0 0x7f27d8161a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:53.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.434+0000 7f27d659c640 1 -- 172.21.15.86:0/3317073904 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27d814ffa0 msgr2=0x7f27d8142e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:53.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.434+0000 7f27d659c640 1 --2- 172.21.15.86:0/3317073904 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27d814ffa0 0x7f27d8142e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:53.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.434+0000 7f27d659c640 1 -- 172.21.15.86:0/3317073904 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27d8151f10 con 0x7f27d8074100 2024-04-25T12:21:53.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.434+0000 7f27d5d9b640 1 --2- 172.21.15.86:0/3317073904 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f27d814fbc0 0x7f27d8161a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:21:53.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.434+0000 7f27d659c640 1 --2- 172.21.15.86:0/3317073904 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27d8074100 0x7f27d80c43b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f27d000c7c0 tx=0x7f27d000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:53.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.434+0000 7f27c6ffd640 1 -- 172.21.15.86:0/3317073904 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d0016020 con 0x7f27d8074100 2024-04-25T12:21:53.444 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.434+0000 7f27c6ffd640 1 -- 172.21.15.86:0/3317073904 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27d0006d60 con 0x7f27d8074100 2024-04-25T12:21:53.444 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.434+0000 7f27dc95d640 1 -- 172.21.15.86:0/3317073904 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27d815d070 con 0x7f27d8074100 2024-04-25T12:21:53.444 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.434+0000 7f27c6ffd640 1 -- 172.21.15.86:0/3317073904 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d0003bc0 con 0x7f27d8074100 2024-04-25T12:21:53.444 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.434+0000 7f27dc95d640 1 -- 172.21.15.86:0/3317073904 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27d8151430 con 0x7f27d8074100 2024-04-25T12:21:53.444 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.434+0000 7f27dc95d640 1 -- 172.21.15.86:0/3317073904 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27d8075df0 con 0x7f27d8074100 2024-04-25T12:21:53.445 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.438+0000 7f27c6ffd640 1 -- 172.21.15.86:0/3317073904 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f27d000a850 con 0x7f27d8074100 2024-04-25T12:21:53.445 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.438+0000 7f27c6ffd640 1 --2- 172.21.15.86:0/3317073904 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f27b8068380 0x7f27b806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:53.445 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.438+0000 7f27c6ffd640 1 -- 172.21.15.86:0/3317073904 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f27d00869d0 con 0x7f27d8074100 2024-04-25T12:21:53.445 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.438+0000 7f27d5d9b640 1 --2- 172.21.15.86:0/3317073904 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f27b8068380 0x7f27b806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:53.445 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.438+0000 7f27d5d9b640 1 --2- 172.21.15.86:0/3317073904 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f27b8068380 0x7f27b806a840 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f27d814e4c0 tx=0x7f27cc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:53.448 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.442+0000 7f27c6ffd640 1 -- 172.21.15.86:0/3317073904 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f27d0020020 con 0x7f27d8074100 2024-04-25T12:21:53.650 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:53.642+0000 7f27dc95d640 1 -- 172.21.15.86:0/3317073904 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f27d81536a0 con 0x7f27d8074100 2024-04-25T12:21:54.294 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.286+0000 7f27c6ffd640 1 -- 172.21.15.86:0/3317073904 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v12) ==== 115+0+0 (secure 0 0 0) 0x7f27d0019310 con 0x7f27d8074100 2024-04-25T12:21:54.299 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.290+0000 7f27dc95d640 1 -- 172.21.15.86:0/3317073904 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f27b8068380 msgr2=0x7f27b806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:54.299 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.290+0000 7f27dc95d640 1 --2- 172.21.15.86:0/3317073904 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f27b8068380 0x7f27b806a840 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f27d814e4c0 tx=0x7f27cc008040 comp rx=0 tx=0).stop 2024-04-25T12:21:54.299 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.290+0000 7f27dc95d640 1 -- 172.21.15.86:0/3317073904 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27d8074100 msgr2=0x7f27d80c43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:54.299 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.290+0000 7f27dc95d640 1 --2- 172.21.15.86:0/3317073904 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27d8074100 0x7f27d80c43b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f27d000c7c0 tx=0x7f27d000cc80 comp rx=0 tx=0).stop 2024-04-25T12:21:54.299 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.290+0000 7f27dc95d640 1 -- 172.21.15.86:0/3317073904 shutdown_connections 2024-04-25T12:21:54.299 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.290+0000 7f27dc95d640 1 --2- 172.21.15.86:0/3317073904 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27d814ffa0 0x7f27d8142e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:54.299 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.290+0000 7f27dc95d640 1 --2- 172.21.15.86:0/3317073904 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f27d814fbc0 0x7f27d8161a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:54.299 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.290+0000 7f27dc95d640 1 --2- 172.21.15.86:0/3317073904 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f27b8068380 0x7f27b806a840 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:54.299 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.290+0000 7f27dc95d640 1 --2- 172.21.15.86:0/3317073904 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27d8074100 0x7f27d80c43b0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:54.299 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.290+0000 7f27dc95d640 1 -- 172.21.15.86:0/3317073904 >> 172.21.15.86:0/3317073904 conn(0x7f27d806b9d0 msgr2=0x7f27d814da80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:54.299 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.290+0000 7f27dc95d640 1 -- 172.21.15.86:0/3317073904 shutdown_connections 2024-04-25T12:21:54.299 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.294+0000 7f27dc95d640 1 -- 172.21.15.86:0/3317073904 wait complete. 2024-04-25T12:21:54.320 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T12:21:54.321 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T12:21:54.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.438+0000 7f4568e54640 1 Processor -- start 2024-04-25T12:21:54.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.438+0000 7f4568e54640 1 -- start start 2024-04-25T12:21:54.444 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.438+0000 7f4568e54640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f45640c8800 0x7f45640c39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:54.444 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.438+0000 7f4568e54640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f45640c3f20 0x7f45640c5780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:54.444 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.438+0000 7f4568e54640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45640c4790 con 0x7f45640c4b40 2024-04-25T12:21:54.445 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.438+0000 7f4568e54640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f456406cc00 con 0x7f45640c8800 2024-04-25T12:21:54.445 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.438+0000 7f4568e54640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f4564158090 con 0x7f45640c3f20 2024-04-25T12:21:54.445 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.438+0000 7f4562d9d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f45640c3f20 0x7f45640c5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:54.445 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.438+0000 7f4562d9d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f45640c3f20 0x7f45640c5780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.86:42728/0 (socket says 172.21.15.86:42728) 2024-04-25T12:21:54.445 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.438+0000 7f4562d9d640 1 -- 172.21.15.86:0/1980423696 learned_addr learned my addr 172.21.15.86:0/1980423696 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:54.445 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.438+0000 7f4561d9b640 1 --2- 172.21.15.86:0/1980423696 >> v2:172.21.15.134:3300/0 conn(0x7f45640c8800 0x7f45640c39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:54.446 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.438+0000 7f4561d9b640 1 -- 172.21.15.86:0/1980423696 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f45640c3f20 msgr2=0x7f45640c5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:54.446 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.438+0000 7f4561d9b640 1 --2- 172.21.15.86:0/1980423696 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f45640c3f20 0x7f45640c5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:54.446 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.438+0000 7f4561d9b640 1 -- 172.21.15.86:0/1980423696 >> v1:172.21.15.134:6789/0 conn(0x7f45640c4b40 legacy=0x7f456406c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:54.446 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.438+0000 7f4561d9b640 1 -- 172.21.15.86:0/1980423696 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45641582e0 con 0x7f45640c8800 2024-04-25T12:21:54.446 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.438+0000 7f4562d9d640 1 --2- 172.21.15.86:0/1980423696 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f45640c3f20 0x7f45640c5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T12:21:54.447 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.442+0000 7f4561d9b640 1 --2- 172.21.15.86:0/1980423696 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45640c8800 0x7f45640c39e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f45580097c0 tx=0x7f455801c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94f665fda56c981e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:54.448 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.442+0000 7f456159a640 1 -- 172.21.15.86:0/1980423696 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45580b1070 con 0x7f45640c8800 2024-04-25T12:21:54.448 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.442+0000 7f456159a640 1 -- 172.21.15.86:0/1980423696 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45580ac600 con 0x7f45640c8800 2024-04-25T12:21:54.448 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.442+0000 7f456159a640 1 -- 172.21.15.86:0/1980423696 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45580ac9d0 con 0x7f45640c8800 2024-04-25T12:21:54.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.442+0000 7f4568e54640 1 -- 172.21.15.86:0/1980423696 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45640c8800 msgr2=0x7f45640c39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:54.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.442+0000 7f4568e54640 1 --2- 172.21.15.86:0/1980423696 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45640c8800 0x7f45640c39e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f45580097c0 tx=0x7f455801c380 comp rx=0 tx=0).stop 2024-04-25T12:21:54.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.442+0000 7f4568e54640 1 -- 172.21.15.86:0/1980423696 shutdown_connections 2024-04-25T12:21:54.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.442+0000 7f4568e54640 1 --2- 172.21.15.86:0/1980423696 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f45640c3f20 0x7f45640c5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:54.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.442+0000 7f4568e54640 1 --2- 172.21.15.86:0/1980423696 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45640c8800 0x7f45640c39e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:54.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.442+0000 7f4568e54640 1 -- 172.21.15.86:0/1980423696 >> 172.21.15.86:0/1980423696 conn(0x7f456406b9d0 msgr2=0x7f456406bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:54.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.442+0000 7f4568e54640 1 -- 172.21.15.86:0/1980423696 shutdown_connections 2024-04-25T12:21:54.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.442+0000 7f4568e54640 1 -- 172.21.15.86:0/1980423696 wait complete. 2024-04-25T12:21:54.452 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.442+0000 7f4568e54640 1 Processor -- start 2024-04-25T12:21:54.452 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.442+0000 7f4568e54640 1 -- start start 2024-04-25T12:21:54.452 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.442+0000 7f4568e54640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45640c3f20 0x7f456414d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:54.452 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.442+0000 7f4568e54640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f45640c4b40 0x7f4564147dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:54.452 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.442+0000 7f4568e54640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45640c8800 0x7f4564148300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:54.452 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.442+0000 7f4568e54640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f45640c52f0 con 0x7f45640c3f20 2024-04-25T12:21:54.452 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.442+0000 7f4568e54640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f45641585c0 con 0x7f45640c8800 2024-04-25T12:21:54.452 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.442+0000 7f4568e54640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f45640c8c40 con 0x7f45640c4b40 2024-04-25T12:21:54.452 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.442+0000 7f456259c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45640c3f20 0x7f456414d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:54.452 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.442+0000 7f456259c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45640c3f20 0x7f456414d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:59138/0 (socket says 172.21.15.86:59138) 2024-04-25T12:21:54.452 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.442+0000 7f456259c640 1 -- 172.21.15.86:0/1260787635 learned_addr learned my addr 172.21.15.86:0/1260787635 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:54.452 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.446+0000 7f4561d9b640 1 --2- 172.21.15.86:0/1260787635 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f45640c4b40 0x7f4564147dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:54.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.446+0000 7f4562d9d640 1 --2- 172.21.15.86:0/1260787635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45640c8800 0x7f4564148300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:54.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.446+0000 7f456259c640 1 -- 172.21.15.86:0/1260787635 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f45640c4b40 msgr2=0x7f4564147dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:54.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.446+0000 7f456259c640 1 --2- 172.21.15.86:0/1260787635 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f45640c4b40 0x7f4564147dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:54.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.446+0000 7f456259c640 1 -- 172.21.15.86:0/1260787635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45640c8800 msgr2=0x7f4564148300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:54.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.446+0000 7f456259c640 1 --2- 172.21.15.86:0/1260787635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45640c8800 0x7f4564148300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:54.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.446+0000 7f456259c640 1 -- 172.21.15.86:0/1260787635 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f456414adf0 con 0x7f45640c3f20 2024-04-25T12:21:54.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.446+0000 7f4561d9b640 1 --2- 172.21.15.86:0/1260787635 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f45640c4b40 0x7f4564147dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:21:54.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.446+0000 7f456259c640 1 --2- 172.21.15.86:0/1260787635 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45640c3f20 0x7f456414d300 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f455c00c370 tx=0x7f455c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:54.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.446+0000 7f4552ffd640 1 -- 172.21.15.86:0/1260787635 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f455c0052d0 con 0x7f45640c3f20 2024-04-25T12:21:54.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.446+0000 7f4552ffd640 1 -- 172.21.15.86:0/1260787635 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f455c005470 con 0x7f45640c3f20 2024-04-25T12:21:54.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.446+0000 7f4568e54640 1 -- 172.21.15.86:0/1260787635 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f456414b0b0 con 0x7f45640c3f20 2024-04-25T12:21:54.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.446+0000 7f4552ffd640 1 -- 172.21.15.86:0/1260787635 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f455c007260 con 0x7f45640c3f20 2024-04-25T12:21:54.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.446+0000 7f4568e54640 1 -- 172.21.15.86:0/1260787635 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f456406c880 con 0x7f45640c3f20 2024-04-25T12:21:54.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.446+0000 7f4568e54640 1 -- 172.21.15.86:0/1260787635 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45641f77a0 con 0x7f45640c3f20 2024-04-25T12:21:54.455 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.446+0000 7f4552ffd640 1 -- 172.21.15.86:0/1260787635 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f455c007400 con 0x7f45640c3f20 2024-04-25T12:21:54.455 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.446+0000 7f4552ffd640 1 --2- 172.21.15.86:0/1260787635 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f4544068380 0x7f454406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:54.455 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.446+0000 7f4552ffd640 1 -- 172.21.15.86:0/1260787635 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f455c0861a0 con 0x7f45640c3f20 2024-04-25T12:21:54.455 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.446+0000 7f4561d9b640 1 --2- 172.21.15.86:0/1260787635 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f4544068380 0x7f454406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:54.455 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.446+0000 7f4561d9b640 1 --2- 172.21.15.86:0/1260787635 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f4544068380 0x7f454406a840 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f45580ae000 tx=0x7f4558008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:54.458 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.450+0000 7f4552ffd640 1 -- 172.21.15.86:0/1260787635 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f45641f77a0 con 0x7f45640c3f20 2024-04-25T12:21:54.654 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.646+0000 7f4568e54640 1 -- 172.21.15.86:0/1260787635 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4564075df0 con 0x7f45640c3f20 2024-04-25T12:21:54.655 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.650+0000 7f4552ffd640 1 -- 172.21.15.86:0/1260787635 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6854 (secure 0 0 0) 0x7f455c056420 con 0x7f45640c3f20 2024-04-25T12:21:54.656 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:21:54.656 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/1969068022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1969068022},{"type":"v1","addr":"172.21.15.86:6835","nonce":1969068022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6838/3213562806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":3213562806},{"type":"v1","addr":"172.21.15.86:6838","nonce":3213562806}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6839/4002713597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6837","nonce":4002713597},{"type":"v1","addr":"172.21.15.86:6839","nonce":4002713597}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4245,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/3114005030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3114005030},{"type":"v1","addr":"172.21.15.134:6833","nonce":3114005030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T12:21:23.459093+0000","modified":"2024-04-25T12:21:53.650175+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1],"up":{"mds_0":4294,"mds_1":4262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4262":{"gid":4262,"name":"b","rank":1,"incarnation":10,"state":"up:creating","state_seq":1,"addr":"172.21.15.134:6837/1079608447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":1079608447},{"type":"v1","addr":"172.21.15.134:6837","nonce":1079608447}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4294":{"gid":4294,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6836/3044511437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3044511437},{"type":"v1","addr":"172.21.15.134:6836","nonce":3044511437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4294]},"id":1}]} 2024-04-25T12:21:54.656 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 12 2024-04-25T12:21:54.658 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.650+0000 7f4568e54640 1 -- 172.21.15.86:0/1260787635 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f4544068380 msgr2=0x7f454406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:54.658 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.650+0000 7f4568e54640 1 --2- 172.21.15.86:0/1260787635 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f4544068380 0x7f454406a840 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f45580ae000 tx=0x7f4558008040 comp rx=0 tx=0).stop 2024-04-25T12:21:54.658 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.650+0000 7f4568e54640 1 -- 172.21.15.86:0/1260787635 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45640c3f20 msgr2=0x7f456414d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:54.658 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.650+0000 7f4568e54640 1 --2- 172.21.15.86:0/1260787635 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45640c3f20 0x7f456414d300 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f455c00c370 tx=0x7f455c00c830 comp rx=0 tx=0).stop 2024-04-25T12:21:54.658 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.650+0000 7f4568e54640 1 -- 172.21.15.86:0/1260787635 shutdown_connections 2024-04-25T12:21:54.658 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.650+0000 7f4568e54640 1 --2- 172.21.15.86:0/1260787635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45640c8800 0x7f4564148300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:54.658 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.650+0000 7f4568e54640 1 --2- 172.21.15.86:0/1260787635 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f45640c4b40 0x7f4564147dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:54.658 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.650+0000 7f4568e54640 1 --2- 172.21.15.86:0/1260787635 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f4544068380 0x7f454406a840 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:54.658 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.650+0000 7f4568e54640 1 --2- 172.21.15.86:0/1260787635 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45640c3f20 0x7f456414d300 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:54.659 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.650+0000 7f4568e54640 1 -- 172.21.15.86:0/1260787635 >> 172.21.15.86:0/1260787635 conn(0x7f456406b9d0 msgr2=0x7f4564155fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:54.659 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.650+0000 7f4568e54640 1 -- 172.21.15.86:0/1260787635 shutdown_connections 2024-04-25T12:21:54.659 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.650+0000 7f4568e54640 1 -- 172.21.15.86:0/1260787635 wait complete. 2024-04-25T12:21:54.673 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T12:21:54.782 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.774+0000 7ff7109c6640 1 Processor -- start 2024-04-25T12:21:54.782 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.774+0000 7ff7109c6640 1 -- start start 2024-04-25T12:21:54.784 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.778+0000 7ff7109c6640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff70c14fbc0 0x7ff70c06f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:54.784 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.778+0000 7ff7109c6640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff70c074100 0x7ff70c0c7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:54.784 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.778+0000 7ff7109c6640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff70c0c5d70 con 0x7ff70c14ffa0 2024-04-25T12:21:54.784 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.778+0000 7ff7109c6640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7ff70c0c6050 con 0x7ff70c074100 2024-04-25T12:21:54.784 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.778+0000 7ff7109c6640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7ff70c0c6330 con 0x7ff70c14fbc0 2024-04-25T12:21:54.784 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.778+0000 7ff70ad9d640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff70c074100 0x7ff70c0c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:54.784 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.778+0000 7ff70ad9d640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff70c074100 0x7ff70c0c7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:59154/0 (socket says 172.21.15.86:59154) 2024-04-25T12:21:54.784 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.778+0000 7ff70ad9d640 1 -- 172.21.15.86:0/3979438210 learned_addr learned my addr 172.21.15.86:0/3979438210 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:54.784 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.778+0000 7ff70ad9d640 1 -- 172.21.15.86:0/3979438210 >> v2:172.21.15.134:3300/0 conn(0x7ff70c14fbc0 msgr2=0x7ff70c06f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:54.784 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.778+0000 7ff70ad9d640 1 --2- 172.21.15.86:0/3979438210 >> v2:172.21.15.134:3300/0 conn(0x7ff70c14fbc0 0x7ff70c06f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:54.784 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.778+0000 7ff70ad9d640 1 -- 172.21.15.86:0/3979438210 >> v1:172.21.15.134:6789/0 conn(0x7ff70c14ffa0 legacy=0x7ff70c0c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:54.784 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.778+0000 7ff70ad9d640 1 -- 172.21.15.86:0/3979438210 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff70c0c6610 con 0x7ff70c074100 2024-04-25T12:21:54.785 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.778+0000 7ff70ad9d640 1 --2- 172.21.15.86:0/3979438210 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff70c074100 0x7ff70c0c7250 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff704009e50 tx=0x7ff70401c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c55d052b268bda5d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:54.786 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.778+0000 7ff70959a640 1 -- 172.21.15.86:0/3979438210 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7040a5890 con 0x7ff70c074100 2024-04-25T12:21:54.786 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.778+0000 7ff70959a640 1 -- 172.21.15.86:0/3979438210 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7040a5a30 con 0x7ff70c074100 2024-04-25T12:21:54.786 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.778+0000 7ff70959a640 1 -- 172.21.15.86:0/3979438210 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7040a5e00 con 0x7ff70c074100 2024-04-25T12:21:54.787 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.778+0000 7ff7109c6640 1 -- 172.21.15.86:0/3979438210 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff70c074100 msgr2=0x7ff70c0c7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:54.787 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.778+0000 7ff7109c6640 1 --2- 172.21.15.86:0/3979438210 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff70c074100 0x7ff70c0c7250 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff704009e50 tx=0x7ff70401c9b0 comp rx=0 tx=0).stop 2024-04-25T12:21:54.787 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.778+0000 7ff7109c6640 1 -- 172.21.15.86:0/3979438210 shutdown_connections 2024-04-25T12:21:54.787 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.778+0000 7ff7109c6640 1 --2- 172.21.15.86:0/3979438210 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff70c074100 0x7ff70c0c7250 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:54.787 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.778+0000 7ff7109c6640 1 --2- 172.21.15.86:0/3979438210 >> v2:172.21.15.134:3300/0 conn(0x7ff70c14fbc0 0x7ff70c06f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:54.787 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.778+0000 7ff7109c6640 1 -- 172.21.15.86:0/3979438210 >> 172.21.15.86:0/3979438210 conn(0x7ff70c06b9d0 msgr2=0x7ff70c06bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:54.787 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.778+0000 7ff7109c6640 1 -- 172.21.15.86:0/3979438210 shutdown_connections 2024-04-25T12:21:54.787 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.778+0000 7ff7109c6640 1 -- 172.21.15.86:0/3979438210 wait complete. 2024-04-25T12:21:54.789 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.782+0000 7ff7109c6640 1 Processor -- start 2024-04-25T12:21:54.789 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.782+0000 7ff7109c6640 1 -- start start 2024-04-25T12:21:54.789 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.782+0000 7ff7109c6640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff70c074100 0x7ff70c0c4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:54.789 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.782+0000 7ff7109c6640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff70c14fbc0 0x7ff70c15a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:54.789 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.782+0000 7ff7109c6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff70c14ffa0 0x7ff70c15adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:54.790 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.782+0000 7ff7109c6640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff70c0c8ab0 con 0x7ff70c14fbc0 2024-04-25T12:21:54.790 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.782+0000 7ff7109c6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff70c0c8930 con 0x7ff70c14ffa0 2024-04-25T12:21:54.790 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.782+0000 7ff7109c6640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7ff70c166090 con 0x7ff70c074100 2024-04-25T12:21:54.790 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.782+0000 7ff709d9b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff70c14fbc0 0x7ff70c15a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:54.790 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.782+0000 7ff709d9b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff70c14fbc0 0x7ff70c15a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:59166/0 (socket says 172.21.15.86:59166) 2024-04-25T12:21:54.790 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.782+0000 7ff709d9b640 1 -- 172.21.15.86:0/1669526208 learned_addr learned my addr 172.21.15.86:0/1669526208 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:54.790 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.782+0000 7ff70ad9d640 1 --2- 172.21.15.86:0/1669526208 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff70c14ffa0 0x7ff70c15adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:54.790 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.782+0000 7ff70a59c640 1 --2- 172.21.15.86:0/1669526208 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff70c074100 0x7ff70c0c4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:54.790 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.782+0000 7ff709d9b640 1 -- 172.21.15.86:0/1669526208 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff70c074100 msgr2=0x7ff70c0c4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:54.790 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.782+0000 7ff709d9b640 1 --2- 172.21.15.86:0/1669526208 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff70c074100 0x7ff70c0c4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:54.790 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.782+0000 7ff709d9b640 1 -- 172.21.15.86:0/1669526208 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff70c14ffa0 msgr2=0x7ff70c15adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:54.790 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.782+0000 7ff709d9b640 1 --2- 172.21.15.86:0/1669526208 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff70c14ffa0 0x7ff70c15adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:54.790 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.782+0000 7ff709d9b640 1 -- 172.21.15.86:0/1669526208 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff70c1f4420 con 0x7ff70c14fbc0 2024-04-25T12:21:54.791 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.782+0000 7ff709d9b640 1 --2- 172.21.15.86:0/1669526208 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff70c14fbc0 0x7ff70c15a8b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff70000b410 tx=0x7ff70000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:54.791 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.782+0000 7ff6faffd640 1 -- 172.21.15.86:0/1669526208 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff700015020 con 0x7ff70c14fbc0 2024-04-25T12:21:54.791 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.782+0000 7ff6faffd640 1 -- 172.21.15.86:0/1669526208 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff700011830 con 0x7ff70c14fbc0 2024-04-25T12:21:54.791 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.782+0000 7ff7109c6640 1 -- 172.21.15.86:0/1669526208 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff70c1f4700 con 0x7ff70c14fbc0 2024-04-25T12:21:54.791 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.782+0000 7ff6faffd640 1 -- 172.21.15.86:0/1669526208 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff700011c20 con 0x7ff70c14fbc0 2024-04-25T12:21:54.791 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.782+0000 7ff7109c6640 1 -- 172.21.15.86:0/1669526208 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff70c1f4cc0 con 0x7ff70c14fbc0 2024-04-25T12:21:54.792 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.782+0000 7ff7109c6640 1 -- 172.21.15.86:0/1669526208 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff70c075df0 con 0x7ff70c14fbc0 2024-04-25T12:21:54.792 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.782+0000 7ff6faffd640 1 -- 172.21.15.86:0/1669526208 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff700018020 con 0x7ff70c14fbc0 2024-04-25T12:21:54.792 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.786+0000 7ff6faffd640 1 --2- 172.21.15.86:0/1669526208 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7ff6ec0683b0 0x7ff6ec06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:54.792 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.786+0000 7ff70a59c640 1 --2- 172.21.15.86:0/1669526208 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7ff6ec0683b0 0x7ff6ec06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:54.792 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.786+0000 7ff6faffd640 1 -- 172.21.15.86:0/1669526208 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff700086760 con 0x7ff70c14fbc0 2024-04-25T12:21:54.792 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.786+0000 7ff70a59c640 1 --2- 172.21.15.86:0/1669526208 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7ff6ec0683b0 0x7ff6ec06a870 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc006fd0 tx=0x7ff6fc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:54.795 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.790+0000 7ff6faffd640 1 -- 172.21.15.86:0/1669526208 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff70001f070 con 0x7ff70c14fbc0 2024-04-25T12:21:54.955 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.950+0000 7ff7109c6640 1 -- 172.21.15.86:0/1669526208 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff70c149c50 con 0x7ff70c14fbc0 2024-04-25T12:21:54.958 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.950+0000 7ff6faffd640 1 -- 172.21.15.86:0/1669526208 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18514 (secure 0 0 0) 0x7ff700018310 con 0x7ff70c14fbc0 2024-04-25T12:21:54.958 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:21:54.959 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":24,"fsid":"f2ef5c0c-9576-4650-b4f7-6cb14247f62a","created":"2024-04-25T12:20:59.241733+0000","modified":"2024-04-25T12:21:28.541128+0000","last_up_change":"2024-04-25T12:21:10.939617+0000","last_in_change":"2024-04-25T12:21:01.534145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T12:21:11.839922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T12:21:21.854040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T12:21:22.406060+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T12:21:26.152386+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1f713f00-ef9f-4a6f-a620-38a8a1f8a822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6801","nonce":2812764579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6803","nonce":2812764579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6807","nonce":2812764579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6805","nonce":2812764579}]},"public_addr":"172.21.15.86:6801/2812764579","cluster_addr":"172.21.15.86:6803/2812764579","heartbeat_back_addr":"172.21.15.86:6807/2812764579","heartbeat_front_addr":"172.21.15.86:6805/2812764579","state":["exists","up"]},{"osd":1,"uuid":"baf6606d-a556-4fbe-a930-855e04ff1534","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6809","nonce":467966038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6811","nonce":467966038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6815","nonce":467966038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6813","nonce":467966038}]},"public_addr":"172.21.15.86:6809/467966038","cluster_addr":"172.21.15.86:6811/467966038","heartbeat_back_addr":"172.21.15.86:6815/467966038","heartbeat_front_addr":"172.21.15.86:6813/467966038","state":["exists","up"]},{"osd":2,"uuid":"c983d68e-6d60-434f-aed6-108420c5dd09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6817","nonce":3279762843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6820","nonce":3279762843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6825","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6827","nonce":3279762843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6824","nonce":3279762843}]},"public_addr":"172.21.15.86:6817/3279762843","cluster_addr":"172.21.15.86:6820/3279762843","heartbeat_back_addr":"172.21.15.86:6827/3279762843","heartbeat_front_addr":"172.21.15.86:6824/3279762843","state":["exists","up"]},{"osd":3,"uuid":"e77657bb-45aa-43bf-ab41-c7377eb495ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6821","nonce":2861354413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6826","nonce":2861354413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6831","nonce":2861354413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6829","nonce":2861354413}]},"public_addr":"172.21.15.86:6821/2861354413","cluster_addr":"172.21.15.86:6826/2861354413","heartbeat_back_addr":"172.21.15.86:6831/2861354413","heartbeat_front_addr":"172.21.15.86:6829/2861354413","state":["exists","up"]},{"osd":4,"uuid":"252bd300-d75a-4b00-be4b-27e6b51de4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6802","nonce":1872913602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6805","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6808","nonce":1872913602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6815","nonce":1872913602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6813","nonce":1872913602}]},"public_addr":"172.21.15.134:6802/1872913602","cluster_addr":"172.21.15.134:6808/1872913602","heartbeat_back_addr":"172.21.15.134:6815/1872913602","heartbeat_front_addr":"172.21.15.134:6813/1872913602","state":["exists","up"]},{"osd":5,"uuid":"4135da3f-7427-4409-a48e-78bd8a7b46ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6801","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6803","nonce":2261413981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6806","nonce":2261413981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6812","nonce":2261413981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6809","nonce":2261413981}]},"public_addr":"172.21.15.134:6803/2261413981","cluster_addr":"172.21.15.134:6806/2261413981","heartbeat_back_addr":"172.21.15.134:6812/2261413981","heartbeat_front_addr":"172.21.15.134:6809/2261413981","state":["exists","up"]},{"osd":6,"uuid":"b6e7a5f1-fa7e-497d-abac-a19994d26820","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6825","nonce":2841082767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6827","nonce":2841082767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6831","nonce":2841082767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6829","nonce":2841082767}]},"public_addr":"172.21.15.134:6825/2841082767","cluster_addr":"172.21.15.134:6827/2841082767","heartbeat_back_addr":"172.21.15.134:6831/2841082767","heartbeat_front_addr":"172.21.15.134:6829/2841082767","state":["exists","up"]},{"osd":7,"uuid":"c5597e50-1962-4103-9124-dd7bceb8ac97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6817","nonce":1277404274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6819","nonce":1277404274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6823","nonce":1277404274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6821","nonce":1277404274}]},"public_addr":"172.21.15.134:6817/1277404274","cluster_addr":"172.21.15.134:6819/1277404274","heartbeat_back_addr":"172.21.15.134:6823/1277404274","heartbeat_front_addr":"172.21.15.134:6821/1277404274","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.018125+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.157958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.113619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.136904+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.844514+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.872629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.775339+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.822867+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T12:21:54.960 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.954+0000 7ff7109c6640 1 -- 172.21.15.86:0/1669526208 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7ff6ec0683b0 msgr2=0x7ff6ec06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:54.961 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.954+0000 7ff7109c6640 1 --2- 172.21.15.86:0/1669526208 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7ff6ec0683b0 0x7ff6ec06a870 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc006fd0 tx=0x7ff6fc008040 comp rx=0 tx=0).stop 2024-04-25T12:21:54.961 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.954+0000 7ff7109c6640 1 -- 172.21.15.86:0/1669526208 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff70c14fbc0 msgr2=0x7ff70c15a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:54.961 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.954+0000 7ff7109c6640 1 --2- 172.21.15.86:0/1669526208 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff70c14fbc0 0x7ff70c15a8b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff70000b410 tx=0x7ff70000b8d0 comp rx=0 tx=0).stop 2024-04-25T12:21:54.961 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.954+0000 7ff7109c6640 1 -- 172.21.15.86:0/1669526208 shutdown_connections 2024-04-25T12:21:54.961 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.954+0000 7ff7109c6640 1 --2- 172.21.15.86:0/1669526208 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff70c14ffa0 0x7ff70c15adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:54.961 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.954+0000 7ff7109c6640 1 --2- 172.21.15.86:0/1669526208 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7ff6ec0683b0 0x7ff6ec06a870 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:54.961 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.954+0000 7ff7109c6640 1 --2- 172.21.15.86:0/1669526208 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff70c14fbc0 0x7ff70c15a8b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:54.961 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.954+0000 7ff7109c6640 1 --2- 172.21.15.86:0/1669526208 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff70c074100 0x7ff70c0c4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:54.961 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.954+0000 7ff7109c6640 1 -- 172.21.15.86:0/1669526208 >> 172.21.15.86:0/1669526208 conn(0x7ff70c06b9d0 msgr2=0x7ff70c14ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:54.961 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.954+0000 7ff7109c6640 1 -- 172.21.15.86:0/1669526208 shutdown_connections 2024-04-25T12:21:54.961 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:54.954+0000 7ff7109c6640 1 -- 172.21.15.86:0/1669526208 wait complete. 2024-04-25T12:21:54.976 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T12:21:54.976 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T12:21:55.080 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.074+0000 7f5d64deb640 1 Processor -- start 2024-04-25T12:21:55.080 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.074+0000 7f5d64deb640 1 -- start start 2024-04-25T12:21:55.082 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.074+0000 7f5d64deb640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5d6014fbc0 0x7f5d6006f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:55.082 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.074+0000 7f5d64deb640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5d6014ffa0 0x7f5d600c8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:55.082 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.074+0000 7f5d64deb640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d600c5d70 con 0x7f5d60074100 2024-04-25T12:21:55.082 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.074+0000 7f5d64deb640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f5d600c6050 con 0x7f5d6014ffa0 2024-04-25T12:21:55.082 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.074+0000 7f5d64deb640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f5d600c6330 con 0x7f5d6014fbc0 2024-04-25T12:21:55.082 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.074+0000 7f5d5dd9b640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5d6014ffa0 0x7f5d600c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:55.082 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.074+0000 7f5d5dd9b640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5d6014ffa0 0x7f5d600c8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:59180/0 (socket says 172.21.15.86:59180) 2024-04-25T12:21:55.082 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.074+0000 7f5d5dd9b640 1 -- 172.21.15.86:0/1389080964 learned_addr learned my addr 172.21.15.86:0/1389080964 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:55.082 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.074+0000 7f5d5ed9d640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f5d60074100 0x7f5d600c7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:40834/0 (socket says 172.21.15.86:40834) 2024-04-25T12:21:55.082 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.074+0000 7f5d5e59c640 1 --2- 172.21.15.86:0/1389080964 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5d6014fbc0 0x7f5d6006f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:55.083 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.074+0000 7f5d5d59a640 1 -- 172.21.15.86:0/1389080964 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2329725887 0 0) 0x7f5d600c5d70 con 0x7f5d60074100 2024-04-25T12:21:55.083 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.074+0000 7f5d5d59a640 1 -- 172.21.15.86:0/1389080964 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d4c003530 con 0x7f5d60074100 2024-04-25T12:21:55.083 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.074+0000 7f5d5dd9b640 1 -- 172.21.15.86:0/1389080964 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5d6014fbc0 msgr2=0x7f5d6006f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:55.083 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.074+0000 7f5d5dd9b640 1 --2- 172.21.15.86:0/1389080964 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5d6014fbc0 0x7f5d6006f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:55.083 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.074+0000 7f5d5dd9b640 1 -- 172.21.15.86:0/1389080964 >> v1:172.21.15.86:6789/0 conn(0x7f5d60074100 legacy=0x7f5d600c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:55.083 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.074+0000 7f5d5dd9b640 1 -- 172.21.15.86:0/1389080964 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d600c6610 con 0x7f5d6014ffa0 2024-04-25T12:21:55.084 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.078+0000 7f5d5dd9b640 1 --2- 172.21.15.86:0/1389080964 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d6014ffa0 0x7f5d600c8220 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5d48009e50 tx=0x7f5d4801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff41d30ff80c0a97 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:55.084 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.078+0000 7f5d5d59a640 1 -- 172.21.15.86:0/1389080964 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d480a5920 con 0x7f5d6014ffa0 2024-04-25T12:21:55.084 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.078+0000 7f5d5d59a640 1 -- 172.21.15.86:0/1389080964 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d480a5ac0 con 0x7f5d6014ffa0 2024-04-25T12:21:55.084 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.078+0000 7f5d5d59a640 1 -- 172.21.15.86:0/1389080964 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d480ad3f0 con 0x7f5d6014ffa0 2024-04-25T12:21:55.084 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.078+0000 7f5d64deb640 1 -- 172.21.15.86:0/1389080964 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d6014ffa0 msgr2=0x7f5d600c8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:55.084 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.078+0000 7f5d64deb640 1 --2- 172.21.15.86:0/1389080964 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d6014ffa0 0x7f5d600c8220 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5d48009e50 tx=0x7f5d4801ca30 comp rx=0 tx=0).stop 2024-04-25T12:21:55.085 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.078+0000 7f5d64deb640 1 -- 172.21.15.86:0/1389080964 shutdown_connections 2024-04-25T12:21:55.085 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.078+0000 7f5d64deb640 1 --2- 172.21.15.86:0/1389080964 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d6014ffa0 0x7f5d600c8220 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:55.085 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.078+0000 7f5d64deb640 1 --2- 172.21.15.86:0/1389080964 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5d6014fbc0 0x7f5d6006f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:55.085 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.078+0000 7f5d64deb640 1 -- 172.21.15.86:0/1389080964 >> 172.21.15.86:0/1389080964 conn(0x7f5d6006b9d0 msgr2=0x7f5d6006bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:55.085 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.078+0000 7f5d64deb640 1 -- 172.21.15.86:0/1389080964 shutdown_connections 2024-04-25T12:21:55.085 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.078+0000 7f5d64deb640 1 -- 172.21.15.86:0/1389080964 wait complete. 2024-04-25T12:21:55.085 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.078+0000 7f5d64deb640 1 Processor -- start 2024-04-25T12:21:55.085 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.078+0000 7f5d64deb640 1 -- start start 2024-04-25T12:21:55.088 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.078+0000 7f5d64deb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d60074100 0x7f5d60143ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:55.088 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.078+0000 7f5d64deb640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d6014fbc0 0x7f5d60144010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:55.088 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.078+0000 7f5d64deb640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5d6014ffa0 0x7f5d601f58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:55.088 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.078+0000 7f5d64deb640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f5d60166420 con 0x7f5d6014fbc0 2024-04-25T12:21:55.088 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.078+0000 7f5d64deb640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5d601662a0 con 0x7f5d60074100 2024-04-25T12:21:55.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.078+0000 7f5d64deb640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f5d601665a0 con 0x7f5d6014ffa0 2024-04-25T12:21:55.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.078+0000 7f5d5dd9b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d6014fbc0 0x7f5d60144010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:55.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.082+0000 7f5d5dd9b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d6014fbc0 0x7f5d60144010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:59190/0 (socket says 172.21.15.86:59190) 2024-04-25T12:21:55.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.082+0000 7f5d5dd9b640 1 -- 172.21.15.86:0/3870096530 learned_addr learned my addr 172.21.15.86:0/3870096530 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:55.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.082+0000 7f5d5e59c640 1 --2- 172.21.15.86:0/3870096530 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d60074100 0x7f5d60143ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:55.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.082+0000 7f5d5ed9d640 1 --2- 172.21.15.86:0/3870096530 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5d6014ffa0 0x7f5d601f58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:55.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.082+0000 7f5d5dd9b640 1 -- 172.21.15.86:0/3870096530 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5d6014ffa0 msgr2=0x7f5d601f58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:55.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.082+0000 7f5d5dd9b640 1 --2- 172.21.15.86:0/3870096530 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5d6014ffa0 0x7f5d601f58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:55.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.082+0000 7f5d5dd9b640 1 -- 172.21.15.86:0/3870096530 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d60074100 msgr2=0x7f5d60143ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:55.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.082+0000 7f5d5dd9b640 1 --2- 172.21.15.86:0/3870096530 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d60074100 0x7f5d60143ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:55.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.082+0000 7f5d5dd9b640 1 -- 172.21.15.86:0/3870096530 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d60151150 con 0x7f5d6014fbc0 2024-04-25T12:21:55.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.082+0000 7f5d5ed9d640 1 --2- 172.21.15.86:0/3870096530 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5d6014ffa0 0x7f5d601f58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:21:55.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.082+0000 7f5d5dd9b640 1 --2- 172.21.15.86:0/3870096530 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d6014fbc0 0x7f5d60144010 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5d480af040 tx=0x7f5d480197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:55.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.082+0000 7f5d56ffd640 1 -- 172.21.15.86:0/3870096530 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d480a5920 con 0x7f5d6014fbc0 2024-04-25T12:21:55.090 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.082+0000 7f5d56ffd640 1 -- 172.21.15.86:0/3870096530 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d480be070 con 0x7f5d6014fbc0 2024-04-25T12:21:55.090 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.082+0000 7f5d64deb640 1 -- 172.21.15.86:0/3870096530 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d60143260 con 0x7f5d6014fbc0 2024-04-25T12:21:55.090 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.082+0000 7f5d56ffd640 1 -- 172.21.15.86:0/3870096530 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d48009510 con 0x7f5d6014fbc0 2024-04-25T12:21:55.090 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.082+0000 7f5d64deb640 1 -- 172.21.15.86:0/3870096530 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d601516d0 con 0x7f5d6014fbc0 2024-04-25T12:21:55.090 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.082+0000 7f5d64deb640 1 -- 172.21.15.86:0/3870096530 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d60075df0 con 0x7f5d6014fbc0 2024-04-25T12:21:55.091 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.082+0000 7f5d56ffd640 1 -- 172.21.15.86:0/3870096530 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5d480b86b0 con 0x7f5d6014fbc0 2024-04-25T12:21:55.091 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.082+0000 7f5d56ffd640 1 --2- 172.21.15.86:0/3870096530 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f5d400683b0 0x7f5d4006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:55.091 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.082+0000 7f5d5e59c640 1 --2- 172.21.15.86:0/3870096530 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f5d400683b0 0x7f5d4006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:55.091 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.082+0000 7f5d56ffd640 1 -- 172.21.15.86:0/3870096530 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f5d48121c20 con 0x7f5d6014fbc0 2024-04-25T12:21:55.091 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.082+0000 7f5d5e59c640 1 --2- 172.21.15.86:0/3870096530 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f5d400683b0 0x7f5d4006a870 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5d5000b9d0 tx=0x7f5d50008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:55.093 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.086+0000 7f5d56ffd640 1 -- 172.21.15.86:0/3870096530 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5d48016620 con 0x7f5d6014fbc0 2024-04-25T12:21:55.245 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.238+0000 7f5d64deb640 1 -- 172.21.15.86:0/3870096530 --> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5d600c7df0 con 0x7f5d400683b0 2024-04-25T12:21:55.258 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.250+0000 7f5d56ffd640 1 -- 172.21.15.86:0/3870096530 <== mgr.4107 v2:172.21.15.86:6832/3708662606 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f5d600c7df0 con 0x7f5d400683b0 2024-04-25T12:21:55.262 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:21:55.264 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2024-04-25T12:21:55.266 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.254+0000 7f5d64deb640 1 -- 172.21.15.86:0/3870096530 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f5d400683b0 msgr2=0x7f5d4006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:55.266 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.254+0000 7f5d64deb640 1 --2- 172.21.15.86:0/3870096530 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f5d400683b0 0x7f5d4006a870 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5d5000b9d0 tx=0x7f5d50008040 comp rx=0 tx=0).stop 2024-04-25T12:21:55.266 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.254+0000 7f5d64deb640 1 -- 172.21.15.86:0/3870096530 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d6014fbc0 msgr2=0x7f5d60144010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:55.266 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.254+0000 7f5d64deb640 1 --2- 172.21.15.86:0/3870096530 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d6014fbc0 0x7f5d60144010 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5d480af040 tx=0x7f5d480197d0 comp rx=0 tx=0).stop 2024-04-25T12:21:55.266 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.254+0000 7f5d64deb640 1 -- 172.21.15.86:0/3870096530 shutdown_connections 2024-04-25T12:21:55.266 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.254+0000 7f5d64deb640 1 --2- 172.21.15.86:0/3870096530 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5d6014ffa0 0x7f5d601f58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:55.266 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.254+0000 7f5d64deb640 1 --2- 172.21.15.86:0/3870096530 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f5d400683b0 0x7f5d4006a870 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:55.266 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.254+0000 7f5d64deb640 1 --2- 172.21.15.86:0/3870096530 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d6014fbc0 0x7f5d60144010 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:55.266 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.254+0000 7f5d64deb640 1 --2- 172.21.15.86:0/3870096530 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d60074100 0x7f5d60143ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:55.266 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.254+0000 7f5d64deb640 1 -- 172.21.15.86:0/3870096530 >> 172.21.15.86:0/3870096530 conn(0x7f5d6006b9d0 msgr2=0x7f5d6006bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:55.266 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.254+0000 7f5d64deb640 1 -- 172.21.15.86:0/3870096530 shutdown_connections 2024-04-25T12:21:55.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.254+0000 7f5d64deb640 1 -- 172.21.15.86:0/3870096530 wait complete. 2024-04-25T12:21:55.278 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2024-04-25T12:21:53.806953+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219400,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755320,"statfs":{"total":773094113280,"available":772869447680,"internally_reserved":0,"allocated":3284992,"data_stored":1992064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004373"},"pg_stats":[{"pgid":"2.1f","version":"23'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547440+0000","last_change":"2024-04-25T12:21:23.124053+0000","last_active":"2024-04-25T12:21:29.547440+0000","last_peered":"2024-04-25T12:21:29.547440+0000","last_clean":"2024-04-25T12:21:29.547440+0000","last_became_active":"2024-04-25T12:21:23.123863+0000","last_became_peered":"2024-04-25T12:21:23.123863+0000","last_unstale":"2024-04-25T12:21:29.547440+0000","last_undegraded":"2024-04-25T12:21:29.547440+0000","last_fullsized":"2024-04-25T12:21:29.547440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:52:10.500619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.286029+0000","last_change":"2024-04-25T12:21:24.141874+0000","last_active":"2024-04-25T12:21:29.286029+0000","last_peered":"2024-04-25T12:21:29.286029+0000","last_clean":"2024-04-25T12:21:29.286029+0000","last_became_active":"2024-04-25T12:21:24.141482+0000","last_became_peered":"2024-04-25T12:21:24.141482+0000","last_unstale":"2024-04-25T12:21:29.286029+0000","last_undegraded":"2024-04-25T12:21:29.286029+0000","last_fullsized":"2024-04-25T12:21:29.286029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:45.364004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.284811+0000","last_change":"2024-04-25T12:21:28.377921+0000","last_active":"2024-04-25T12:21:29.284811+0000","last_peered":"2024-04-25T12:21:29.284811+0000","last_clean":"2024-04-25T12:21:29.284811+0000","last_became_active":"2024-04-25T12:21:28.376966+0000","last_became_peered":"2024-04-25T12:21:28.376966+0000","last_unstale":"2024-04-25T12:21:29.284811+0000","last_undegraded":"2024-04-25T12:21:29.284811+0000","last_fullsized":"2024-04-25T12:21:29.284811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:50:43.460694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.286467+0000","last_change":"2024-04-25T12:21:23.113889+0000","last_active":"2024-04-25T12:21:29.286467+0000","last_peered":"2024-04-25T12:21:29.286467+0000","last_clean":"2024-04-25T12:21:29.286467+0000","last_became_active":"2024-04-25T12:21:23.113605+0000","last_became_peered":"2024-04-25T12:21:23.113605+0000","last_unstale":"2024-04-25T12:21:29.286467+0000","last_undegraded":"2024-04-25T12:21:29.286467+0000","last_fullsized":"2024-04-25T12:21:29.286467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:01.082322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547299+0000","last_change":"2024-04-25T12:21:24.115472+0000","last_active":"2024-04-25T12:21:29.547299+0000","last_peered":"2024-04-25T12:21:29.547299+0000","last_clean":"2024-04-25T12:21:29.547299+0000","last_became_active":"2024-04-25T12:21:24.114671+0000","last_became_peered":"2024-04-25T12:21:24.114671+0000","last_unstale":"2024-04-25T12:21:29.547299+0000","last_undegraded":"2024-04-25T12:21:29.547299+0000","last_fullsized":"2024-04-25T12:21:29.547299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:01:31.853992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.165775+0000","last_change":"2024-04-25T12:21:28.205320+0000","last_active":"2024-04-25T12:21:29.165775+0000","last_peered":"2024-04-25T12:21:29.165775+0000","last_clean":"2024-04-25T12:21:29.165775+0000","last_became_active":"2024-04-25T12:21:28.204404+0000","last_became_peered":"2024-04-25T12:21:28.204404+0000","last_unstale":"2024-04-25T12:21:29.165775+0000","last_undegraded":"2024-04-25T12:21:29.165775+0000","last_fullsized":"2024-04-25T12:21:29.165775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:03:17.730928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.549885+0000","last_change":"2024-04-25T12:21:23.132332+0000","last_active":"2024-04-25T12:21:29.549885+0000","last_peered":"2024-04-25T12:21:29.549885+0000","last_clean":"2024-04-25T12:21:29.549885+0000","last_became_active":"2024-04-25T12:21:23.131566+0000","last_became_peered":"2024-04-25T12:21:23.131566+0000","last_unstale":"2024-04-25T12:21:29.549885+0000","last_undegraded":"2024-04-25T12:21:29.549885+0000","last_fullsized":"2024-04-25T12:21:29.549885+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:02.429838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.168229+0000","last_change":"2024-04-25T12:21:24.128824+0000","last_active":"2024-04-25T12:21:29.168229+0000","last_peered":"2024-04-25T12:21:29.168229+0000","last_clean":"2024-04-25T12:21:29.168229+0000","last_became_active":"2024-04-25T12:21:24.128027+0000","last_became_peered":"2024-04-25T12:21:24.128027+0000","last_unstale":"2024-04-25T12:21:29.168229+0000","last_undegraded":"2024-04-25T12:21:29.168229+0000","last_fullsized":"2024-04-25T12:21:29.168229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:57:44.137044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.167257+0000","last_change":"2024-04-25T12:21:28.202389+0000","last_active":"2024-04-25T12:21:29.167257+0000","last_peered":"2024-04-25T12:21:29.167257+0000","last_clean":"2024-04-25T12:21:29.167257+0000","last_became_active":"2024-04-25T12:21:28.201228+0000","last_became_peered":"2024-04-25T12:21:28.201228+0000","last_unstale":"2024-04-25T12:21:29.167257+0000","last_undegraded":"2024-04-25T12:21:29.167257+0000","last_fullsized":"2024-04-25T12:21:29.167257+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:45:30.365480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.549318+0000","last_change":"2024-04-25T12:21:23.128355+0000","last_active":"2024-04-25T12:21:29.549318+0000","last_peered":"2024-04-25T12:21:29.549318+0000","last_clean":"2024-04-25T12:21:29.549318+0000","last_became_active":"2024-04-25T12:21:23.127717+0000","last_became_peered":"2024-04-25T12:21:23.127717+0000","last_unstale":"2024-04-25T12:21:29.549318+0000","last_undegraded":"2024-04-25T12:21:29.549318+0000","last_fullsized":"2024-04-25T12:21:29.549318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:26.319715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.168925+0000","last_change":"2024-04-25T12:21:24.122098+0000","last_active":"2024-04-25T12:21:29.168925+0000","last_peered":"2024-04-25T12:21:29.168925+0000","last_clean":"2024-04-25T12:21:29.168925+0000","last_became_active":"2024-04-25T12:21:24.121392+0000","last_became_peered":"2024-04-25T12:21:24.121392+0000","last_unstale":"2024-04-25T12:21:29.168925+0000","last_undegraded":"2024-04-25T12:21:29.168925+0000","last_fullsized":"2024-04-25T12:21:29.168925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:11:35.116222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.167070+0000","last_change":"2024-04-25T12:21:28.189048+0000","last_active":"2024-04-25T12:21:29.167070+0000","last_peered":"2024-04-25T12:21:29.167070+0000","last_clean":"2024-04-25T12:21:29.167070+0000","last_became_active":"2024-04-25T12:21:28.187340+0000","last_became_peered":"2024-04-25T12:21:28.187340+0000","last_unstale":"2024-04-25T12:21:29.167070+0000","last_undegraded":"2024-04-25T12:21:29.167070+0000","last_fullsized":"2024-04-25T12:21:29.167070+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:47:13.797595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.280524+0000","last_change":"2024-04-25T12:21:24.126211+0000","last_active":"2024-04-25T12:21:29.280524+0000","last_peered":"2024-04-25T12:21:29.280524+0000","last_clean":"2024-04-25T12:21:29.280524+0000","last_became_active":"2024-04-25T12:21:24.123695+0000","last_became_peered":"2024-04-25T12:21:24.123695+0000","last_unstale":"2024-04-25T12:21:29.280524+0000","last_undegraded":"2024-04-25T12:21:29.280524+0000","last_fullsized":"2024-04-25T12:21:29.280524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:09:04.327157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.550040+0000","last_change":"2024-04-25T12:21:23.139676+0000","last_active":"2024-04-25T12:21:29.550040+0000","last_peered":"2024-04-25T12:21:29.550040+0000","last_clean":"2024-04-25T12:21:29.550040+0000","last_became_active":"2024-04-25T12:21:23.139025+0000","last_became_peered":"2024-04-25T12:21:23.139025+0000","last_unstale":"2024-04-25T12:21:29.550040+0000","last_undegraded":"2024-04-25T12:21:29.550040+0000","last_fullsized":"2024-04-25T12:21:29.550040+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:43:51.445149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.168869+0000","last_change":"2024-04-25T12:21:28.188852+0000","last_active":"2024-04-25T12:21:29.168869+0000","last_peered":"2024-04-25T12:21:29.168869+0000","last_clean":"2024-04-25T12:21:29.168869+0000","last_became_active":"2024-04-25T12:21:28.187619+0000","last_became_peered":"2024-04-25T12:21:28.187619+0000","last_unstale":"2024-04-25T12:21:29.168869+0000","last_undegraded":"2024-04-25T12:21:29.168869+0000","last_fullsized":"2024-04-25T12:21:29.168869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:12:14.726245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.285527+0000","last_change":"2024-04-25T12:21:24.136925+0000","last_active":"2024-04-25T12:21:29.285527+0000","last_peered":"2024-04-25T12:21:29.285527+0000","last_clean":"2024-04-25T12:21:29.285527+0000","last_became_active":"2024-04-25T12:21:24.136535+0000","last_became_peered":"2024-04-25T12:21:24.136535+0000","last_unstale":"2024-04-25T12:21:29.285527+0000","last_undegraded":"2024-04-25T12:21:29.285527+0000","last_fullsized":"2024-04-25T12:21:29.285527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:28:23.965010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547294+0000","last_change":"2024-04-25T12:21:23.105571+0000","last_active":"2024-04-25T12:21:29.547294+0000","last_peered":"2024-04-25T12:21:29.547294+0000","last_clean":"2024-04-25T12:21:29.547294+0000","last_became_active":"2024-04-25T12:21:23.105051+0000","last_became_peered":"2024-04-25T12:21:23.105051+0000","last_unstale":"2024-04-25T12:21:29.547294+0000","last_undegraded":"2024-04-25T12:21:29.547294+0000","last_fullsized":"2024-04-25T12:21:29.547294+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:52:40.783100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.167305+0000","last_change":"2024-04-25T12:21:28.202632+0000","last_active":"2024-04-25T12:21:29.167305+0000","last_peered":"2024-04-25T12:21:29.167305+0000","last_clean":"2024-04-25T12:21:29.167305+0000","last_became_active":"2024-04-25T12:21:28.201389+0000","last_became_peered":"2024-04-25T12:21:28.201389+0000","last_unstale":"2024-04-25T12:21:29.167305+0000","last_undegraded":"2024-04-25T12:21:29.167305+0000","last_fullsized":"2024-04-25T12:21:29.167305+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:48:58.246610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.285297+0000","last_change":"2024-04-25T12:21:24.138749+0000","last_active":"2024-04-25T12:21:29.285297+0000","last_peered":"2024-04-25T12:21:29.285297+0000","last_clean":"2024-04-25T12:21:29.285297+0000","last_became_active":"2024-04-25T12:21:24.138446+0000","last_became_peered":"2024-04-25T12:21:24.138446+0000","last_unstale":"2024-04-25T12:21:29.285297+0000","last_undegraded":"2024-04-25T12:21:29.285297+0000","last_fullsized":"2024-04-25T12:21:29.285297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:22:03.856237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.546669+0000","last_change":"2024-04-25T12:21:23.126871+0000","last_active":"2024-04-25T12:21:29.546669+0000","last_peered":"2024-04-25T12:21:29.546669+0000","last_clean":"2024-04-25T12:21:29.546669+0000","last_became_active":"2024-04-25T12:21:23.126521+0000","last_became_peered":"2024-04-25T12:21:23.126521+0000","last_unstale":"2024-04-25T12:21:29.546669+0000","last_undegraded":"2024-04-25T12:21:29.546669+0000","last_fullsized":"2024-04-25T12:21:29.546669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:12:31.353951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.548028+0000","last_change":"2024-04-25T12:21:28.383996+0000","last_active":"2024-04-25T12:21:29.548028+0000","last_peered":"2024-04-25T12:21:29.548028+0000","last_clean":"2024-04-25T12:21:29.548028+0000","last_became_active":"2024-04-25T12:21:28.383568+0000","last_became_peered":"2024-04-25T12:21:28.383568+0000","last_unstale":"2024-04-25T12:21:29.548028+0000","last_undegraded":"2024-04-25T12:21:29.548028+0000","last_fullsized":"2024-04-25T12:21:29.548028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:19:41.564694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.167030+0000","last_change":"2024-04-25T12:21:24.125112+0000","last_active":"2024-04-25T12:21:29.167030+0000","last_peered":"2024-04-25T12:21:29.167030+0000","last_clean":"2024-04-25T12:21:29.167030+0000","last_became_active":"2024-04-25T12:21:24.121963+0000","last_became_peered":"2024-04-25T12:21:24.121963+0000","last_unstale":"2024-04-25T12:21:29.167030+0000","last_undegraded":"2024-04-25T12:21:29.167030+0000","last_fullsized":"2024-04-25T12:21:29.167030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:33:14.123119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.548711+0000","last_change":"2024-04-25T12:21:23.117114+0000","last_active":"2024-04-25T12:21:29.548711+0000","last_peered":"2024-04-25T12:21:29.548711+0000","last_clean":"2024-04-25T12:21:29.548711+0000","last_became_active":"2024-04-25T12:21:23.115571+0000","last_became_peered":"2024-04-25T12:21:23.115571+0000","last_unstale":"2024-04-25T12:21:29.548711+0000","last_undegraded":"2024-04-25T12:21:29.548711+0000","last_fullsized":"2024-04-25T12:21:29.548711+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:47.838299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.168694+0000","last_change":"2024-04-25T12:21:28.202374+0000","last_active":"2024-04-25T12:21:29.168694+0000","last_peered":"2024-04-25T12:21:29.168694+0000","last_clean":"2024-04-25T12:21:29.168694+0000","last_became_active":"2024-04-25T12:21:28.201297+0000","last_became_peered":"2024-04-25T12:21:28.201297+0000","last_unstale":"2024-04-25T12:21:29.168694+0000","last_undegraded":"2024-04-25T12:21:29.168694+0000","last_fullsized":"2024-04-25T12:21:29.168694+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:13.461169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547865+0000","last_change":"2024-04-25T12:21:24.133827+0000","last_active":"2024-04-25T12:21:29.547865+0000","last_peered":"2024-04-25T12:21:29.547865+0000","last_clean":"2024-04-25T12:21:29.547865+0000","last_became_active":"2024-04-25T12:21:24.132703+0000","last_became_peered":"2024-04-25T12:21:24.132703+0000","last_unstale":"2024-04-25T12:21:29.547865+0000","last_undegraded":"2024-04-25T12:21:29.547865+0000","last_fullsized":"2024-04-25T12:21:29.547865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:06:22.849827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.282189+0000","last_change":"2024-04-25T12:21:23.132331+0000","last_active":"2024-04-25T12:21:29.282189+0000","last_peered":"2024-04-25T12:21:29.282189+0000","last_clean":"2024-04-25T12:21:29.282189+0000","last_became_active":"2024-04-25T12:21:23.131628+0000","last_became_peered":"2024-04-25T12:21:23.131628+0000","last_unstale":"2024-04-25T12:21:29.282189+0000","last_undegraded":"2024-04-25T12:21:29.282189+0000","last_fullsized":"2024-04-25T12:21:29.282189+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:19:13.372172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.166531+0000","last_change":"2024-04-25T12:21:28.377407+0000","last_active":"2024-04-25T12:21:29.166531+0000","last_peered":"2024-04-25T12:21:29.166531+0000","last_clean":"2024-04-25T12:21:29.166531+0000","last_became_active":"2024-04-25T12:21:28.376224+0000","last_became_peered":"2024-04-25T12:21:28.376224+0000","last_unstale":"2024-04-25T12:21:29.166531+0000","last_undegraded":"2024-04-25T12:21:29.166531+0000","last_fullsized":"2024-04-25T12:21:29.166531+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:13:02.955979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.286648+0000","last_change":"2024-04-25T12:21:24.145468+0000","last_active":"2024-04-25T12:21:29.286648+0000","last_peered":"2024-04-25T12:21:29.286648+0000","last_clean":"2024-04-25T12:21:29.286648+0000","last_became_active":"2024-04-25T12:21:24.145132+0000","last_became_peered":"2024-04-25T12:21:24.145132+0000","last_unstale":"2024-04-25T12:21:29.286648+0000","last_undegraded":"2024-04-25T12:21:29.286648+0000","last_fullsized":"2024-04-25T12:21:29.286648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:46:44.281270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.548372+0000","last_change":"2024-04-25T12:21:23.131029+0000","last_active":"2024-04-25T12:21:29.548372+0000","last_peered":"2024-04-25T12:21:29.548372+0000","last_clean":"2024-04-25T12:21:29.548372+0000","last_became_active":"2024-04-25T12:21:23.130612+0000","last_became_peered":"2024-04-25T12:21:23.130612+0000","last_unstale":"2024-04-25T12:21:29.548372+0000","last_undegraded":"2024-04-25T12:21:29.548372+0000","last_fullsized":"2024-04-25T12:21:29.548372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:02.146986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.284659+0000","last_change":"2024-04-25T12:21:28.375231+0000","last_active":"2024-04-25T12:21:29.284659+0000","last_peered":"2024-04-25T12:21:29.284659+0000","last_clean":"2024-04-25T12:21:29.284659+0000","last_became_active":"2024-04-25T12:21:28.374813+0000","last_became_peered":"2024-04-25T12:21:28.374813+0000","last_unstale":"2024-04-25T12:21:29.284659+0000","last_undegraded":"2024-04-25T12:21:29.284659+0000","last_fullsized":"2024-04-25T12:21:29.284659+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:16.393582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547074+0000","last_change":"2024-04-25T12:21:24.112280+0000","last_active":"2024-04-25T12:21:29.547074+0000","last_peered":"2024-04-25T12:21:29.547074+0000","last_clean":"2024-04-25T12:21:29.547074+0000","last_became_active":"2024-04-25T12:21:24.111430+0000","last_became_peered":"2024-04-25T12:21:24.111430+0000","last_unstale":"2024-04-25T12:21:29.547074+0000","last_undegraded":"2024-04-25T12:21:29.547074+0000","last_fullsized":"2024-04-25T12:21:29.547074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:58.325720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.550155+0000","last_change":"2024-04-25T12:21:23.124271+0000","last_active":"2024-04-25T12:21:29.550155+0000","last_peered":"2024-04-25T12:21:29.550155+0000","last_clean":"2024-04-25T12:21:29.550155+0000","last_became_active":"2024-04-25T12:21:23.123492+0000","last_became_peered":"2024-04-25T12:21:23.123492+0000","last_unstale":"2024-04-25T12:21:29.550155+0000","last_undegraded":"2024-04-25T12:21:29.550155+0000","last_fullsized":"2024-04-25T12:21:29.550155+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:31:09.080478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.546586+0000","last_change":"2024-04-25T12:21:28.375801+0000","last_active":"2024-04-25T12:21:29.546586+0000","last_peered":"2024-04-25T12:21:29.546586+0000","last_clean":"2024-04-25T12:21:29.546586+0000","last_became_active":"2024-04-25T12:21:28.375119+0000","last_became_peered":"2024-04-25T12:21:28.375119+0000","last_unstale":"2024-04-25T12:21:29.546586+0000","last_undegraded":"2024-04-25T12:21:29.546586+0000","last_fullsized":"2024-04-25T12:21:29.546586+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:00:29.908954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.169044+0000","last_change":"2024-04-25T12:21:24.131673+0000","last_active":"2024-04-25T12:21:29.169044+0000","last_peered":"2024-04-25T12:21:29.169044+0000","last_clean":"2024-04-25T12:21:29.169044+0000","last_became_active":"2024-04-25T12:21:24.130866+0000","last_became_peered":"2024-04-25T12:21:24.130866+0000","last_unstale":"2024-04-25T12:21:29.169044+0000","last_undegraded":"2024-04-25T12:21:29.169044+0000","last_fullsized":"2024-04-25T12:21:29.169044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:09:04.327157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547130+0000","last_change":"2024-04-25T12:21:23.106785+0000","last_active":"2024-04-25T12:21:29.547130+0000","last_peered":"2024-04-25T12:21:29.547130+0000","last_clean":"2024-04-25T12:21:29.547130+0000","last_became_active":"2024-04-25T12:21:23.105809+0000","last_became_peered":"2024-04-25T12:21:23.105809+0000","last_unstale":"2024-04-25T12:21:29.547130+0000","last_undegraded":"2024-04-25T12:21:29.547130+0000","last_fullsized":"2024-04-25T12:21:29.547130+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:17.185116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.546915+0000","last_change":"2024-04-25T12:21:28.193242+0000","last_active":"2024-04-25T12:21:29.546915+0000","last_peered":"2024-04-25T12:21:29.546915+0000","last_clean":"2024-04-25T12:21:29.546915+0000","last_became_active":"2024-04-25T12:21:28.192835+0000","last_became_peered":"2024-04-25T12:21:28.192835+0000","last_unstale":"2024-04-25T12:21:29.546915+0000","last_undegraded":"2024-04-25T12:21:29.546915+0000","last_fullsized":"2024-04-25T12:21:29.546915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:42:52.476024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.167733+0000","last_change":"2024-04-25T12:21:24.128902+0000","last_active":"2024-04-25T12:21:29.167733+0000","last_peered":"2024-04-25T12:21:29.167733+0000","last_clean":"2024-04-25T12:21:29.167733+0000","last_became_active":"2024-04-25T12:21:24.124563+0000","last_became_peered":"2024-04-25T12:21:24.124563+0000","last_unstale":"2024-04-25T12:21:29.167733+0000","last_undegraded":"2024-04-25T12:21:29.167733+0000","last_fullsized":"2024-04-25T12:21:29.167733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:16.937980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.168141+0000","last_change":"2024-04-25T12:21:23.114222+0000","last_active":"2024-04-25T12:21:29.168141+0000","last_peered":"2024-04-25T12:21:29.168141+0000","last_clean":"2024-04-25T12:21:29.168141+0000","last_became_active":"2024-04-25T12:21:23.113504+0000","last_became_peered":"2024-04-25T12:21:23.113504+0000","last_unstale":"2024-04-25T12:21:29.168141+0000","last_undegraded":"2024-04-25T12:21:29.168141+0000","last_fullsized":"2024-04-25T12:21:29.168141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:37:42.382391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547040+0000","last_change":"2024-04-25T12:21:28.200532+0000","last_active":"2024-04-25T12:21:29.547040+0000","last_peered":"2024-04-25T12:21:29.547040+0000","last_clean":"2024-04-25T12:21:29.547040+0000","last_became_active":"2024-04-25T12:21:28.200082+0000","last_became_peered":"2024-04-25T12:21:28.200082+0000","last_unstale":"2024-04-25T12:21:29.547040+0000","last_undegraded":"2024-04-25T12:21:29.547040+0000","last_fullsized":"2024-04-25T12:21:29.547040+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:24.889665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547331+0000","last_change":"2024-04-25T12:21:24.112524+0000","last_active":"2024-04-25T12:21:29.547331+0000","last_peered":"2024-04-25T12:21:29.547331+0000","last_clean":"2024-04-25T12:21:29.547331+0000","last_became_active":"2024-04-25T12:21:24.111503+0000","last_became_peered":"2024-04-25T12:21:24.111503+0000","last_unstale":"2024-04-25T12:21:29.547331+0000","last_undegraded":"2024-04-25T12:21:29.547331+0000","last_fullsized":"2024-04-25T12:21:29.547331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:03:35.982959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.166343+0000","last_change":"2024-04-25T12:21:23.108434+0000","last_active":"2024-04-25T12:21:29.166343+0000","last_peered":"2024-04-25T12:21:29.166343+0000","last_clean":"2024-04-25T12:21:29.166343+0000","last_became_active":"2024-04-25T12:21:23.108051+0000","last_became_peered":"2024-04-25T12:21:23.108051+0000","last_unstale":"2024-04-25T12:21:29.166343+0000","last_undegraded":"2024-04-25T12:21:29.166343+0000","last_fullsized":"2024-04-25T12:21:29.166343+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:49.222950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.548093+0000","last_change":"2024-04-25T12:21:28.189825+0000","last_active":"2024-04-25T12:21:29.548093+0000","last_peered":"2024-04-25T12:21:29.548093+0000","last_clean":"2024-04-25T12:21:29.548093+0000","last_became_active":"2024-04-25T12:21:28.189247+0000","last_became_peered":"2024-04-25T12:21:28.189247+0000","last_unstale":"2024-04-25T12:21:29.548093+0000","last_undegraded":"2024-04-25T12:21:29.548093+0000","last_fullsized":"2024-04-25T12:21:29.548093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:54:02.752212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.546226+0000","last_change":"2024-04-25T12:21:24.105746+0000","last_active":"2024-04-25T12:21:29.546226+0000","last_peered":"2024-04-25T12:21:29.546226+0000","last_clean":"2024-04-25T12:21:29.546226+0000","last_became_active":"2024-04-25T12:21:24.104947+0000","last_became_peered":"2024-04-25T12:21:24.104947+0000","last_unstale":"2024-04-25T12:21:29.546226+0000","last_undegraded":"2024-04-25T12:21:29.546226+0000","last_fullsized":"2024-04-25T12:21:29.546226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:46:14.853789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.548699+0000","last_change":"2024-04-25T12:21:23.114591+0000","last_active":"2024-04-25T12:21:29.548699+0000","last_peered":"2024-04-25T12:21:29.548699+0000","last_clean":"2024-04-25T12:21:29.548699+0000","last_became_active":"2024-04-25T12:21:23.113829+0000","last_became_peered":"2024-04-25T12:21:23.113829+0000","last_unstale":"2024-04-25T12:21:29.548699+0000","last_undegraded":"2024-04-25T12:21:29.548699+0000","last_fullsized":"2024-04-25T12:21:29.548699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:51:38.471436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547750+0000","last_change":"2024-04-25T12:21:28.378024+0000","last_active":"2024-04-25T12:21:29.547750+0000","last_peered":"2024-04-25T12:21:29.547750+0000","last_clean":"2024-04-25T12:21:29.547750+0000","last_became_active":"2024-04-25T12:21:28.377639+0000","last_became_peered":"2024-04-25T12:21:28.377639+0000","last_unstale":"2024-04-25T12:21:29.547750+0000","last_undegraded":"2024-04-25T12:21:29.547750+0000","last_fullsized":"2024-04-25T12:21:29.547750+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:18:40.723659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.285268+0000","last_change":"2024-04-25T12:21:24.120719+0000","last_active":"2024-04-25T12:21:29.285268+0000","last_peered":"2024-04-25T12:21:29.285268+0000","last_clean":"2024-04-25T12:21:29.285268+0000","last_became_active":"2024-04-25T12:21:24.119870+0000","last_became_peered":"2024-04-25T12:21:24.119870+0000","last_unstale":"2024-04-25T12:21:29.285268+0000","last_undegraded":"2024-04-25T12:21:29.285268+0000","last_fullsized":"2024-04-25T12:21:29.285268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:53:15.175473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.168316+0000","last_change":"2024-04-25T12:21:23.103524+0000","last_active":"2024-04-25T12:21:29.168316+0000","last_peered":"2024-04-25T12:21:29.168316+0000","last_clean":"2024-04-25T12:21:29.168316+0000","last_became_active":"2024-04-25T12:21:23.102790+0000","last_became_peered":"2024-04-25T12:21:23.102790+0000","last_unstale":"2024-04-25T12:21:29.168316+0000","last_undegraded":"2024-04-25T12:21:29.168316+0000","last_fullsized":"2024-04-25T12:21:29.168316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:15:54.796303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.549016+0000","last_change":"2024-04-25T12:21:13.081186+0000","last_active":"2024-04-25T12:21:29.549016+0000","last_peered":"2024-04-25T12:21:29.549016+0000","last_clean":"2024-04-25T12:21:29.549016+0000","last_became_active":"2024-04-25T12:21:13.076753+0000","last_became_peered":"2024-04-25T12:21:13.076753+0000","last_unstale":"2024-04-25T12:21:29.549016+0000","last_undegraded":"2024-04-25T12:21:29.549016+0000","last_fullsized":"2024-04-25T12:21:29.549016+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:12.013694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:12.013694+0000","last_clean_scrub_stamp":"2024-04-25T12:21:12.013694+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:18:03.288120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.281646+0000","last_change":"2024-04-25T12:21:28.379372+0000","last_active":"2024-04-25T12:21:29.281646+0000","last_peered":"2024-04-25T12:21:29.281646+0000","last_clean":"2024-04-25T12:21:29.281646+0000","last_became_active":"2024-04-25T12:21:28.378522+0000","last_became_peered":"2024-04-25T12:21:28.378522+0000","last_unstale":"2024-04-25T12:21:29.281646+0000","last_undegraded":"2024-04-25T12:21:29.281646+0000","last_fullsized":"2024-04-25T12:21:29.281646+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:54:35.288829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.549343+0000","last_change":"2024-04-25T12:21:24.144632+0000","last_active":"2024-04-25T12:21:29.549343+0000","last_peered":"2024-04-25T12:21:29.549343+0000","last_clean":"2024-04-25T12:21:29.549343+0000","last_became_active":"2024-04-25T12:21:24.142085+0000","last_became_peered":"2024-04-25T12:21:24.142085+0000","last_unstale":"2024-04-25T12:21:29.549343+0000","last_undegraded":"2024-04-25T12:21:29.549343+0000","last_fullsized":"2024-04-25T12:21:29.549343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:16:55.634329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.166743+0000","last_change":"2024-04-25T12:21:23.126527+0000","last_active":"2024-04-25T12:21:29.166743+0000","last_peered":"2024-04-25T12:21:29.166743+0000","last_clean":"2024-04-25T12:21:29.166743+0000","last_became_active":"2024-04-25T12:21:23.126103+0000","last_became_peered":"2024-04-25T12:21:23.126103+0000","last_unstale":"2024-04-25T12:21:29.166743+0000","last_undegraded":"2024-04-25T12:21:29.166743+0000","last_fullsized":"2024-04-25T12:21:29.166743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:16:36.502824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.280872+0000","last_change":"2024-04-25T12:21:28.379480+0000","last_active":"2024-04-25T12:21:29.280872+0000","last_peered":"2024-04-25T12:21:29.280872+0000","last_clean":"2024-04-25T12:21:29.280872+0000","last_became_active":"2024-04-25T12:21:28.378559+0000","last_became_peered":"2024-04-25T12:21:28.378559+0000","last_unstale":"2024-04-25T12:21:29.280872+0000","last_undegraded":"2024-04-25T12:21:29.280872+0000","last_fullsized":"2024-04-25T12:21:29.280872+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:40.975592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.168315+0000","last_change":"2024-04-25T12:21:24.129518+0000","last_active":"2024-04-25T12:21:29.168315+0000","last_peered":"2024-04-25T12:21:29.168315+0000","last_clean":"2024-04-25T12:21:29.168315+0000","last_became_active":"2024-04-25T12:21:24.126968+0000","last_became_peered":"2024-04-25T12:21:24.126968+0000","last_unstale":"2024-04-25T12:21:29.168315+0000","last_undegraded":"2024-04-25T12:21:29.168315+0000","last_fullsized":"2024-04-25T12:21:29.168315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:49.243645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547717+0000","last_change":"2024-04-25T12:21:23.116529+0000","last_active":"2024-04-25T12:21:29.547717+0000","last_peered":"2024-04-25T12:21:29.547717+0000","last_clean":"2024-04-25T12:21:29.547717+0000","last_became_active":"2024-04-25T12:21:23.116148+0000","last_became_peered":"2024-04-25T12:21:23.116148+0000","last_unstale":"2024-04-25T12:21:29.547717+0000","last_undegraded":"2024-04-25T12:21:29.547717+0000","last_fullsized":"2024-04-25T12:21:29.547717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:01:45.567238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.546941+0000","last_change":"2024-04-25T12:21:28.194823+0000","last_active":"2024-04-25T12:21:29.546941+0000","last_peered":"2024-04-25T12:21:29.546941+0000","last_clean":"2024-04-25T12:21:29.546941+0000","last_became_active":"2024-04-25T12:21:28.194191+0000","last_became_peered":"2024-04-25T12:21:28.194191+0000","last_unstale":"2024-04-25T12:21:29.546941+0000","last_undegraded":"2024-04-25T12:21:29.546941+0000","last_fullsized":"2024-04-25T12:21:29.546941+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:50:30.454926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.550030+0000","last_change":"2024-04-25T12:21:24.146733+0000","last_active":"2024-04-25T12:21:29.550030+0000","last_peered":"2024-04-25T12:21:29.550030+0000","last_clean":"2024-04-25T12:21:29.550030+0000","last_became_active":"2024-04-25T12:21:24.145807+0000","last_became_peered":"2024-04-25T12:21:24.145807+0000","last_unstale":"2024-04-25T12:21:29.550030+0000","last_undegraded":"2024-04-25T12:21:29.550030+0000","last_fullsized":"2024-04-25T12:21:29.550030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:07:35.092827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.166946+0000","last_change":"2024-04-25T12:21:23.103393+0000","last_active":"2024-04-25T12:21:29.166946+0000","last_peered":"2024-04-25T12:21:29.166946+0000","last_clean":"2024-04-25T12:21:29.166946+0000","last_became_active":"2024-04-25T12:21:23.102997+0000","last_became_peered":"2024-04-25T12:21:23.102997+0000","last_unstale":"2024-04-25T12:21:29.166946+0000","last_undegraded":"2024-04-25T12:21:29.166946+0000","last_fullsized":"2024-04-25T12:21:29.166946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:40:23.054158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.167860+0000","last_change":"2024-04-25T12:21:28.384645+0000","last_active":"2024-04-25T12:21:29.167860+0000","last_peered":"2024-04-25T12:21:29.167860+0000","last_clean":"2024-04-25T12:21:29.167860+0000","last_became_active":"2024-04-25T12:21:28.382953+0000","last_became_peered":"2024-04-25T12:21:28.382953+0000","last_unstale":"2024-04-25T12:21:29.167860+0000","last_undegraded":"2024-04-25T12:21:29.167860+0000","last_fullsized":"2024-04-25T12:21:29.167860+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:40:56.218533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.549409+0000","last_change":"2024-04-25T12:21:24.146557+0000","last_active":"2024-04-25T12:21:29.549409+0000","last_peered":"2024-04-25T12:21:29.549409+0000","last_clean":"2024-04-25T12:21:29.549409+0000","last_became_active":"2024-04-25T12:21:24.146162+0000","last_became_peered":"2024-04-25T12:21:24.146162+0000","last_unstale":"2024-04-25T12:21:29.549409+0000","last_undegraded":"2024-04-25T12:21:29.549409+0000","last_fullsized":"2024-04-25T12:21:29.549409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:09:00.995503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.169245+0000","last_change":"2024-04-25T12:21:23.135467+0000","last_active":"2024-04-25T12:21:29.169245+0000","last_peered":"2024-04-25T12:21:29.169245+0000","last_clean":"2024-04-25T12:21:29.169245+0000","last_became_active":"2024-04-25T12:21:23.134441+0000","last_became_peered":"2024-04-25T12:21:23.134441+0000","last_unstale":"2024-04-25T12:21:29.169245+0000","last_undegraded":"2024-04-25T12:21:29.169245+0000","last_fullsized":"2024-04-25T12:21:29.169245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:44:33.069221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.165946+0000","last_change":"2024-04-25T12:21:28.202610+0000","last_active":"2024-04-25T12:21:29.165946+0000","last_peered":"2024-04-25T12:21:29.165946+0000","last_clean":"2024-04-25T12:21:29.165946+0000","last_became_active":"2024-04-25T12:21:28.201479+0000","last_became_peered":"2024-04-25T12:21:28.201479+0000","last_unstale":"2024-04-25T12:21:29.165946+0000","last_undegraded":"2024-04-25T12:21:29.165946+0000","last_fullsized":"2024-04-25T12:21:29.165946+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:25:15.458202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.548957+0000","last_change":"2024-04-25T12:21:24.145131+0000","last_active":"2024-04-25T12:21:29.548957+0000","last_peered":"2024-04-25T12:21:29.548957+0000","last_clean":"2024-04-25T12:21:29.548957+0000","last_became_active":"2024-04-25T12:21:24.142422+0000","last_became_peered":"2024-04-25T12:21:24.142422+0000","last_unstale":"2024-04-25T12:21:29.548957+0000","last_undegraded":"2024-04-25T12:21:29.548957+0000","last_fullsized":"2024-04-25T12:21:29.548957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:40:24.312543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.166123+0000","last_change":"2024-04-25T12:21:23.104288+0000","last_active":"2024-04-25T12:21:29.166123+0000","last_peered":"2024-04-25T12:21:29.166123+0000","last_clean":"2024-04-25T12:21:29.166123+0000","last_became_active":"2024-04-25T12:21:23.103680+0000","last_became_peered":"2024-04-25T12:21:23.103680+0000","last_unstale":"2024-04-25T12:21:29.166123+0000","last_undegraded":"2024-04-25T12:21:29.166123+0000","last_fullsized":"2024-04-25T12:21:29.166123+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:29.672890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547646+0000","last_change":"2024-04-25T12:21:28.199834+0000","last_active":"2024-04-25T12:21:29.547646+0000","last_peered":"2024-04-25T12:21:29.547646+0000","last_clean":"2024-04-25T12:21:29.547646+0000","last_became_active":"2024-04-25T12:21:28.199411+0000","last_became_peered":"2024-04-25T12:21:28.199411+0000","last_unstale":"2024-04-25T12:21:29.547646+0000","last_undegraded":"2024-04-25T12:21:29.547646+0000","last_fullsized":"2024-04-25T12:21:29.547646+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:52:34.443813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.280647+0000","last_change":"2024-04-25T12:21:24.127488+0000","last_active":"2024-04-25T12:21:29.280647+0000","last_peered":"2024-04-25T12:21:29.280647+0000","last_clean":"2024-04-25T12:21:29.280647+0000","last_became_active":"2024-04-25T12:21:24.126721+0000","last_became_peered":"2024-04-25T12:21:24.126721+0000","last_unstale":"2024-04-25T12:21:29.280647+0000","last_undegraded":"2024-04-25T12:21:29.280647+0000","last_fullsized":"2024-04-25T12:21:29.280647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:02.153025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.280911+0000","last_change":"2024-04-25T12:21:23.139626+0000","last_active":"2024-04-25T12:21:29.280911+0000","last_peered":"2024-04-25T12:21:29.280911+0000","last_clean":"2024-04-25T12:21:29.280911+0000","last_became_active":"2024-04-25T12:21:23.138837+0000","last_became_peered":"2024-04-25T12:21:23.138837+0000","last_unstale":"2024-04-25T12:21:29.280911+0000","last_undegraded":"2024-04-25T12:21:29.280911+0000","last_fullsized":"2024-04-25T12:21:29.280911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:09.309384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.286588+0000","last_change":"2024-04-25T12:21:28.383919+0000","last_active":"2024-04-25T12:21:29.286588+0000","last_peered":"2024-04-25T12:21:29.286588+0000","last_clean":"2024-04-25T12:21:29.286588+0000","last_became_active":"2024-04-25T12:21:28.383298+0000","last_became_peered":"2024-04-25T12:21:28.383298+0000","last_unstale":"2024-04-25T12:21:29.286588+0000","last_undegraded":"2024-04-25T12:21:29.286588+0000","last_fullsized":"2024-04-25T12:21:29.286588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:01.115040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.549858+0000","last_change":"2024-04-25T12:21:24.146454+0000","last_active":"2024-04-25T12:21:29.549858+0000","last_peered":"2024-04-25T12:21:29.549858+0000","last_clean":"2024-04-25T12:21:29.549858+0000","last_became_active":"2024-04-25T12:21:24.145931+0000","last_became_peered":"2024-04-25T12:21:24.145931+0000","last_unstale":"2024-04-25T12:21:29.549858+0000","last_undegraded":"2024-04-25T12:21:29.549858+0000","last_fullsized":"2024-04-25T12:21:29.549858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:35:22.490243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.168054+0000","last_change":"2024-04-25T12:21:23.122495+0000","last_active":"2024-04-25T12:21:29.168054+0000","last_peered":"2024-04-25T12:21:29.168054+0000","last_clean":"2024-04-25T12:21:29.168054+0000","last_became_active":"2024-04-25T12:21:23.121429+0000","last_became_peered":"2024-04-25T12:21:23.121429+0000","last_unstale":"2024-04-25T12:21:29.168054+0000","last_undegraded":"2024-04-25T12:21:29.168054+0000","last_fullsized":"2024-04-25T12:21:29.168054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:10.530248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.285955+0000","last_change":"2024-04-25T12:21:28.375971+0000","last_active":"2024-04-25T12:21:29.285955+0000","last_peered":"2024-04-25T12:21:29.285955+0000","last_clean":"2024-04-25T12:21:29.285955+0000","last_became_active":"2024-04-25T12:21:28.375013+0000","last_became_peered":"2024-04-25T12:21:28.375013+0000","last_unstale":"2024-04-25T12:21:29.285955+0000","last_undegraded":"2024-04-25T12:21:29.285955+0000","last_fullsized":"2024-04-25T12:21:29.285955+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:56:45.398763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.546876+0000","last_change":"2024-04-25T12:21:24.138293+0000","last_active":"2024-04-25T12:21:29.546876+0000","last_peered":"2024-04-25T12:21:29.546876+0000","last_clean":"2024-04-25T12:21:29.546876+0000","last_became_active":"2024-04-25T12:21:24.138016+0000","last_became_peered":"2024-04-25T12:21:24.138016+0000","last_unstale":"2024-04-25T12:21:29.546876+0000","last_undegraded":"2024-04-25T12:21:29.546876+0000","last_fullsized":"2024-04-25T12:21:29.546876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:48:54.078239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547256+0000","last_change":"2024-04-25T12:21:23.136227+0000","last_active":"2024-04-25T12:21:29.547256+0000","last_peered":"2024-04-25T12:21:29.547256+0000","last_clean":"2024-04-25T12:21:29.547256+0000","last_became_active":"2024-04-25T12:21:23.135947+0000","last_became_peered":"2024-04-25T12:21:23.135947+0000","last_unstale":"2024-04-25T12:21:29.547256+0000","last_undegraded":"2024-04-25T12:21:29.547256+0000","last_fullsized":"2024-04-25T12:21:29.547256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:41:24.323924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.168847+0000","last_change":"2024-04-25T12:21:28.378564+0000","last_active":"2024-04-25T12:21:29.168847+0000","last_peered":"2024-04-25T12:21:29.168847+0000","last_clean":"2024-04-25T12:21:29.168847+0000","last_became_active":"2024-04-25T12:21:28.377532+0000","last_became_peered":"2024-04-25T12:21:28.377532+0000","last_unstale":"2024-04-25T12:21:29.168847+0000","last_undegraded":"2024-04-25T12:21:29.168847+0000","last_fullsized":"2024-04-25T12:21:29.168847+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:20.576562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.549070+0000","last_change":"2024-04-25T12:21:24.148665+0000","last_active":"2024-04-25T12:21:29.549070+0000","last_peered":"2024-04-25T12:21:29.549070+0000","last_clean":"2024-04-25T12:21:29.549070+0000","last_became_active":"2024-04-25T12:21:24.142505+0000","last_became_peered":"2024-04-25T12:21:24.142505+0000","last_unstale":"2024-04-25T12:21:29.549070+0000","last_undegraded":"2024-04-25T12:21:29.549070+0000","last_fullsized":"2024-04-25T12:21:29.549070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:19:44.014834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:38.438513+0000","last_change":"2024-04-25T12:21:23.130231+0000","last_active":"2024-04-25T12:21:38.438513+0000","last_peered":"2024-04-25T12:21:38.438513+0000","last_clean":"2024-04-25T12:21:38.438513+0000","last_became_active":"2024-04-25T12:21:23.129474+0000","last_became_peered":"2024-04-25T12:21:23.129474+0000","last_unstale":"2024-04-25T12:21:38.438513+0000","last_undegraded":"2024-04-25T12:21:38.438513+0000","last_fullsized":"2024-04-25T12:21:38.438513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:50.974387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547082+0000","last_change":"2024-04-25T12:21:28.200551+0000","last_active":"2024-04-25T12:21:29.547082+0000","last_peered":"2024-04-25T12:21:29.547082+0000","last_clean":"2024-04-25T12:21:29.547082+0000","last_became_active":"2024-04-25T12:21:28.200152+0000","last_became_peered":"2024-04-25T12:21:28.200152+0000","last_unstale":"2024-04-25T12:21:29.547082+0000","last_undegraded":"2024-04-25T12:21:29.547082+0000","last_fullsized":"2024-04-25T12:21:29.547082+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:17:34.847925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.167585+0000","last_change":"2024-04-25T12:21:24.142957+0000","last_active":"2024-04-25T12:21:29.167585+0000","last_peered":"2024-04-25T12:21:29.167585+0000","last_clean":"2024-04-25T12:21:29.167585+0000","last_became_active":"2024-04-25T12:21:24.142594+0000","last_became_peered":"2024-04-25T12:21:24.142594+0000","last_unstale":"2024-04-25T12:21:29.167585+0000","last_undegraded":"2024-04-25T12:21:29.167585+0000","last_fullsized":"2024-04-25T12:21:29.167585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:36:47.719946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547660+0000","last_change":"2024-04-25T12:21:23.125118+0000","last_active":"2024-04-25T12:21:29.547660+0000","last_peered":"2024-04-25T12:21:29.547660+0000","last_clean":"2024-04-25T12:21:29.547660+0000","last_became_active":"2024-04-25T12:21:23.124836+0000","last_became_peered":"2024-04-25T12:21:23.124836+0000","last_unstale":"2024-04-25T12:21:29.547660+0000","last_undegraded":"2024-04-25T12:21:29.547660+0000","last_fullsized":"2024-04-25T12:21:29.547660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:03:28.500940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.167503+0000","last_change":"2024-04-25T12:21:28.194476+0000","last_active":"2024-04-25T12:21:29.167503+0000","last_peered":"2024-04-25T12:21:29.167503+0000","last_clean":"2024-04-25T12:21:29.167503+0000","last_became_active":"2024-04-25T12:21:28.193277+0000","last_became_peered":"2024-04-25T12:21:28.193277+0000","last_unstale":"2024-04-25T12:21:29.167503+0000","last_undegraded":"2024-04-25T12:21:29.167503+0000","last_fullsized":"2024-04-25T12:21:29.167503+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:31.495441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547391+0000","last_change":"2024-04-25T12:21:24.115104+0000","last_active":"2024-04-25T12:21:29.547391+0000","last_peered":"2024-04-25T12:21:29.547391+0000","last_clean":"2024-04-25T12:21:29.547391+0000","last_became_active":"2024-04-25T12:21:24.114367+0000","last_became_peered":"2024-04-25T12:21:24.114367+0000","last_unstale":"2024-04-25T12:21:29.547391+0000","last_undegraded":"2024-04-25T12:21:29.547391+0000","last_fullsized":"2024-04-25T12:21:29.547391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:03.107076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.168564+0000","last_change":"2024-04-25T12:21:23.132996+0000","last_active":"2024-04-25T12:21:29.168564+0000","last_peered":"2024-04-25T12:21:29.168564+0000","last_clean":"2024-04-25T12:21:29.168564+0000","last_became_active":"2024-04-25T12:21:23.132223+0000","last_became_peered":"2024-04-25T12:21:23.132223+0000","last_unstale":"2024-04-25T12:21:29.168564+0000","last_undegraded":"2024-04-25T12:21:29.168564+0000","last_fullsized":"2024-04-25T12:21:29.168564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:18.689461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.285114+0000","last_change":"2024-04-25T12:21:28.203302+0000","last_active":"2024-04-25T12:21:29.285114+0000","last_peered":"2024-04-25T12:21:29.285114+0000","last_clean":"2024-04-25T12:21:29.285114+0000","last_became_active":"2024-04-25T12:21:28.202800+0000","last_became_peered":"2024-04-25T12:21:28.202800+0000","last_unstale":"2024-04-25T12:21:29.285114+0000","last_undegraded":"2024-04-25T12:21:29.285114+0000","last_fullsized":"2024-04-25T12:21:29.285114+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:27:16.676736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.169161+0000","last_change":"2024-04-25T12:21:24.142716+0000","last_active":"2024-04-25T12:21:29.169161+0000","last_peered":"2024-04-25T12:21:29.169161+0000","last_clean":"2024-04-25T12:21:29.169161+0000","last_became_active":"2024-04-25T12:21:24.142363+0000","last_became_peered":"2024-04-25T12:21:24.142363+0000","last_unstale":"2024-04-25T12:21:29.169161+0000","last_undegraded":"2024-04-25T12:21:29.169161+0000","last_fullsized":"2024-04-25T12:21:29.169161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:02.153025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.281923+0000","last_change":"2024-04-25T12:21:23.130843+0000","last_active":"2024-04-25T12:21:29.281923+0000","last_peered":"2024-04-25T12:21:29.281923+0000","last_clean":"2024-04-25T12:21:29.281923+0000","last_became_active":"2024-04-25T12:21:23.129967+0000","last_became_peered":"2024-04-25T12:21:23.129967+0000","last_unstale":"2024-04-25T12:21:29.281923+0000","last_undegraded":"2024-04-25T12:21:29.281923+0000","last_fullsized":"2024-04-25T12:21:29.281923+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:19:22.719364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.285047+0000","last_change":"2024-04-25T12:21:28.384082+0000","last_active":"2024-04-25T12:21:29.285047+0000","last_peered":"2024-04-25T12:21:29.285047+0000","last_clean":"2024-04-25T12:21:29.285047+0000","last_became_active":"2024-04-25T12:21:28.383228+0000","last_became_peered":"2024-04-25T12:21:28.383228+0000","last_unstale":"2024-04-25T12:21:29.285047+0000","last_undegraded":"2024-04-25T12:21:29.285047+0000","last_fullsized":"2024-04-25T12:21:29.285047+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:14.600341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547535+0000","last_change":"2024-04-25T12:21:28.378352+0000","last_active":"2024-04-25T12:21:29.547535+0000","last_peered":"2024-04-25T12:21:29.547535+0000","last_clean":"2024-04-25T12:21:29.547535+0000","last_became_active":"2024-04-25T12:21:28.377742+0000","last_became_peered":"2024-04-25T12:21:28.377742+0000","last_unstale":"2024-04-25T12:21:29.547535+0000","last_undegraded":"2024-04-25T12:21:29.547535+0000","last_fullsized":"2024-04-25T12:21:29.547535+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:20.075296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.546465+0000","last_change":"2024-04-25T12:21:24.126158+0000","last_active":"2024-04-25T12:21:29.546465+0000","last_peered":"2024-04-25T12:21:29.546465+0000","last_clean":"2024-04-25T12:21:29.546465+0000","last_became_active":"2024-04-25T12:21:24.125448+0000","last_became_peered":"2024-04-25T12:21:24.125448+0000","last_unstale":"2024-04-25T12:21:29.546465+0000","last_undegraded":"2024-04-25T12:21:29.546465+0000","last_fullsized":"2024-04-25T12:21:29.546465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:42.769206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.168026+0000","last_change":"2024-04-25T12:21:23.117159+0000","last_active":"2024-04-25T12:21:29.168026+0000","last_peered":"2024-04-25T12:21:29.168026+0000","last_clean":"2024-04-25T12:21:29.168026+0000","last_became_active":"2024-04-25T12:21:23.115911+0000","last_became_peered":"2024-04-25T12:21:23.115911+0000","last_unstale":"2024-04-25T12:21:29.168026+0000","last_undegraded":"2024-04-25T12:21:29.168026+0000","last_fullsized":"2024-04-25T12:21:29.168026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:46:10.238958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.281751+0000","last_change":"2024-04-25T12:21:28.205952+0000","last_active":"2024-04-25T12:21:29.281751+0000","last_peered":"2024-04-25T12:21:29.281751+0000","last_clean":"2024-04-25T12:21:29.281751+0000","last_became_active":"2024-04-25T12:21:28.204472+0000","last_became_peered":"2024-04-25T12:21:28.204472+0000","last_unstale":"2024-04-25T12:21:29.281751+0000","last_undegraded":"2024-04-25T12:21:29.281751+0000","last_fullsized":"2024-04-25T12:21:29.281751+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:16:03.460343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.285501+0000","last_change":"2024-04-25T12:21:24.137477+0000","last_active":"2024-04-25T12:21:29.285501+0000","last_peered":"2024-04-25T12:21:29.285501+0000","last_clean":"2024-04-25T12:21:29.285501+0000","last_became_active":"2024-04-25T12:21:24.137078+0000","last_became_peered":"2024-04-25T12:21:24.137078+0000","last_unstale":"2024-04-25T12:21:29.285501+0000","last_undegraded":"2024-04-25T12:21:29.285501+0000","last_fullsized":"2024-04-25T12:21:29.285501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:53.321239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.285357+0000","last_change":"2024-04-25T12:21:23.130046+0000","last_active":"2024-04-25T12:21:29.285357+0000","last_peered":"2024-04-25T12:21:29.285357+0000","last_clean":"2024-04-25T12:21:29.285357+0000","last_became_active":"2024-04-25T12:21:23.129779+0000","last_became_peered":"2024-04-25T12:21:23.129779+0000","last_unstale":"2024-04-25T12:21:29.285357+0000","last_undegraded":"2024-04-25T12:21:29.285357+0000","last_fullsized":"2024-04-25T12:21:29.285357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:24:43.733780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.281044+0000","last_change":"2024-04-25T12:21:23.138152+0000","last_active":"2024-04-25T12:21:29.281044+0000","last_peered":"2024-04-25T12:21:29.281044+0000","last_clean":"2024-04-25T12:21:29.281044+0000","last_became_active":"2024-04-25T12:21:23.137393+0000","last_became_peered":"2024-04-25T12:21:23.137393+0000","last_unstale":"2024-04-25T12:21:29.281044+0000","last_undegraded":"2024-04-25T12:21:29.281044+0000","last_fullsized":"2024-04-25T12:21:29.281044+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:10:42.713304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547129+0000","last_change":"2024-04-25T12:21:24.122299+0000","last_active":"2024-04-25T12:21:29.547129+0000","last_peered":"2024-04-25T12:21:29.547129+0000","last_clean":"2024-04-25T12:21:29.547129+0000","last_became_active":"2024-04-25T12:21:24.121480+0000","last_became_peered":"2024-04-25T12:21:24.121480+0000","last_unstale":"2024-04-25T12:21:29.547129+0000","last_undegraded":"2024-04-25T12:21:29.547129+0000","last_fullsized":"2024-04-25T12:21:29.547129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:05:46.050357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.166540+0000","last_change":"2024-04-25T12:21:28.183735+0000","last_active":"2024-04-25T12:21:29.166540+0000","last_peered":"2024-04-25T12:21:29.166540+0000","last_clean":"2024-04-25T12:21:29.166540+0000","last_became_active":"2024-04-25T12:21:28.183319+0000","last_became_peered":"2024-04-25T12:21:28.183319+0000","last_unstale":"2024-04-25T12:21:29.166540+0000","last_undegraded":"2024-04-25T12:21:29.166540+0000","last_fullsized":"2024-04-25T12:21:29.166540+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:42:14.120075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.285705+0000","last_change":"2024-04-25T12:21:23.113080+0000","last_active":"2024-04-25T12:21:29.285705+0000","last_peered":"2024-04-25T12:21:29.285705+0000","last_clean":"2024-04-25T12:21:29.285705+0000","last_became_active":"2024-04-25T12:21:23.112721+0000","last_became_peered":"2024-04-25T12:21:23.112721+0000","last_unstale":"2024-04-25T12:21:29.285705+0000","last_undegraded":"2024-04-25T12:21:29.285705+0000","last_fullsized":"2024-04-25T12:21:29.285705+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:25.396377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.167162+0000","last_change":"2024-04-25T12:21:24.134267+0000","last_active":"2024-04-25T12:21:29.167162+0000","last_peered":"2024-04-25T12:21:29.167162+0000","last_clean":"2024-04-25T12:21:29.167162+0000","last_became_active":"2024-04-25T12:21:24.133493+0000","last_became_peered":"2024-04-25T12:21:24.133493+0000","last_unstale":"2024-04-25T12:21:29.167162+0000","last_undegraded":"2024-04-25T12:21:29.167162+0000","last_fullsized":"2024-04-25T12:21:29.167162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:24:25.810067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.286483+0000","last_change":"2024-04-25T12:21:28.188314+0000","last_active":"2024-04-25T12:21:29.286483+0000","last_peered":"2024-04-25T12:21:29.286483+0000","last_clean":"2024-04-25T12:21:29.286483+0000","last_became_active":"2024-04-25T12:21:28.187955+0000","last_became_peered":"2024-04-25T12:21:28.187955+0000","last_unstale":"2024-04-25T12:21:29.286483+0000","last_undegraded":"2024-04-25T12:21:29.286483+0000","last_fullsized":"2024-04-25T12:21:29.286483+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:17.889868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.280334+0000","last_change":"2024-04-25T12:21:24.126582+0000","last_active":"2024-04-25T12:21:29.280334+0000","last_peered":"2024-04-25T12:21:29.280334+0000","last_clean":"2024-04-25T12:21:29.280334+0000","last_became_active":"2024-04-25T12:21:24.125831+0000","last_became_peered":"2024-04-25T12:21:24.125831+0000","last_unstale":"2024-04-25T12:21:29.280334+0000","last_undegraded":"2024-04-25T12:21:29.280334+0000","last_fullsized":"2024-04-25T12:21:29.280334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:53.129274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.166193+0000","last_change":"2024-04-25T12:21:24.117441+0000","last_active":"2024-04-25T12:21:29.166193+0000","last_peered":"2024-04-25T12:21:29.166193+0000","last_clean":"2024-04-25T12:21:29.166193+0000","last_became_active":"2024-04-25T12:21:24.116498+0000","last_became_peered":"2024-04-25T12:21:24.116498+0000","last_unstale":"2024-04-25T12:21:29.166193+0000","last_undegraded":"2024-04-25T12:21:29.166193+0000","last_fullsized":"2024-04-25T12:21:29.166193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:06:45.632199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.167962+0000","last_change":"2024-04-25T12:21:24.117995+0000","last_active":"2024-04-25T12:21:29.167962+0000","last_peered":"2024-04-25T12:21:29.167962+0000","last_clean":"2024-04-25T12:21:29.167962+0000","last_became_active":"2024-04-25T12:21:24.114742+0000","last_became_peered":"2024-04-25T12:21:24.114742+0000","last_unstale":"2024-04-25T12:21:29.167962+0000","last_undegraded":"2024-04-25T12:21:29.167962+0000","last_fullsized":"2024-04-25T12:21:29.167962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:59.864082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547009+0000","last_change":"2024-04-25T12:21:24.134863+0000","last_active":"2024-04-25T12:21:29.547009+0000","last_peered":"2024-04-25T12:21:29.547009+0000","last_clean":"2024-04-25T12:21:29.547009+0000","last_became_active":"2024-04-25T12:21:24.126476+0000","last_became_peered":"2024-04-25T12:21:24.126476+0000","last_unstale":"2024-04-25T12:21:29.547009+0000","last_undegraded":"2024-04-25T12:21:29.547009+0000","last_fullsized":"2024-04-25T12:21:29.547009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:19:32.516429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.286222+0000","last_change":"2024-04-25T12:21:24.135699+0000","last_active":"2024-04-25T12:21:29.286222+0000","last_peered":"2024-04-25T12:21:29.286222+0000","last_clean":"2024-04-25T12:21:29.286222+0000","last_became_active":"2024-04-25T12:21:24.135257+0000","last_became_peered":"2024-04-25T12:21:24.135257+0000","last_unstale":"2024-04-25T12:21:29.286222+0000","last_undegraded":"2024-04-25T12:21:29.286222+0000","last_fullsized":"2024-04-25T12:21:29.286222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:55:21.195220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547552+0000","last_change":"2024-04-25T12:21:24.132760+0000","last_active":"2024-04-25T12:21:29.547552+0000","last_peered":"2024-04-25T12:21:29.547552+0000","last_clean":"2024-04-25T12:21:29.547552+0000","last_became_active":"2024-04-25T12:21:24.132225+0000","last_became_peered":"2024-04-25T12:21:24.132225+0000","last_unstale":"2024-04-25T12:21:29.547552+0000","last_undegraded":"2024-04-25T12:21:29.547552+0000","last_fullsized":"2024-04-25T12:21:29.547552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:44:23.025905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.281911+0000","last_change":"2024-04-25T12:21:24.148515+0000","last_active":"2024-04-25T12:21:29.281911+0000","last_peered":"2024-04-25T12:21:29.281911+0000","last_clean":"2024-04-25T12:21:29.281911+0000","last_became_active":"2024-04-25T12:21:24.148025+0000","last_became_peered":"2024-04-25T12:21:24.148025+0000","last_unstale":"2024-04-25T12:21:29.281911+0000","last_undegraded":"2024-04-25T12:21:29.281911+0000","last_fullsized":"2024-04-25T12:21:29.281911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:49:29.665678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.286467+0000","last_change":"2024-04-25T12:21:24.135856+0000","last_active":"2024-04-25T12:21:29.286467+0000","last_peered":"2024-04-25T12:21:29.286467+0000","last_clean":"2024-04-25T12:21:29.286467+0000","last_became_active":"2024-04-25T12:21:24.135310+0000","last_became_peered":"2024-04-25T12:21:24.135310+0000","last_unstale":"2024-04-25T12:21:29.286467+0000","last_undegraded":"2024-04-25T12:21:29.286467+0000","last_fullsized":"2024-04-25T12:21:29.286467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:02.396753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.167926+0000","last_change":"2024-04-25T12:21:24.119002+0000","last_active":"2024-04-25T12:21:29.167926+0000","last_peered":"2024-04-25T12:21:29.167926+0000","last_clean":"2024-04-25T12:21:29.167926+0000","last_became_active":"2024-04-25T12:21:24.112992+0000","last_became_peered":"2024-04-25T12:21:24.112992+0000","last_unstale":"2024-04-25T12:21:29.167926+0000","last_undegraded":"2024-04-25T12:21:29.167926+0000","last_fullsized":"2024-04-25T12:21:29.167926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:44:34.461656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.285101+0000","last_change":"2024-04-25T12:21:24.118251+0000","last_active":"2024-04-25T12:21:29.285101+0000","last_peered":"2024-04-25T12:21:29.285101+0000","last_clean":"2024-04-25T12:21:29.285101+0000","last_became_active":"2024-04-25T12:21:24.117412+0000","last_became_peered":"2024-04-25T12:21:24.117412+0000","last_unstale":"2024-04-25T12:21:29.285101+0000","last_undegraded":"2024-04-25T12:21:29.285101+0000","last_fullsized":"2024-04-25T12:21:29.285101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:44:13.238510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.167670+0000","last_change":"2024-04-25T12:21:24.138641+0000","last_active":"2024-04-25T12:21:29.167670+0000","last_peered":"2024-04-25T12:21:29.167670+0000","last_clean":"2024-04-25T12:21:29.167670+0000","last_became_active":"2024-04-25T12:21:24.137937+0000","last_became_peered":"2024-04-25T12:21:24.137937+0000","last_unstale":"2024-04-25T12:21:29.167670+0000","last_undegraded":"2024-04-25T12:21:29.167670+0000","last_fullsized":"2024-04-25T12:21:29.167670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:55:49.291319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.546657+0000","last_change":"2024-04-25T12:21:24.137779+0000","last_active":"2024-04-25T12:21:29.546657+0000","last_peered":"2024-04-25T12:21:29.546657+0000","last_clean":"2024-04-25T12:21:29.546657+0000","last_became_active":"2024-04-25T12:21:24.137431+0000","last_became_peered":"2024-04-25T12:21:24.137431+0000","last_unstale":"2024-04-25T12:21:29.546657+0000","last_undegraded":"2024-04-25T12:21:29.546657+0000","last_fullsized":"2024-04-25T12:21:29.546657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:24:24.181972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.281098+0000","last_change":"2024-04-25T12:21:24.128960+0000","last_active":"2024-04-25T12:21:29.281098+0000","last_peered":"2024-04-25T12:21:29.281098+0000","last_clean":"2024-04-25T12:21:29.281098+0000","last_became_active":"2024-04-25T12:21:24.128125+0000","last_became_peered":"2024-04-25T12:21:24.128125+0000","last_unstale":"2024-04-25T12:21:29.281098+0000","last_undegraded":"2024-04-25T12:21:29.281098+0000","last_fullsized":"2024-04-25T12:21:29.281098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:01.701850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.550097+0000","last_change":"2024-04-25T12:21:24.149001+0000","last_active":"2024-04-25T12:21:29.550097+0000","last_peered":"2024-04-25T12:21:29.550097+0000","last_clean":"2024-04-25T12:21:29.550097+0000","last_became_active":"2024-04-25T12:21:24.147230+0000","last_became_peered":"2024-04-25T12:21:24.147230+0000","last_unstale":"2024-04-25T12:21:29.550097+0000","last_undegraded":"2024-04-25T12:21:29.550097+0000","last_fullsized":"2024-04-25T12:21:29.550097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:05:17.824845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.166871+0000","last_change":"2024-04-25T12:21:24.119941+0000","last_active":"2024-04-25T12:21:29.166871+0000","last_peered":"2024-04-25T12:21:29.166871+0000","last_clean":"2024-04-25T12:21:29.166871+0000","last_became_active":"2024-04-25T12:21:24.118761+0000","last_became_peered":"2024-04-25T12:21:24.118761+0000","last_unstale":"2024-04-25T12:21:29.166871+0000","last_undegraded":"2024-04-25T12:21:29.166871+0000","last_fullsized":"2024-04-25T12:21:29.166871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:49:41.353812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.168941+0000","last_change":"2024-04-25T12:21:24.144163+0000","last_active":"2024-04-25T12:21:29.168941+0000","last_peered":"2024-04-25T12:21:29.168941+0000","last_clean":"2024-04-25T12:21:29.168941+0000","last_became_active":"2024-04-25T12:21:24.143786+0000","last_became_peered":"2024-04-25T12:21:24.143786+0000","last_unstale":"2024-04-25T12:21:29.168941+0000","last_undegraded":"2024-04-25T12:21:29.168941+0000","last_fullsized":"2024-04-25T12:21:29.168941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:17.961437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.167895+0000","last_change":"2024-04-25T12:21:24.107551+0000","last_active":"2024-04-25T12:21:29.167895+0000","last_peered":"2024-04-25T12:21:29.167895+0000","last_clean":"2024-04-25T12:21:29.167895+0000","last_became_active":"2024-04-25T12:21:24.106818+0000","last_became_peered":"2024-04-25T12:21:24.106818+0000","last_unstale":"2024-04-25T12:21:29.167895+0000","last_undegraded":"2024-04-25T12:21:29.167895+0000","last_fullsized":"2024-04-25T12:21:29.167895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:09:24.627007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.546570+0000","last_change":"2024-04-25T12:21:24.114917+0000","last_active":"2024-04-25T12:21:29.546570+0000","last_peered":"2024-04-25T12:21:29.546570+0000","last_clean":"2024-04-25T12:21:29.546570+0000","last_became_active":"2024-04-25T12:21:24.114237+0000","last_became_peered":"2024-04-25T12:21:24.114237+0000","last_unstale":"2024-04-25T12:21:29.546570+0000","last_undegraded":"2024-04-25T12:21:29.546570+0000","last_fullsized":"2024-04-25T12:21:29.546570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:32:38.296553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.546685+0000","last_change":"2024-04-25T12:21:24.132860+0000","last_active":"2024-04-25T12:21:29.546685+0000","last_peered":"2024-04-25T12:21:29.546685+0000","last_clean":"2024-04-25T12:21:29.546685+0000","last_became_active":"2024-04-25T12:21:24.132094+0000","last_became_peered":"2024-04-25T12:21:24.132094+0000","last_unstale":"2024-04-25T12:21:29.546685+0000","last_undegraded":"2024-04-25T12:21:29.546685+0000","last_fullsized":"2024-04-25T12:21:29.546685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:27:24.026145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.285468+0000","last_change":"2024-04-25T12:21:24.118083+0000","last_active":"2024-04-25T12:21:29.285468+0000","last_peered":"2024-04-25T12:21:29.285468+0000","last_clean":"2024-04-25T12:21:29.285468+0000","last_became_active":"2024-04-25T12:21:24.116766+0000","last_became_peered":"2024-04-25T12:21:24.116766+0000","last_unstale":"2024-04-25T12:21:29.285468+0000","last_undegraded":"2024-04-25T12:21:29.285468+0000","last_fullsized":"2024-04-25T12:21:29.285468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:02.432868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.167503+0000","last_change":"2024-04-25T12:21:24.124288+0000","last_active":"2024-04-25T12:21:29.167503+0000","last_peered":"2024-04-25T12:21:29.167503+0000","last_clean":"2024-04-25T12:21:29.167503+0000","last_became_active":"2024-04-25T12:21:24.116973+0000","last_became_peered":"2024-04-25T12:21:24.116973+0000","last_unstale":"2024-04-25T12:21:29.167503+0000","last_undegraded":"2024-04-25T12:21:29.167503+0000","last_fullsized":"2024-04-25T12:21:29.167503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:34:53.390321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.281584+0000","last_change":"2024-04-25T12:21:24.115615+0000","last_active":"2024-04-25T12:21:29.281584+0000","last_peered":"2024-04-25T12:21:29.281584+0000","last_clean":"2024-04-25T12:21:29.281584+0000","last_became_active":"2024-04-25T12:21:24.114829+0000","last_became_peered":"2024-04-25T12:21:24.114829+0000","last_unstale":"2024-04-25T12:21:29.281584+0000","last_undegraded":"2024-04-25T12:21:29.281584+0000","last_fullsized":"2024-04-25T12:21:29.281584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:17.961437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.281900+0000","last_change":"2024-04-25T12:21:24.117225+0000","last_active":"2024-04-25T12:21:29.281900+0000","last_peered":"2024-04-25T12:21:29.281900+0000","last_clean":"2024-04-25T12:21:29.281900+0000","last_became_active":"2024-04-25T12:21:24.116359+0000","last_became_peered":"2024-04-25T12:21:24.116359+0000","last_unstale":"2024-04-25T12:21:29.281900+0000","last_undegraded":"2024-04-25T12:21:29.281900+0000","last_fullsized":"2024-04-25T12:21:29.281900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:22:27.461512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.550024+0000","last_change":"2024-04-25T12:21:24.145198+0000","last_active":"2024-04-25T12:21:29.550024+0000","last_peered":"2024-04-25T12:21:29.550024+0000","last_clean":"2024-04-25T12:21:29.550024+0000","last_became_active":"2024-04-25T12:21:24.142353+0000","last_became_peered":"2024-04-25T12:21:24.142353+0000","last_unstale":"2024-04-25T12:21:29.550024+0000","last_undegraded":"2024-04-25T12:21:29.550024+0000","last_fullsized":"2024-04-25T12:21:29.550024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:44:24.335226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.285030+0000","last_change":"2024-04-25T12:21:24.128086+0000","last_active":"2024-04-25T12:21:29.285030+0000","last_peered":"2024-04-25T12:21:29.285030+0000","last_clean":"2024-04-25T12:21:29.285030+0000","last_became_active":"2024-04-25T12:21:24.127315+0000","last_became_peered":"2024-04-25T12:21:24.127315+0000","last_unstale":"2024-04-25T12:21:29.285030+0000","last_undegraded":"2024-04-25T12:21:29.285030+0000","last_fullsized":"2024-04-25T12:21:29.285030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:20.513145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.549407+0000","last_change":"2024-04-25T12:21:24.142394+0000","last_active":"2024-04-25T12:21:29.549407+0000","last_peered":"2024-04-25T12:21:29.549407+0000","last_clean":"2024-04-25T12:21:29.549407+0000","last_became_active":"2024-04-25T12:21:24.142029+0000","last_became_peered":"2024-04-25T12:21:24.142029+0000","last_unstale":"2024-04-25T12:21:29.549407+0000","last_undegraded":"2024-04-25T12:21:29.549407+0000","last_fullsized":"2024-04-25T12:21:29.549407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:02:56.129724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.167820+0000","last_change":"2024-04-25T12:21:24.113876+0000","last_active":"2024-04-25T12:21:29.167820+0000","last_peered":"2024-04-25T12:21:29.167820+0000","last_clean":"2024-04-25T12:21:29.167820+0000","last_became_active":"2024-04-25T12:21:24.112339+0000","last_became_peered":"2024-04-25T12:21:24.112339+0000","last_unstale":"2024-04-25T12:21:29.167820+0000","last_undegraded":"2024-04-25T12:21:29.167820+0000","last_fullsized":"2024-04-25T12:21:29.167820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:31:44.641068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.549669+0000","last_change":"2024-04-25T12:21:24.144879+0000","last_active":"2024-04-25T12:21:29.549669+0000","last_peered":"2024-04-25T12:21:29.549669+0000","last_clean":"2024-04-25T12:21:29.549669+0000","last_became_active":"2024-04-25T12:21:24.142422+0000","last_became_peered":"2024-04-25T12:21:24.142422+0000","last_unstale":"2024-04-25T12:21:29.549669+0000","last_undegraded":"2024-04-25T12:21:29.549669+0000","last_fullsized":"2024-04-25T12:21:29.549669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:03.206429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.168142+0000","last_change":"2024-04-25T12:21:24.132561+0000","last_active":"2024-04-25T12:21:29.168142+0000","last_peered":"2024-04-25T12:21:29.168142+0000","last_clean":"2024-04-25T12:21:29.168142+0000","last_became_active":"2024-04-25T12:21:24.131746+0000","last_became_peered":"2024-04-25T12:21:24.131746+0000","last_unstale":"2024-04-25T12:21:29.168142+0000","last_undegraded":"2024-04-25T12:21:29.168142+0000","last_fullsized":"2024-04-25T12:21:29.168142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:24.441417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.546747+0000","last_change":"2024-04-25T12:21:24.111956+0000","last_active":"2024-04-25T12:21:29.546747+0000","last_peered":"2024-04-25T12:21:29.546747+0000","last_clean":"2024-04-25T12:21:29.546747+0000","last_became_active":"2024-04-25T12:21:24.111154+0000","last_became_peered":"2024-04-25T12:21:24.111154+0000","last_unstale":"2024-04-25T12:21:29.546747+0000","last_undegraded":"2024-04-25T12:21:29.546747+0000","last_fullsized":"2024-04-25T12:21:29.546747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:39:56.070884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.548238+0000","last_change":"2024-04-25T12:21:24.134511+0000","last_active":"2024-04-25T12:21:29.548238+0000","last_peered":"2024-04-25T12:21:29.548238+0000","last_clean":"2024-04-25T12:21:29.548238+0000","last_became_active":"2024-04-25T12:21:24.133839+0000","last_became_peered":"2024-04-25T12:21:24.133839+0000","last_unstale":"2024-04-25T12:21:29.548238+0000","last_undegraded":"2024-04-25T12:21:29.548238+0000","last_fullsized":"2024-04-25T12:21:29.548238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:43.263673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.549724+0000","last_change":"2024-04-25T12:21:24.147519+0000","last_active":"2024-04-25T12:21:29.549724+0000","last_peered":"2024-04-25T12:21:29.549724+0000","last_clean":"2024-04-25T12:21:29.549724+0000","last_became_active":"2024-04-25T12:21:24.146805+0000","last_became_peered":"2024-04-25T12:21:24.146805+0000","last_unstale":"2024-04-25T12:21:29.549724+0000","last_undegraded":"2024-04-25T12:21:29.549724+0000","last_fullsized":"2024-04-25T12:21:29.549724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:23.200746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574860,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574861,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T12:21:55.284 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T12:21:55.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.418+0000 7f8169570640 1 Processor -- start 2024-04-25T12:21:55.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.418+0000 7f8169570640 1 -- start start 2024-04-25T12:21:55.427 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.418+0000 7f8169570640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f816414ffa0 0x7f816406f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:55.427 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.418+0000 7f8169570640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8164074100 0x7f81640c7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:55.427 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.418+0000 7f8169570640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81640c5d70 con 0x7f816414fbc0 2024-04-25T12:21:55.427 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.418+0000 7f8169570640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f81640c6050 con 0x7f8164074100 2024-04-25T12:21:55.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.418+0000 7f8169570640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f81640c6330 con 0x7f816414ffa0 2024-04-25T12:21:55.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.422+0000 7f81637fe640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8164074100 0x7f81640c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:55.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.422+0000 7f81637fe640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8164074100 0x7f81640c7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:59200/0 (socket says 172.21.15.86:59200) 2024-04-25T12:21:55.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.422+0000 7f81637fe640 1 -- 172.21.15.86:0/1680369047 learned_addr learned my addr 172.21.15.86:0/1680369047 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:55.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.422+0000 7f81627fc640 1 --2- 172.21.15.86:0/1680369047 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f816414ffa0 0x7f816406f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:55.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.422+0000 7f81637fe640 1 -- 172.21.15.86:0/1680369047 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f816414ffa0 msgr2=0x7f816406f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:55.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.422+0000 7f81637fe640 1 --2- 172.21.15.86:0/1680369047 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f816414ffa0 0x7f816406f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:55.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.422+0000 7f81637fe640 1 -- 172.21.15.86:0/1680369047 >> v1:172.21.15.134:6789/0 conn(0x7f816414fbc0 legacy=0x7f81640c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:55.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.422+0000 7f81637fe640 1 -- 172.21.15.86:0/1680369047 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81640c6610 con 0x7f8164074100 2024-04-25T12:21:55.429 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.422+0000 7f81637fe640 1 --2- 172.21.15.86:0/1680369047 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8164074100 0x7f81640c7250 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f815c009e50 tx=0x7f815c01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=627f4de61daae3c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:55.429 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.422+0000 7f8161ffb640 1 -- 172.21.15.86:0/1680369047 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f815c0a5890 con 0x7f8164074100 2024-04-25T12:21:55.429 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.422+0000 7f8161ffb640 1 -- 172.21.15.86:0/1680369047 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f815c0a5a30 con 0x7f8164074100 2024-04-25T12:21:55.429 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.422+0000 7f8161ffb640 1 -- 172.21.15.86:0/1680369047 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f815c0a5e00 con 0x7f8164074100 2024-04-25T12:21:55.430 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.422+0000 7f8169570640 1 -- 172.21.15.86:0/1680369047 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8164074100 msgr2=0x7f81640c7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:55.430 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.422+0000 7f8169570640 1 --2- 172.21.15.86:0/1680369047 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8164074100 0x7f81640c7250 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f815c009e50 tx=0x7f815c01c9f0 comp rx=0 tx=0).stop 2024-04-25T12:21:55.430 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.422+0000 7f8169570640 1 -- 172.21.15.86:0/1680369047 shutdown_connections 2024-04-25T12:21:55.430 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.422+0000 7f8169570640 1 --2- 172.21.15.86:0/1680369047 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8164074100 0x7f81640c7250 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:55.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.422+0000 7f8169570640 1 --2- 172.21.15.86:0/1680369047 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f816414ffa0 0x7f816406f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:55.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.422+0000 7f8169570640 1 -- 172.21.15.86:0/1680369047 >> 172.21.15.86:0/1680369047 conn(0x7f816406b9d0 msgr2=0x7f816406bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:55.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.422+0000 7f8169570640 1 -- 172.21.15.86:0/1680369047 shutdown_connections 2024-04-25T12:21:55.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.422+0000 7f8169570640 1 -- 172.21.15.86:0/1680369047 wait complete. 2024-04-25T12:21:55.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.426+0000 7f8169570640 1 Processor -- start 2024-04-25T12:21:55.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.426+0000 7f8169570640 1 -- start start 2024-04-25T12:21:55.433 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.426+0000 7f8169570640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8164074100 0x7f816414c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:55.433 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.426+0000 7f8169570640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f816414fbc0 0x7f81641f7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:55.433 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.426+0000 7f8169570640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f816414ffa0 0x7f81641f8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:55.433 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.426+0000 7f8169570640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f81640c8ab0 con 0x7f816414ffa0 2024-04-25T12:21:55.433 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.426+0000 7f8169570640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f81640c8930 con 0x7f816414fbc0 2024-04-25T12:21:55.433 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.426+0000 7f8169570640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f8164166090 con 0x7f8164074100 2024-04-25T12:21:55.434 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.426+0000 7f81637fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f816414ffa0 0x7f81641f8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:55.434 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.426+0000 7f81637fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f816414ffa0 0x7f81641f8430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:59212/0 (socket says 172.21.15.86:59212) 2024-04-25T12:21:55.434 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.426+0000 7f81637fe640 1 -- 172.21.15.86:0/3407028822 learned_addr learned my addr 172.21.15.86:0/3407028822 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:55.434 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.426+0000 7f8162ffd640 1 --2- 172.21.15.86:0/3407028822 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8164074100 0x7f816414c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:55.434 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.426+0000 7f81627fc640 1 --2- 172.21.15.86:0/3407028822 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f816414fbc0 0x7f81641f7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:55.434 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.426+0000 7f81637fe640 1 -- 172.21.15.86:0/3407028822 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8164074100 msgr2=0x7f816414c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:55.434 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.426+0000 7f81637fe640 1 --2- 172.21.15.86:0/3407028822 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8164074100 0x7f816414c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:55.434 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.426+0000 7f81637fe640 1 -- 172.21.15.86:0/3407028822 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f816414fbc0 msgr2=0x7f81641f7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:55.434 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.426+0000 7f81637fe640 1 --2- 172.21.15.86:0/3407028822 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f816414fbc0 0x7f81641f7ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:55.434 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.426+0000 7f81637fe640 1 -- 172.21.15.86:0/3407028822 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f816415c420 con 0x7f816414ffa0 2024-04-25T12:21:55.434 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.426+0000 7f81637fe640 1 --2- 172.21.15.86:0/3407028822 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f816414ffa0 0x7f81641f8430 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f815c01b0a0 tx=0x7f815c019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:55.434 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.426+0000 7f814b7fe640 1 -- 172.21.15.86:0/3407028822 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f815c0bc030 con 0x7f816414ffa0 2024-04-25T12:21:55.434 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.426+0000 7f814b7fe640 1 -- 172.21.15.86:0/3407028822 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f815c0b8470 con 0x7f816414ffa0 2024-04-25T12:21:55.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.426+0000 7f8169570640 1 -- 172.21.15.86:0/3407028822 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81641630d0 con 0x7f816414ffa0 2024-04-25T12:21:55.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.426+0000 7f814b7fe640 1 -- 172.21.15.86:0/3407028822 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f815c0b8860 con 0x7f816414ffa0 2024-04-25T12:21:55.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.426+0000 7f8169570640 1 -- 172.21.15.86:0/3407028822 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81641f79d0 con 0x7f816414ffa0 2024-04-25T12:21:55.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.426+0000 7f8169570640 1 -- 172.21.15.86:0/3407028822 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8164075df0 con 0x7f816414ffa0 2024-04-25T12:21:55.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.426+0000 7f814b7fe640 1 -- 172.21.15.86:0/3407028822 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f815c0bf070 con 0x7f816414ffa0 2024-04-25T12:21:55.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.426+0000 7f814b7fe640 1 --2- 172.21.15.86:0/3407028822 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f81500683b0 0x7f815006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:55.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.426+0000 7f814b7fe640 1 -- 172.21.15.86:0/3407028822 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f815c121620 con 0x7f816414ffa0 2024-04-25T12:21:55.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.426+0000 7f8162ffd640 1 --2- 172.21.15.86:0/3407028822 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f81500683b0 0x7f815006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:55.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.430+0000 7f8162ffd640 1 --2- 172.21.15.86:0/3407028822 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f81500683b0 0x7f815006a870 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8154003d60 tx=0x7f8154009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:55.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.434+0000 7f814b7fe640 1 -- 172.21.15.86:0/3407028822 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f815c0165e0 con 0x7f816414ffa0 2024-04-25T12:21:55.584 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.578+0000 7f8169570640 1 -- 172.21.15.86:0/3407028822 --> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f81641f7ba0 con 0x7f81500683b0 2024-04-25T12:21:55.607 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.598+0000 7f814b7fe640 1 -- 172.21.15.86:0/3407028822 <== mgr.4107 v2:172.21.15.86:6832/3708662606 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f81641f7ba0 con 0x7f81500683b0 2024-04-25T12:21:55.608 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:21:55.613 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2024-04-25T12:21:55.614 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.606+0000 7f8169570640 1 -- 172.21.15.86:0/3407028822 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f81500683b0 msgr2=0x7f815006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:55.614 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.606+0000 7f8169570640 1 --2- 172.21.15.86:0/3407028822 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f81500683b0 0x7f815006a870 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8154003d60 tx=0x7f8154009040 comp rx=0 tx=0).stop 2024-04-25T12:21:55.614 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.606+0000 7f8169570640 1 -- 172.21.15.86:0/3407028822 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f816414ffa0 msgr2=0x7f81641f8430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:55.614 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.606+0000 7f8169570640 1 --2- 172.21.15.86:0/3407028822 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f816414ffa0 0x7f81641f8430 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f815c01b0a0 tx=0x7f815c019790 comp rx=0 tx=0).stop 2024-04-25T12:21:55.614 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.606+0000 7f8169570640 1 -- 172.21.15.86:0/3407028822 shutdown_connections 2024-04-25T12:21:55.614 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.606+0000 7f8169570640 1 --2- 172.21.15.86:0/3407028822 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f81500683b0 0x7f815006a870 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:55.614 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.606+0000 7f8169570640 1 --2- 172.21.15.86:0/3407028822 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f816414ffa0 0x7f81641f8430 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:55.614 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.606+0000 7f8169570640 1 --2- 172.21.15.86:0/3407028822 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f816414fbc0 0x7f81641f7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:55.614 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.606+0000 7f8169570640 1 --2- 172.21.15.86:0/3407028822 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8164074100 0x7f816414c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:55.614 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.606+0000 7f8169570640 1 -- 172.21.15.86:0/3407028822 >> 172.21.15.86:0/3407028822 conn(0x7f816406b9d0 msgr2=0x7f81640cbce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:55.614 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.606+0000 7f8169570640 1 -- 172.21.15.86:0/3407028822 shutdown_connections 2024-04-25T12:21:55.614 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.606+0000 7f8169570640 1 -- 172.21.15.86:0/3407028822 wait complete. 2024-04-25T12:21:55.628 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2024-04-25T12:21:53.806953+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219400,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755320,"statfs":{"total":773094113280,"available":772869447680,"internally_reserved":0,"allocated":3284992,"data_stored":1992064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004373"},"pg_stats":[{"pgid":"2.1f","version":"23'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547440+0000","last_change":"2024-04-25T12:21:23.124053+0000","last_active":"2024-04-25T12:21:29.547440+0000","last_peered":"2024-04-25T12:21:29.547440+0000","last_clean":"2024-04-25T12:21:29.547440+0000","last_became_active":"2024-04-25T12:21:23.123863+0000","last_became_peered":"2024-04-25T12:21:23.123863+0000","last_unstale":"2024-04-25T12:21:29.547440+0000","last_undegraded":"2024-04-25T12:21:29.547440+0000","last_fullsized":"2024-04-25T12:21:29.547440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:52:10.500619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.286029+0000","last_change":"2024-04-25T12:21:24.141874+0000","last_active":"2024-04-25T12:21:29.286029+0000","last_peered":"2024-04-25T12:21:29.286029+0000","last_clean":"2024-04-25T12:21:29.286029+0000","last_became_active":"2024-04-25T12:21:24.141482+0000","last_became_peered":"2024-04-25T12:21:24.141482+0000","last_unstale":"2024-04-25T12:21:29.286029+0000","last_undegraded":"2024-04-25T12:21:29.286029+0000","last_fullsized":"2024-04-25T12:21:29.286029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:45.364004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.284811+0000","last_change":"2024-04-25T12:21:28.377921+0000","last_active":"2024-04-25T12:21:29.284811+0000","last_peered":"2024-04-25T12:21:29.284811+0000","last_clean":"2024-04-25T12:21:29.284811+0000","last_became_active":"2024-04-25T12:21:28.376966+0000","last_became_peered":"2024-04-25T12:21:28.376966+0000","last_unstale":"2024-04-25T12:21:29.284811+0000","last_undegraded":"2024-04-25T12:21:29.284811+0000","last_fullsized":"2024-04-25T12:21:29.284811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:50:43.460694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.286467+0000","last_change":"2024-04-25T12:21:23.113889+0000","last_active":"2024-04-25T12:21:29.286467+0000","last_peered":"2024-04-25T12:21:29.286467+0000","last_clean":"2024-04-25T12:21:29.286467+0000","last_became_active":"2024-04-25T12:21:23.113605+0000","last_became_peered":"2024-04-25T12:21:23.113605+0000","last_unstale":"2024-04-25T12:21:29.286467+0000","last_undegraded":"2024-04-25T12:21:29.286467+0000","last_fullsized":"2024-04-25T12:21:29.286467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:01.082322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547299+0000","last_change":"2024-04-25T12:21:24.115472+0000","last_active":"2024-04-25T12:21:29.547299+0000","last_peered":"2024-04-25T12:21:29.547299+0000","last_clean":"2024-04-25T12:21:29.547299+0000","last_became_active":"2024-04-25T12:21:24.114671+0000","last_became_peered":"2024-04-25T12:21:24.114671+0000","last_unstale":"2024-04-25T12:21:29.547299+0000","last_undegraded":"2024-04-25T12:21:29.547299+0000","last_fullsized":"2024-04-25T12:21:29.547299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:01:31.853992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.165775+0000","last_change":"2024-04-25T12:21:28.205320+0000","last_active":"2024-04-25T12:21:29.165775+0000","last_peered":"2024-04-25T12:21:29.165775+0000","last_clean":"2024-04-25T12:21:29.165775+0000","last_became_active":"2024-04-25T12:21:28.204404+0000","last_became_peered":"2024-04-25T12:21:28.204404+0000","last_unstale":"2024-04-25T12:21:29.165775+0000","last_undegraded":"2024-04-25T12:21:29.165775+0000","last_fullsized":"2024-04-25T12:21:29.165775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:03:17.730928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.549885+0000","last_change":"2024-04-25T12:21:23.132332+0000","last_active":"2024-04-25T12:21:29.549885+0000","last_peered":"2024-04-25T12:21:29.549885+0000","last_clean":"2024-04-25T12:21:29.549885+0000","last_became_active":"2024-04-25T12:21:23.131566+0000","last_became_peered":"2024-04-25T12:21:23.131566+0000","last_unstale":"2024-04-25T12:21:29.549885+0000","last_undegraded":"2024-04-25T12:21:29.549885+0000","last_fullsized":"2024-04-25T12:21:29.549885+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:02.429838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.168229+0000","last_change":"2024-04-25T12:21:24.128824+0000","last_active":"2024-04-25T12:21:29.168229+0000","last_peered":"2024-04-25T12:21:29.168229+0000","last_clean":"2024-04-25T12:21:29.168229+0000","last_became_active":"2024-04-25T12:21:24.128027+0000","last_became_peered":"2024-04-25T12:21:24.128027+0000","last_unstale":"2024-04-25T12:21:29.168229+0000","last_undegraded":"2024-04-25T12:21:29.168229+0000","last_fullsized":"2024-04-25T12:21:29.168229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:57:44.137044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.167257+0000","last_change":"2024-04-25T12:21:28.202389+0000","last_active":"2024-04-25T12:21:29.167257+0000","last_peered":"2024-04-25T12:21:29.167257+0000","last_clean":"2024-04-25T12:21:29.167257+0000","last_became_active":"2024-04-25T12:21:28.201228+0000","last_became_peered":"2024-04-25T12:21:28.201228+0000","last_unstale":"2024-04-25T12:21:29.167257+0000","last_undegraded":"2024-04-25T12:21:29.167257+0000","last_fullsized":"2024-04-25T12:21:29.167257+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:45:30.365480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.549318+0000","last_change":"2024-04-25T12:21:23.128355+0000","last_active":"2024-04-25T12:21:29.549318+0000","last_peered":"2024-04-25T12:21:29.549318+0000","last_clean":"2024-04-25T12:21:29.549318+0000","last_became_active":"2024-04-25T12:21:23.127717+0000","last_became_peered":"2024-04-25T12:21:23.127717+0000","last_unstale":"2024-04-25T12:21:29.549318+0000","last_undegraded":"2024-04-25T12:21:29.549318+0000","last_fullsized":"2024-04-25T12:21:29.549318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:26.319715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.168925+0000","last_change":"2024-04-25T12:21:24.122098+0000","last_active":"2024-04-25T12:21:29.168925+0000","last_peered":"2024-04-25T12:21:29.168925+0000","last_clean":"2024-04-25T12:21:29.168925+0000","last_became_active":"2024-04-25T12:21:24.121392+0000","last_became_peered":"2024-04-25T12:21:24.121392+0000","last_unstale":"2024-04-25T12:21:29.168925+0000","last_undegraded":"2024-04-25T12:21:29.168925+0000","last_fullsized":"2024-04-25T12:21:29.168925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:11:35.116222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.167070+0000","last_change":"2024-04-25T12:21:28.189048+0000","last_active":"2024-04-25T12:21:29.167070+0000","last_peered":"2024-04-25T12:21:29.167070+0000","last_clean":"2024-04-25T12:21:29.167070+0000","last_became_active":"2024-04-25T12:21:28.187340+0000","last_became_peered":"2024-04-25T12:21:28.187340+0000","last_unstale":"2024-04-25T12:21:29.167070+0000","last_undegraded":"2024-04-25T12:21:29.167070+0000","last_fullsized":"2024-04-25T12:21:29.167070+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:47:13.797595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.280524+0000","last_change":"2024-04-25T12:21:24.126211+0000","last_active":"2024-04-25T12:21:29.280524+0000","last_peered":"2024-04-25T12:21:29.280524+0000","last_clean":"2024-04-25T12:21:29.280524+0000","last_became_active":"2024-04-25T12:21:24.123695+0000","last_became_peered":"2024-04-25T12:21:24.123695+0000","last_unstale":"2024-04-25T12:21:29.280524+0000","last_undegraded":"2024-04-25T12:21:29.280524+0000","last_fullsized":"2024-04-25T12:21:29.280524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:09:04.327157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.550040+0000","last_change":"2024-04-25T12:21:23.139676+0000","last_active":"2024-04-25T12:21:29.550040+0000","last_peered":"2024-04-25T12:21:29.550040+0000","last_clean":"2024-04-25T12:21:29.550040+0000","last_became_active":"2024-04-25T12:21:23.139025+0000","last_became_peered":"2024-04-25T12:21:23.139025+0000","last_unstale":"2024-04-25T12:21:29.550040+0000","last_undegraded":"2024-04-25T12:21:29.550040+0000","last_fullsized":"2024-04-25T12:21:29.550040+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:43:51.445149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.168869+0000","last_change":"2024-04-25T12:21:28.188852+0000","last_active":"2024-04-25T12:21:29.168869+0000","last_peered":"2024-04-25T12:21:29.168869+0000","last_clean":"2024-04-25T12:21:29.168869+0000","last_became_active":"2024-04-25T12:21:28.187619+0000","last_became_peered":"2024-04-25T12:21:28.187619+0000","last_unstale":"2024-04-25T12:21:29.168869+0000","last_undegraded":"2024-04-25T12:21:29.168869+0000","last_fullsized":"2024-04-25T12:21:29.168869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:12:14.726245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.285527+0000","last_change":"2024-04-25T12:21:24.136925+0000","last_active":"2024-04-25T12:21:29.285527+0000","last_peered":"2024-04-25T12:21:29.285527+0000","last_clean":"2024-04-25T12:21:29.285527+0000","last_became_active":"2024-04-25T12:21:24.136535+0000","last_became_peered":"2024-04-25T12:21:24.136535+0000","last_unstale":"2024-04-25T12:21:29.285527+0000","last_undegraded":"2024-04-25T12:21:29.285527+0000","last_fullsized":"2024-04-25T12:21:29.285527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:28:23.965010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547294+0000","last_change":"2024-04-25T12:21:23.105571+0000","last_active":"2024-04-25T12:21:29.547294+0000","last_peered":"2024-04-25T12:21:29.547294+0000","last_clean":"2024-04-25T12:21:29.547294+0000","last_became_active":"2024-04-25T12:21:23.105051+0000","last_became_peered":"2024-04-25T12:21:23.105051+0000","last_unstale":"2024-04-25T12:21:29.547294+0000","last_undegraded":"2024-04-25T12:21:29.547294+0000","last_fullsized":"2024-04-25T12:21:29.547294+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:52:40.783100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.167305+0000","last_change":"2024-04-25T12:21:28.202632+0000","last_active":"2024-04-25T12:21:29.167305+0000","last_peered":"2024-04-25T12:21:29.167305+0000","last_clean":"2024-04-25T12:21:29.167305+0000","last_became_active":"2024-04-25T12:21:28.201389+0000","last_became_peered":"2024-04-25T12:21:28.201389+0000","last_unstale":"2024-04-25T12:21:29.167305+0000","last_undegraded":"2024-04-25T12:21:29.167305+0000","last_fullsized":"2024-04-25T12:21:29.167305+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:48:58.246610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.285297+0000","last_change":"2024-04-25T12:21:24.138749+0000","last_active":"2024-04-25T12:21:29.285297+0000","last_peered":"2024-04-25T12:21:29.285297+0000","last_clean":"2024-04-25T12:21:29.285297+0000","last_became_active":"2024-04-25T12:21:24.138446+0000","last_became_peered":"2024-04-25T12:21:24.138446+0000","last_unstale":"2024-04-25T12:21:29.285297+0000","last_undegraded":"2024-04-25T12:21:29.285297+0000","last_fullsized":"2024-04-25T12:21:29.285297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:22:03.856237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.546669+0000","last_change":"2024-04-25T12:21:23.126871+0000","last_active":"2024-04-25T12:21:29.546669+0000","last_peered":"2024-04-25T12:21:29.546669+0000","last_clean":"2024-04-25T12:21:29.546669+0000","last_became_active":"2024-04-25T12:21:23.126521+0000","last_became_peered":"2024-04-25T12:21:23.126521+0000","last_unstale":"2024-04-25T12:21:29.546669+0000","last_undegraded":"2024-04-25T12:21:29.546669+0000","last_fullsized":"2024-04-25T12:21:29.546669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:12:31.353951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.548028+0000","last_change":"2024-04-25T12:21:28.383996+0000","last_active":"2024-04-25T12:21:29.548028+0000","last_peered":"2024-04-25T12:21:29.548028+0000","last_clean":"2024-04-25T12:21:29.548028+0000","last_became_active":"2024-04-25T12:21:28.383568+0000","last_became_peered":"2024-04-25T12:21:28.383568+0000","last_unstale":"2024-04-25T12:21:29.548028+0000","last_undegraded":"2024-04-25T12:21:29.548028+0000","last_fullsized":"2024-04-25T12:21:29.548028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:19:41.564694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.167030+0000","last_change":"2024-04-25T12:21:24.125112+0000","last_active":"2024-04-25T12:21:29.167030+0000","last_peered":"2024-04-25T12:21:29.167030+0000","last_clean":"2024-04-25T12:21:29.167030+0000","last_became_active":"2024-04-25T12:21:24.121963+0000","last_became_peered":"2024-04-25T12:21:24.121963+0000","last_unstale":"2024-04-25T12:21:29.167030+0000","last_undegraded":"2024-04-25T12:21:29.167030+0000","last_fullsized":"2024-04-25T12:21:29.167030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:33:14.123119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.548711+0000","last_change":"2024-04-25T12:21:23.117114+0000","last_active":"2024-04-25T12:21:29.548711+0000","last_peered":"2024-04-25T12:21:29.548711+0000","last_clean":"2024-04-25T12:21:29.548711+0000","last_became_active":"2024-04-25T12:21:23.115571+0000","last_became_peered":"2024-04-25T12:21:23.115571+0000","last_unstale":"2024-04-25T12:21:29.548711+0000","last_undegraded":"2024-04-25T12:21:29.548711+0000","last_fullsized":"2024-04-25T12:21:29.548711+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:47.838299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.168694+0000","last_change":"2024-04-25T12:21:28.202374+0000","last_active":"2024-04-25T12:21:29.168694+0000","last_peered":"2024-04-25T12:21:29.168694+0000","last_clean":"2024-04-25T12:21:29.168694+0000","last_became_active":"2024-04-25T12:21:28.201297+0000","last_became_peered":"2024-04-25T12:21:28.201297+0000","last_unstale":"2024-04-25T12:21:29.168694+0000","last_undegraded":"2024-04-25T12:21:29.168694+0000","last_fullsized":"2024-04-25T12:21:29.168694+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:13.461169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547865+0000","last_change":"2024-04-25T12:21:24.133827+0000","last_active":"2024-04-25T12:21:29.547865+0000","last_peered":"2024-04-25T12:21:29.547865+0000","last_clean":"2024-04-25T12:21:29.547865+0000","last_became_active":"2024-04-25T12:21:24.132703+0000","last_became_peered":"2024-04-25T12:21:24.132703+0000","last_unstale":"2024-04-25T12:21:29.547865+0000","last_undegraded":"2024-04-25T12:21:29.547865+0000","last_fullsized":"2024-04-25T12:21:29.547865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:06:22.849827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.282189+0000","last_change":"2024-04-25T12:21:23.132331+0000","last_active":"2024-04-25T12:21:29.282189+0000","last_peered":"2024-04-25T12:21:29.282189+0000","last_clean":"2024-04-25T12:21:29.282189+0000","last_became_active":"2024-04-25T12:21:23.131628+0000","last_became_peered":"2024-04-25T12:21:23.131628+0000","last_unstale":"2024-04-25T12:21:29.282189+0000","last_undegraded":"2024-04-25T12:21:29.282189+0000","last_fullsized":"2024-04-25T12:21:29.282189+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:19:13.372172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.166531+0000","last_change":"2024-04-25T12:21:28.377407+0000","last_active":"2024-04-25T12:21:29.166531+0000","last_peered":"2024-04-25T12:21:29.166531+0000","last_clean":"2024-04-25T12:21:29.166531+0000","last_became_active":"2024-04-25T12:21:28.376224+0000","last_became_peered":"2024-04-25T12:21:28.376224+0000","last_unstale":"2024-04-25T12:21:29.166531+0000","last_undegraded":"2024-04-25T12:21:29.166531+0000","last_fullsized":"2024-04-25T12:21:29.166531+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:13:02.955979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.286648+0000","last_change":"2024-04-25T12:21:24.145468+0000","last_active":"2024-04-25T12:21:29.286648+0000","last_peered":"2024-04-25T12:21:29.286648+0000","last_clean":"2024-04-25T12:21:29.286648+0000","last_became_active":"2024-04-25T12:21:24.145132+0000","last_became_peered":"2024-04-25T12:21:24.145132+0000","last_unstale":"2024-04-25T12:21:29.286648+0000","last_undegraded":"2024-04-25T12:21:29.286648+0000","last_fullsized":"2024-04-25T12:21:29.286648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:46:44.281270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.548372+0000","last_change":"2024-04-25T12:21:23.131029+0000","last_active":"2024-04-25T12:21:29.548372+0000","last_peered":"2024-04-25T12:21:29.548372+0000","last_clean":"2024-04-25T12:21:29.548372+0000","last_became_active":"2024-04-25T12:21:23.130612+0000","last_became_peered":"2024-04-25T12:21:23.130612+0000","last_unstale":"2024-04-25T12:21:29.548372+0000","last_undegraded":"2024-04-25T12:21:29.548372+0000","last_fullsized":"2024-04-25T12:21:29.548372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:02.146986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.284659+0000","last_change":"2024-04-25T12:21:28.375231+0000","last_active":"2024-04-25T12:21:29.284659+0000","last_peered":"2024-04-25T12:21:29.284659+0000","last_clean":"2024-04-25T12:21:29.284659+0000","last_became_active":"2024-04-25T12:21:28.374813+0000","last_became_peered":"2024-04-25T12:21:28.374813+0000","last_unstale":"2024-04-25T12:21:29.284659+0000","last_undegraded":"2024-04-25T12:21:29.284659+0000","last_fullsized":"2024-04-25T12:21:29.284659+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:16.393582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547074+0000","last_change":"2024-04-25T12:21:24.112280+0000","last_active":"2024-04-25T12:21:29.547074+0000","last_peered":"2024-04-25T12:21:29.547074+0000","last_clean":"2024-04-25T12:21:29.547074+0000","last_became_active":"2024-04-25T12:21:24.111430+0000","last_became_peered":"2024-04-25T12:21:24.111430+0000","last_unstale":"2024-04-25T12:21:29.547074+0000","last_undegraded":"2024-04-25T12:21:29.547074+0000","last_fullsized":"2024-04-25T12:21:29.547074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:58.325720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.550155+0000","last_change":"2024-04-25T12:21:23.124271+0000","last_active":"2024-04-25T12:21:29.550155+0000","last_peered":"2024-04-25T12:21:29.550155+0000","last_clean":"2024-04-25T12:21:29.550155+0000","last_became_active":"2024-04-25T12:21:23.123492+0000","last_became_peered":"2024-04-25T12:21:23.123492+0000","last_unstale":"2024-04-25T12:21:29.550155+0000","last_undegraded":"2024-04-25T12:21:29.550155+0000","last_fullsized":"2024-04-25T12:21:29.550155+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:31:09.080478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.546586+0000","last_change":"2024-04-25T12:21:28.375801+0000","last_active":"2024-04-25T12:21:29.546586+0000","last_peered":"2024-04-25T12:21:29.546586+0000","last_clean":"2024-04-25T12:21:29.546586+0000","last_became_active":"2024-04-25T12:21:28.375119+0000","last_became_peered":"2024-04-25T12:21:28.375119+0000","last_unstale":"2024-04-25T12:21:29.546586+0000","last_undegraded":"2024-04-25T12:21:29.546586+0000","last_fullsized":"2024-04-25T12:21:29.546586+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:00:29.908954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.169044+0000","last_change":"2024-04-25T12:21:24.131673+0000","last_active":"2024-04-25T12:21:29.169044+0000","last_peered":"2024-04-25T12:21:29.169044+0000","last_clean":"2024-04-25T12:21:29.169044+0000","last_became_active":"2024-04-25T12:21:24.130866+0000","last_became_peered":"2024-04-25T12:21:24.130866+0000","last_unstale":"2024-04-25T12:21:29.169044+0000","last_undegraded":"2024-04-25T12:21:29.169044+0000","last_fullsized":"2024-04-25T12:21:29.169044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:09:04.327157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547130+0000","last_change":"2024-04-25T12:21:23.106785+0000","last_active":"2024-04-25T12:21:29.547130+0000","last_peered":"2024-04-25T12:21:29.547130+0000","last_clean":"2024-04-25T12:21:29.547130+0000","last_became_active":"2024-04-25T12:21:23.105809+0000","last_became_peered":"2024-04-25T12:21:23.105809+0000","last_unstale":"2024-04-25T12:21:29.547130+0000","last_undegraded":"2024-04-25T12:21:29.547130+0000","last_fullsized":"2024-04-25T12:21:29.547130+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:17.185116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.546915+0000","last_change":"2024-04-25T12:21:28.193242+0000","last_active":"2024-04-25T12:21:29.546915+0000","last_peered":"2024-04-25T12:21:29.546915+0000","last_clean":"2024-04-25T12:21:29.546915+0000","last_became_active":"2024-04-25T12:21:28.192835+0000","last_became_peered":"2024-04-25T12:21:28.192835+0000","last_unstale":"2024-04-25T12:21:29.546915+0000","last_undegraded":"2024-04-25T12:21:29.546915+0000","last_fullsized":"2024-04-25T12:21:29.546915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:42:52.476024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.167733+0000","last_change":"2024-04-25T12:21:24.128902+0000","last_active":"2024-04-25T12:21:29.167733+0000","last_peered":"2024-04-25T12:21:29.167733+0000","last_clean":"2024-04-25T12:21:29.167733+0000","last_became_active":"2024-04-25T12:21:24.124563+0000","last_became_peered":"2024-04-25T12:21:24.124563+0000","last_unstale":"2024-04-25T12:21:29.167733+0000","last_undegraded":"2024-04-25T12:21:29.167733+0000","last_fullsized":"2024-04-25T12:21:29.167733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:16.937980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.168141+0000","last_change":"2024-04-25T12:21:23.114222+0000","last_active":"2024-04-25T12:21:29.168141+0000","last_peered":"2024-04-25T12:21:29.168141+0000","last_clean":"2024-04-25T12:21:29.168141+0000","last_became_active":"2024-04-25T12:21:23.113504+0000","last_became_peered":"2024-04-25T12:21:23.113504+0000","last_unstale":"2024-04-25T12:21:29.168141+0000","last_undegraded":"2024-04-25T12:21:29.168141+0000","last_fullsized":"2024-04-25T12:21:29.168141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:37:42.382391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547040+0000","last_change":"2024-04-25T12:21:28.200532+0000","last_active":"2024-04-25T12:21:29.547040+0000","last_peered":"2024-04-25T12:21:29.547040+0000","last_clean":"2024-04-25T12:21:29.547040+0000","last_became_active":"2024-04-25T12:21:28.200082+0000","last_became_peered":"2024-04-25T12:21:28.200082+0000","last_unstale":"2024-04-25T12:21:29.547040+0000","last_undegraded":"2024-04-25T12:21:29.547040+0000","last_fullsized":"2024-04-25T12:21:29.547040+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:24.889665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547331+0000","last_change":"2024-04-25T12:21:24.112524+0000","last_active":"2024-04-25T12:21:29.547331+0000","last_peered":"2024-04-25T12:21:29.547331+0000","last_clean":"2024-04-25T12:21:29.547331+0000","last_became_active":"2024-04-25T12:21:24.111503+0000","last_became_peered":"2024-04-25T12:21:24.111503+0000","last_unstale":"2024-04-25T12:21:29.547331+0000","last_undegraded":"2024-04-25T12:21:29.547331+0000","last_fullsized":"2024-04-25T12:21:29.547331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:03:35.982959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.166343+0000","last_change":"2024-04-25T12:21:23.108434+0000","last_active":"2024-04-25T12:21:29.166343+0000","last_peered":"2024-04-25T12:21:29.166343+0000","last_clean":"2024-04-25T12:21:29.166343+0000","last_became_active":"2024-04-25T12:21:23.108051+0000","last_became_peered":"2024-04-25T12:21:23.108051+0000","last_unstale":"2024-04-25T12:21:29.166343+0000","last_undegraded":"2024-04-25T12:21:29.166343+0000","last_fullsized":"2024-04-25T12:21:29.166343+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:49.222950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.548093+0000","last_change":"2024-04-25T12:21:28.189825+0000","last_active":"2024-04-25T12:21:29.548093+0000","last_peered":"2024-04-25T12:21:29.548093+0000","last_clean":"2024-04-25T12:21:29.548093+0000","last_became_active":"2024-04-25T12:21:28.189247+0000","last_became_peered":"2024-04-25T12:21:28.189247+0000","last_unstale":"2024-04-25T12:21:29.548093+0000","last_undegraded":"2024-04-25T12:21:29.548093+0000","last_fullsized":"2024-04-25T12:21:29.548093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:54:02.752212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.546226+0000","last_change":"2024-04-25T12:21:24.105746+0000","last_active":"2024-04-25T12:21:29.546226+0000","last_peered":"2024-04-25T12:21:29.546226+0000","last_clean":"2024-04-25T12:21:29.546226+0000","last_became_active":"2024-04-25T12:21:24.104947+0000","last_became_peered":"2024-04-25T12:21:24.104947+0000","last_unstale":"2024-04-25T12:21:29.546226+0000","last_undegraded":"2024-04-25T12:21:29.546226+0000","last_fullsized":"2024-04-25T12:21:29.546226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:46:14.853789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.548699+0000","last_change":"2024-04-25T12:21:23.114591+0000","last_active":"2024-04-25T12:21:29.548699+0000","last_peered":"2024-04-25T12:21:29.548699+0000","last_clean":"2024-04-25T12:21:29.548699+0000","last_became_active":"2024-04-25T12:21:23.113829+0000","last_became_peered":"2024-04-25T12:21:23.113829+0000","last_unstale":"2024-04-25T12:21:29.548699+0000","last_undegraded":"2024-04-25T12:21:29.548699+0000","last_fullsized":"2024-04-25T12:21:29.548699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:51:38.471436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547750+0000","last_change":"2024-04-25T12:21:28.378024+0000","last_active":"2024-04-25T12:21:29.547750+0000","last_peered":"2024-04-25T12:21:29.547750+0000","last_clean":"2024-04-25T12:21:29.547750+0000","last_became_active":"2024-04-25T12:21:28.377639+0000","last_became_peered":"2024-04-25T12:21:28.377639+0000","last_unstale":"2024-04-25T12:21:29.547750+0000","last_undegraded":"2024-04-25T12:21:29.547750+0000","last_fullsized":"2024-04-25T12:21:29.547750+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:18:40.723659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.285268+0000","last_change":"2024-04-25T12:21:24.120719+0000","last_active":"2024-04-25T12:21:29.285268+0000","last_peered":"2024-04-25T12:21:29.285268+0000","last_clean":"2024-04-25T12:21:29.285268+0000","last_became_active":"2024-04-25T12:21:24.119870+0000","last_became_peered":"2024-04-25T12:21:24.119870+0000","last_unstale":"2024-04-25T12:21:29.285268+0000","last_undegraded":"2024-04-25T12:21:29.285268+0000","last_fullsized":"2024-04-25T12:21:29.285268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:53:15.175473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.168316+0000","last_change":"2024-04-25T12:21:23.103524+0000","last_active":"2024-04-25T12:21:29.168316+0000","last_peered":"2024-04-25T12:21:29.168316+0000","last_clean":"2024-04-25T12:21:29.168316+0000","last_became_active":"2024-04-25T12:21:23.102790+0000","last_became_peered":"2024-04-25T12:21:23.102790+0000","last_unstale":"2024-04-25T12:21:29.168316+0000","last_undegraded":"2024-04-25T12:21:29.168316+0000","last_fullsized":"2024-04-25T12:21:29.168316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:15:54.796303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.549016+0000","last_change":"2024-04-25T12:21:13.081186+0000","last_active":"2024-04-25T12:21:29.549016+0000","last_peered":"2024-04-25T12:21:29.549016+0000","last_clean":"2024-04-25T12:21:29.549016+0000","last_became_active":"2024-04-25T12:21:13.076753+0000","last_became_peered":"2024-04-25T12:21:13.076753+0000","last_unstale":"2024-04-25T12:21:29.549016+0000","last_undegraded":"2024-04-25T12:21:29.549016+0000","last_fullsized":"2024-04-25T12:21:29.549016+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:12.013694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:12.013694+0000","last_clean_scrub_stamp":"2024-04-25T12:21:12.013694+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:18:03.288120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.281646+0000","last_change":"2024-04-25T12:21:28.379372+0000","last_active":"2024-04-25T12:21:29.281646+0000","last_peered":"2024-04-25T12:21:29.281646+0000","last_clean":"2024-04-25T12:21:29.281646+0000","last_became_active":"2024-04-25T12:21:28.378522+0000","last_became_peered":"2024-04-25T12:21:28.378522+0000","last_unstale":"2024-04-25T12:21:29.281646+0000","last_undegraded":"2024-04-25T12:21:29.281646+0000","last_fullsized":"2024-04-25T12:21:29.281646+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:54:35.288829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.549343+0000","last_change":"2024-04-25T12:21:24.144632+0000","last_active":"2024-04-25T12:21:29.549343+0000","last_peered":"2024-04-25T12:21:29.549343+0000","last_clean":"2024-04-25T12:21:29.549343+0000","last_became_active":"2024-04-25T12:21:24.142085+0000","last_became_peered":"2024-04-25T12:21:24.142085+0000","last_unstale":"2024-04-25T12:21:29.549343+0000","last_undegraded":"2024-04-25T12:21:29.549343+0000","last_fullsized":"2024-04-25T12:21:29.549343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:16:55.634329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.166743+0000","last_change":"2024-04-25T12:21:23.126527+0000","last_active":"2024-04-25T12:21:29.166743+0000","last_peered":"2024-04-25T12:21:29.166743+0000","last_clean":"2024-04-25T12:21:29.166743+0000","last_became_active":"2024-04-25T12:21:23.126103+0000","last_became_peered":"2024-04-25T12:21:23.126103+0000","last_unstale":"2024-04-25T12:21:29.166743+0000","last_undegraded":"2024-04-25T12:21:29.166743+0000","last_fullsized":"2024-04-25T12:21:29.166743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:16:36.502824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.280872+0000","last_change":"2024-04-25T12:21:28.379480+0000","last_active":"2024-04-25T12:21:29.280872+0000","last_peered":"2024-04-25T12:21:29.280872+0000","last_clean":"2024-04-25T12:21:29.280872+0000","last_became_active":"2024-04-25T12:21:28.378559+0000","last_became_peered":"2024-04-25T12:21:28.378559+0000","last_unstale":"2024-04-25T12:21:29.280872+0000","last_undegraded":"2024-04-25T12:21:29.280872+0000","last_fullsized":"2024-04-25T12:21:29.280872+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:40.975592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.168315+0000","last_change":"2024-04-25T12:21:24.129518+0000","last_active":"2024-04-25T12:21:29.168315+0000","last_peered":"2024-04-25T12:21:29.168315+0000","last_clean":"2024-04-25T12:21:29.168315+0000","last_became_active":"2024-04-25T12:21:24.126968+0000","last_became_peered":"2024-04-25T12:21:24.126968+0000","last_unstale":"2024-04-25T12:21:29.168315+0000","last_undegraded":"2024-04-25T12:21:29.168315+0000","last_fullsized":"2024-04-25T12:21:29.168315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:49.243645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547717+0000","last_change":"2024-04-25T12:21:23.116529+0000","last_active":"2024-04-25T12:21:29.547717+0000","last_peered":"2024-04-25T12:21:29.547717+0000","last_clean":"2024-04-25T12:21:29.547717+0000","last_became_active":"2024-04-25T12:21:23.116148+0000","last_became_peered":"2024-04-25T12:21:23.116148+0000","last_unstale":"2024-04-25T12:21:29.547717+0000","last_undegraded":"2024-04-25T12:21:29.547717+0000","last_fullsized":"2024-04-25T12:21:29.547717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:01:45.567238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.546941+0000","last_change":"2024-04-25T12:21:28.194823+0000","last_active":"2024-04-25T12:21:29.546941+0000","last_peered":"2024-04-25T12:21:29.546941+0000","last_clean":"2024-04-25T12:21:29.546941+0000","last_became_active":"2024-04-25T12:21:28.194191+0000","last_became_peered":"2024-04-25T12:21:28.194191+0000","last_unstale":"2024-04-25T12:21:29.546941+0000","last_undegraded":"2024-04-25T12:21:29.546941+0000","last_fullsized":"2024-04-25T12:21:29.546941+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:50:30.454926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.550030+0000","last_change":"2024-04-25T12:21:24.146733+0000","last_active":"2024-04-25T12:21:29.550030+0000","last_peered":"2024-04-25T12:21:29.550030+0000","last_clean":"2024-04-25T12:21:29.550030+0000","last_became_active":"2024-04-25T12:21:24.145807+0000","last_became_peered":"2024-04-25T12:21:24.145807+0000","last_unstale":"2024-04-25T12:21:29.550030+0000","last_undegraded":"2024-04-25T12:21:29.550030+0000","last_fullsized":"2024-04-25T12:21:29.550030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:07:35.092827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.166946+0000","last_change":"2024-04-25T12:21:23.103393+0000","last_active":"2024-04-25T12:21:29.166946+0000","last_peered":"2024-04-25T12:21:29.166946+0000","last_clean":"2024-04-25T12:21:29.166946+0000","last_became_active":"2024-04-25T12:21:23.102997+0000","last_became_peered":"2024-04-25T12:21:23.102997+0000","last_unstale":"2024-04-25T12:21:29.166946+0000","last_undegraded":"2024-04-25T12:21:29.166946+0000","last_fullsized":"2024-04-25T12:21:29.166946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:40:23.054158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.167860+0000","last_change":"2024-04-25T12:21:28.384645+0000","last_active":"2024-04-25T12:21:29.167860+0000","last_peered":"2024-04-25T12:21:29.167860+0000","last_clean":"2024-04-25T12:21:29.167860+0000","last_became_active":"2024-04-25T12:21:28.382953+0000","last_became_peered":"2024-04-25T12:21:28.382953+0000","last_unstale":"2024-04-25T12:21:29.167860+0000","last_undegraded":"2024-04-25T12:21:29.167860+0000","last_fullsized":"2024-04-25T12:21:29.167860+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:40:56.218533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.549409+0000","last_change":"2024-04-25T12:21:24.146557+0000","last_active":"2024-04-25T12:21:29.549409+0000","last_peered":"2024-04-25T12:21:29.549409+0000","last_clean":"2024-04-25T12:21:29.549409+0000","last_became_active":"2024-04-25T12:21:24.146162+0000","last_became_peered":"2024-04-25T12:21:24.146162+0000","last_unstale":"2024-04-25T12:21:29.549409+0000","last_undegraded":"2024-04-25T12:21:29.549409+0000","last_fullsized":"2024-04-25T12:21:29.549409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:09:00.995503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.169245+0000","last_change":"2024-04-25T12:21:23.135467+0000","last_active":"2024-04-25T12:21:29.169245+0000","last_peered":"2024-04-25T12:21:29.169245+0000","last_clean":"2024-04-25T12:21:29.169245+0000","last_became_active":"2024-04-25T12:21:23.134441+0000","last_became_peered":"2024-04-25T12:21:23.134441+0000","last_unstale":"2024-04-25T12:21:29.169245+0000","last_undegraded":"2024-04-25T12:21:29.169245+0000","last_fullsized":"2024-04-25T12:21:29.169245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:44:33.069221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.165946+0000","last_change":"2024-04-25T12:21:28.202610+0000","last_active":"2024-04-25T12:21:29.165946+0000","last_peered":"2024-04-25T12:21:29.165946+0000","last_clean":"2024-04-25T12:21:29.165946+0000","last_became_active":"2024-04-25T12:21:28.201479+0000","last_became_peered":"2024-04-25T12:21:28.201479+0000","last_unstale":"2024-04-25T12:21:29.165946+0000","last_undegraded":"2024-04-25T12:21:29.165946+0000","last_fullsized":"2024-04-25T12:21:29.165946+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:25:15.458202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.548957+0000","last_change":"2024-04-25T12:21:24.145131+0000","last_active":"2024-04-25T12:21:29.548957+0000","last_peered":"2024-04-25T12:21:29.548957+0000","last_clean":"2024-04-25T12:21:29.548957+0000","last_became_active":"2024-04-25T12:21:24.142422+0000","last_became_peered":"2024-04-25T12:21:24.142422+0000","last_unstale":"2024-04-25T12:21:29.548957+0000","last_undegraded":"2024-04-25T12:21:29.548957+0000","last_fullsized":"2024-04-25T12:21:29.548957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:40:24.312543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.166123+0000","last_change":"2024-04-25T12:21:23.104288+0000","last_active":"2024-04-25T12:21:29.166123+0000","last_peered":"2024-04-25T12:21:29.166123+0000","last_clean":"2024-04-25T12:21:29.166123+0000","last_became_active":"2024-04-25T12:21:23.103680+0000","last_became_peered":"2024-04-25T12:21:23.103680+0000","last_unstale":"2024-04-25T12:21:29.166123+0000","last_undegraded":"2024-04-25T12:21:29.166123+0000","last_fullsized":"2024-04-25T12:21:29.166123+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:29.672890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547646+0000","last_change":"2024-04-25T12:21:28.199834+0000","last_active":"2024-04-25T12:21:29.547646+0000","last_peered":"2024-04-25T12:21:29.547646+0000","last_clean":"2024-04-25T12:21:29.547646+0000","last_became_active":"2024-04-25T12:21:28.199411+0000","last_became_peered":"2024-04-25T12:21:28.199411+0000","last_unstale":"2024-04-25T12:21:29.547646+0000","last_undegraded":"2024-04-25T12:21:29.547646+0000","last_fullsized":"2024-04-25T12:21:29.547646+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:52:34.443813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.280647+0000","last_change":"2024-04-25T12:21:24.127488+0000","last_active":"2024-04-25T12:21:29.280647+0000","last_peered":"2024-04-25T12:21:29.280647+0000","last_clean":"2024-04-25T12:21:29.280647+0000","last_became_active":"2024-04-25T12:21:24.126721+0000","last_became_peered":"2024-04-25T12:21:24.126721+0000","last_unstale":"2024-04-25T12:21:29.280647+0000","last_undegraded":"2024-04-25T12:21:29.280647+0000","last_fullsized":"2024-04-25T12:21:29.280647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:02.153025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.280911+0000","last_change":"2024-04-25T12:21:23.139626+0000","last_active":"2024-04-25T12:21:29.280911+0000","last_peered":"2024-04-25T12:21:29.280911+0000","last_clean":"2024-04-25T12:21:29.280911+0000","last_became_active":"2024-04-25T12:21:23.138837+0000","last_became_peered":"2024-04-25T12:21:23.138837+0000","last_unstale":"2024-04-25T12:21:29.280911+0000","last_undegraded":"2024-04-25T12:21:29.280911+0000","last_fullsized":"2024-04-25T12:21:29.280911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:09.309384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.286588+0000","last_change":"2024-04-25T12:21:28.383919+0000","last_active":"2024-04-25T12:21:29.286588+0000","last_peered":"2024-04-25T12:21:29.286588+0000","last_clean":"2024-04-25T12:21:29.286588+0000","last_became_active":"2024-04-25T12:21:28.383298+0000","last_became_peered":"2024-04-25T12:21:28.383298+0000","last_unstale":"2024-04-25T12:21:29.286588+0000","last_undegraded":"2024-04-25T12:21:29.286588+0000","last_fullsized":"2024-04-25T12:21:29.286588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:01.115040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.549858+0000","last_change":"2024-04-25T12:21:24.146454+0000","last_active":"2024-04-25T12:21:29.549858+0000","last_peered":"2024-04-25T12:21:29.549858+0000","last_clean":"2024-04-25T12:21:29.549858+0000","last_became_active":"2024-04-25T12:21:24.145931+0000","last_became_peered":"2024-04-25T12:21:24.145931+0000","last_unstale":"2024-04-25T12:21:29.549858+0000","last_undegraded":"2024-04-25T12:21:29.549858+0000","last_fullsized":"2024-04-25T12:21:29.549858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:35:22.490243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.168054+0000","last_change":"2024-04-25T12:21:23.122495+0000","last_active":"2024-04-25T12:21:29.168054+0000","last_peered":"2024-04-25T12:21:29.168054+0000","last_clean":"2024-04-25T12:21:29.168054+0000","last_became_active":"2024-04-25T12:21:23.121429+0000","last_became_peered":"2024-04-25T12:21:23.121429+0000","last_unstale":"2024-04-25T12:21:29.168054+0000","last_undegraded":"2024-04-25T12:21:29.168054+0000","last_fullsized":"2024-04-25T12:21:29.168054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:10.530248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.285955+0000","last_change":"2024-04-25T12:21:28.375971+0000","last_active":"2024-04-25T12:21:29.285955+0000","last_peered":"2024-04-25T12:21:29.285955+0000","last_clean":"2024-04-25T12:21:29.285955+0000","last_became_active":"2024-04-25T12:21:28.375013+0000","last_became_peered":"2024-04-25T12:21:28.375013+0000","last_unstale":"2024-04-25T12:21:29.285955+0000","last_undegraded":"2024-04-25T12:21:29.285955+0000","last_fullsized":"2024-04-25T12:21:29.285955+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:56:45.398763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.546876+0000","last_change":"2024-04-25T12:21:24.138293+0000","last_active":"2024-04-25T12:21:29.546876+0000","last_peered":"2024-04-25T12:21:29.546876+0000","last_clean":"2024-04-25T12:21:29.546876+0000","last_became_active":"2024-04-25T12:21:24.138016+0000","last_became_peered":"2024-04-25T12:21:24.138016+0000","last_unstale":"2024-04-25T12:21:29.546876+0000","last_undegraded":"2024-04-25T12:21:29.546876+0000","last_fullsized":"2024-04-25T12:21:29.546876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:48:54.078239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547256+0000","last_change":"2024-04-25T12:21:23.136227+0000","last_active":"2024-04-25T12:21:29.547256+0000","last_peered":"2024-04-25T12:21:29.547256+0000","last_clean":"2024-04-25T12:21:29.547256+0000","last_became_active":"2024-04-25T12:21:23.135947+0000","last_became_peered":"2024-04-25T12:21:23.135947+0000","last_unstale":"2024-04-25T12:21:29.547256+0000","last_undegraded":"2024-04-25T12:21:29.547256+0000","last_fullsized":"2024-04-25T12:21:29.547256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:41:24.323924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.168847+0000","last_change":"2024-04-25T12:21:28.378564+0000","last_active":"2024-04-25T12:21:29.168847+0000","last_peered":"2024-04-25T12:21:29.168847+0000","last_clean":"2024-04-25T12:21:29.168847+0000","last_became_active":"2024-04-25T12:21:28.377532+0000","last_became_peered":"2024-04-25T12:21:28.377532+0000","last_unstale":"2024-04-25T12:21:29.168847+0000","last_undegraded":"2024-04-25T12:21:29.168847+0000","last_fullsized":"2024-04-25T12:21:29.168847+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:20.576562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.549070+0000","last_change":"2024-04-25T12:21:24.148665+0000","last_active":"2024-04-25T12:21:29.549070+0000","last_peered":"2024-04-25T12:21:29.549070+0000","last_clean":"2024-04-25T12:21:29.549070+0000","last_became_active":"2024-04-25T12:21:24.142505+0000","last_became_peered":"2024-04-25T12:21:24.142505+0000","last_unstale":"2024-04-25T12:21:29.549070+0000","last_undegraded":"2024-04-25T12:21:29.549070+0000","last_fullsized":"2024-04-25T12:21:29.549070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:19:44.014834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:38.438513+0000","last_change":"2024-04-25T12:21:23.130231+0000","last_active":"2024-04-25T12:21:38.438513+0000","last_peered":"2024-04-25T12:21:38.438513+0000","last_clean":"2024-04-25T12:21:38.438513+0000","last_became_active":"2024-04-25T12:21:23.129474+0000","last_became_peered":"2024-04-25T12:21:23.129474+0000","last_unstale":"2024-04-25T12:21:38.438513+0000","last_undegraded":"2024-04-25T12:21:38.438513+0000","last_fullsized":"2024-04-25T12:21:38.438513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:50.974387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547082+0000","last_change":"2024-04-25T12:21:28.200551+0000","last_active":"2024-04-25T12:21:29.547082+0000","last_peered":"2024-04-25T12:21:29.547082+0000","last_clean":"2024-04-25T12:21:29.547082+0000","last_became_active":"2024-04-25T12:21:28.200152+0000","last_became_peered":"2024-04-25T12:21:28.200152+0000","last_unstale":"2024-04-25T12:21:29.547082+0000","last_undegraded":"2024-04-25T12:21:29.547082+0000","last_fullsized":"2024-04-25T12:21:29.547082+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:17:34.847925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.167585+0000","last_change":"2024-04-25T12:21:24.142957+0000","last_active":"2024-04-25T12:21:29.167585+0000","last_peered":"2024-04-25T12:21:29.167585+0000","last_clean":"2024-04-25T12:21:29.167585+0000","last_became_active":"2024-04-25T12:21:24.142594+0000","last_became_peered":"2024-04-25T12:21:24.142594+0000","last_unstale":"2024-04-25T12:21:29.167585+0000","last_undegraded":"2024-04-25T12:21:29.167585+0000","last_fullsized":"2024-04-25T12:21:29.167585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:36:47.719946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547660+0000","last_change":"2024-04-25T12:21:23.125118+0000","last_active":"2024-04-25T12:21:29.547660+0000","last_peered":"2024-04-25T12:21:29.547660+0000","last_clean":"2024-04-25T12:21:29.547660+0000","last_became_active":"2024-04-25T12:21:23.124836+0000","last_became_peered":"2024-04-25T12:21:23.124836+0000","last_unstale":"2024-04-25T12:21:29.547660+0000","last_undegraded":"2024-04-25T12:21:29.547660+0000","last_fullsized":"2024-04-25T12:21:29.547660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:03:28.500940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.167503+0000","last_change":"2024-04-25T12:21:28.194476+0000","last_active":"2024-04-25T12:21:29.167503+0000","last_peered":"2024-04-25T12:21:29.167503+0000","last_clean":"2024-04-25T12:21:29.167503+0000","last_became_active":"2024-04-25T12:21:28.193277+0000","last_became_peered":"2024-04-25T12:21:28.193277+0000","last_unstale":"2024-04-25T12:21:29.167503+0000","last_undegraded":"2024-04-25T12:21:29.167503+0000","last_fullsized":"2024-04-25T12:21:29.167503+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:31.495441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547391+0000","last_change":"2024-04-25T12:21:24.115104+0000","last_active":"2024-04-25T12:21:29.547391+0000","last_peered":"2024-04-25T12:21:29.547391+0000","last_clean":"2024-04-25T12:21:29.547391+0000","last_became_active":"2024-04-25T12:21:24.114367+0000","last_became_peered":"2024-04-25T12:21:24.114367+0000","last_unstale":"2024-04-25T12:21:29.547391+0000","last_undegraded":"2024-04-25T12:21:29.547391+0000","last_fullsized":"2024-04-25T12:21:29.547391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:03.107076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.168564+0000","last_change":"2024-04-25T12:21:23.132996+0000","last_active":"2024-04-25T12:21:29.168564+0000","last_peered":"2024-04-25T12:21:29.168564+0000","last_clean":"2024-04-25T12:21:29.168564+0000","last_became_active":"2024-04-25T12:21:23.132223+0000","last_became_peered":"2024-04-25T12:21:23.132223+0000","last_unstale":"2024-04-25T12:21:29.168564+0000","last_undegraded":"2024-04-25T12:21:29.168564+0000","last_fullsized":"2024-04-25T12:21:29.168564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:18.689461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.285114+0000","last_change":"2024-04-25T12:21:28.203302+0000","last_active":"2024-04-25T12:21:29.285114+0000","last_peered":"2024-04-25T12:21:29.285114+0000","last_clean":"2024-04-25T12:21:29.285114+0000","last_became_active":"2024-04-25T12:21:28.202800+0000","last_became_peered":"2024-04-25T12:21:28.202800+0000","last_unstale":"2024-04-25T12:21:29.285114+0000","last_undegraded":"2024-04-25T12:21:29.285114+0000","last_fullsized":"2024-04-25T12:21:29.285114+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:27:16.676736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.169161+0000","last_change":"2024-04-25T12:21:24.142716+0000","last_active":"2024-04-25T12:21:29.169161+0000","last_peered":"2024-04-25T12:21:29.169161+0000","last_clean":"2024-04-25T12:21:29.169161+0000","last_became_active":"2024-04-25T12:21:24.142363+0000","last_became_peered":"2024-04-25T12:21:24.142363+0000","last_unstale":"2024-04-25T12:21:29.169161+0000","last_undegraded":"2024-04-25T12:21:29.169161+0000","last_fullsized":"2024-04-25T12:21:29.169161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:02.153025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.281923+0000","last_change":"2024-04-25T12:21:23.130843+0000","last_active":"2024-04-25T12:21:29.281923+0000","last_peered":"2024-04-25T12:21:29.281923+0000","last_clean":"2024-04-25T12:21:29.281923+0000","last_became_active":"2024-04-25T12:21:23.129967+0000","last_became_peered":"2024-04-25T12:21:23.129967+0000","last_unstale":"2024-04-25T12:21:29.281923+0000","last_undegraded":"2024-04-25T12:21:29.281923+0000","last_fullsized":"2024-04-25T12:21:29.281923+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:19:22.719364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.285047+0000","last_change":"2024-04-25T12:21:28.384082+0000","last_active":"2024-04-25T12:21:29.285047+0000","last_peered":"2024-04-25T12:21:29.285047+0000","last_clean":"2024-04-25T12:21:29.285047+0000","last_became_active":"2024-04-25T12:21:28.383228+0000","last_became_peered":"2024-04-25T12:21:28.383228+0000","last_unstale":"2024-04-25T12:21:29.285047+0000","last_undegraded":"2024-04-25T12:21:29.285047+0000","last_fullsized":"2024-04-25T12:21:29.285047+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:14.600341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547535+0000","last_change":"2024-04-25T12:21:28.378352+0000","last_active":"2024-04-25T12:21:29.547535+0000","last_peered":"2024-04-25T12:21:29.547535+0000","last_clean":"2024-04-25T12:21:29.547535+0000","last_became_active":"2024-04-25T12:21:28.377742+0000","last_became_peered":"2024-04-25T12:21:28.377742+0000","last_unstale":"2024-04-25T12:21:29.547535+0000","last_undegraded":"2024-04-25T12:21:29.547535+0000","last_fullsized":"2024-04-25T12:21:29.547535+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:20.075296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.546465+0000","last_change":"2024-04-25T12:21:24.126158+0000","last_active":"2024-04-25T12:21:29.546465+0000","last_peered":"2024-04-25T12:21:29.546465+0000","last_clean":"2024-04-25T12:21:29.546465+0000","last_became_active":"2024-04-25T12:21:24.125448+0000","last_became_peered":"2024-04-25T12:21:24.125448+0000","last_unstale":"2024-04-25T12:21:29.546465+0000","last_undegraded":"2024-04-25T12:21:29.546465+0000","last_fullsized":"2024-04-25T12:21:29.546465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:42.769206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.168026+0000","last_change":"2024-04-25T12:21:23.117159+0000","last_active":"2024-04-25T12:21:29.168026+0000","last_peered":"2024-04-25T12:21:29.168026+0000","last_clean":"2024-04-25T12:21:29.168026+0000","last_became_active":"2024-04-25T12:21:23.115911+0000","last_became_peered":"2024-04-25T12:21:23.115911+0000","last_unstale":"2024-04-25T12:21:29.168026+0000","last_undegraded":"2024-04-25T12:21:29.168026+0000","last_fullsized":"2024-04-25T12:21:29.168026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:46:10.238958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.281751+0000","last_change":"2024-04-25T12:21:28.205952+0000","last_active":"2024-04-25T12:21:29.281751+0000","last_peered":"2024-04-25T12:21:29.281751+0000","last_clean":"2024-04-25T12:21:29.281751+0000","last_became_active":"2024-04-25T12:21:28.204472+0000","last_became_peered":"2024-04-25T12:21:28.204472+0000","last_unstale":"2024-04-25T12:21:29.281751+0000","last_undegraded":"2024-04-25T12:21:29.281751+0000","last_fullsized":"2024-04-25T12:21:29.281751+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:16:03.460343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.285501+0000","last_change":"2024-04-25T12:21:24.137477+0000","last_active":"2024-04-25T12:21:29.285501+0000","last_peered":"2024-04-25T12:21:29.285501+0000","last_clean":"2024-04-25T12:21:29.285501+0000","last_became_active":"2024-04-25T12:21:24.137078+0000","last_became_peered":"2024-04-25T12:21:24.137078+0000","last_unstale":"2024-04-25T12:21:29.285501+0000","last_undegraded":"2024-04-25T12:21:29.285501+0000","last_fullsized":"2024-04-25T12:21:29.285501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:53.321239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.285357+0000","last_change":"2024-04-25T12:21:23.130046+0000","last_active":"2024-04-25T12:21:29.285357+0000","last_peered":"2024-04-25T12:21:29.285357+0000","last_clean":"2024-04-25T12:21:29.285357+0000","last_became_active":"2024-04-25T12:21:23.129779+0000","last_became_peered":"2024-04-25T12:21:23.129779+0000","last_unstale":"2024-04-25T12:21:29.285357+0000","last_undegraded":"2024-04-25T12:21:29.285357+0000","last_fullsized":"2024-04-25T12:21:29.285357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:24:43.733780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.281044+0000","last_change":"2024-04-25T12:21:23.138152+0000","last_active":"2024-04-25T12:21:29.281044+0000","last_peered":"2024-04-25T12:21:29.281044+0000","last_clean":"2024-04-25T12:21:29.281044+0000","last_became_active":"2024-04-25T12:21:23.137393+0000","last_became_peered":"2024-04-25T12:21:23.137393+0000","last_unstale":"2024-04-25T12:21:29.281044+0000","last_undegraded":"2024-04-25T12:21:29.281044+0000","last_fullsized":"2024-04-25T12:21:29.281044+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:10:42.713304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547129+0000","last_change":"2024-04-25T12:21:24.122299+0000","last_active":"2024-04-25T12:21:29.547129+0000","last_peered":"2024-04-25T12:21:29.547129+0000","last_clean":"2024-04-25T12:21:29.547129+0000","last_became_active":"2024-04-25T12:21:24.121480+0000","last_became_peered":"2024-04-25T12:21:24.121480+0000","last_unstale":"2024-04-25T12:21:29.547129+0000","last_undegraded":"2024-04-25T12:21:29.547129+0000","last_fullsized":"2024-04-25T12:21:29.547129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:05:46.050357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.166540+0000","last_change":"2024-04-25T12:21:28.183735+0000","last_active":"2024-04-25T12:21:29.166540+0000","last_peered":"2024-04-25T12:21:29.166540+0000","last_clean":"2024-04-25T12:21:29.166540+0000","last_became_active":"2024-04-25T12:21:28.183319+0000","last_became_peered":"2024-04-25T12:21:28.183319+0000","last_unstale":"2024-04-25T12:21:29.166540+0000","last_undegraded":"2024-04-25T12:21:29.166540+0000","last_fullsized":"2024-04-25T12:21:29.166540+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:42:14.120075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.285705+0000","last_change":"2024-04-25T12:21:23.113080+0000","last_active":"2024-04-25T12:21:29.285705+0000","last_peered":"2024-04-25T12:21:29.285705+0000","last_clean":"2024-04-25T12:21:29.285705+0000","last_became_active":"2024-04-25T12:21:23.112721+0000","last_became_peered":"2024-04-25T12:21:23.112721+0000","last_unstale":"2024-04-25T12:21:29.285705+0000","last_undegraded":"2024-04-25T12:21:29.285705+0000","last_fullsized":"2024-04-25T12:21:29.285705+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:25.396377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.167162+0000","last_change":"2024-04-25T12:21:24.134267+0000","last_active":"2024-04-25T12:21:29.167162+0000","last_peered":"2024-04-25T12:21:29.167162+0000","last_clean":"2024-04-25T12:21:29.167162+0000","last_became_active":"2024-04-25T12:21:24.133493+0000","last_became_peered":"2024-04-25T12:21:24.133493+0000","last_unstale":"2024-04-25T12:21:29.167162+0000","last_undegraded":"2024-04-25T12:21:29.167162+0000","last_fullsized":"2024-04-25T12:21:29.167162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:24:25.810067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.286483+0000","last_change":"2024-04-25T12:21:28.188314+0000","last_active":"2024-04-25T12:21:29.286483+0000","last_peered":"2024-04-25T12:21:29.286483+0000","last_clean":"2024-04-25T12:21:29.286483+0000","last_became_active":"2024-04-25T12:21:28.187955+0000","last_became_peered":"2024-04-25T12:21:28.187955+0000","last_unstale":"2024-04-25T12:21:29.286483+0000","last_undegraded":"2024-04-25T12:21:29.286483+0000","last_fullsized":"2024-04-25T12:21:29.286483+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:17.889868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.280334+0000","last_change":"2024-04-25T12:21:24.126582+0000","last_active":"2024-04-25T12:21:29.280334+0000","last_peered":"2024-04-25T12:21:29.280334+0000","last_clean":"2024-04-25T12:21:29.280334+0000","last_became_active":"2024-04-25T12:21:24.125831+0000","last_became_peered":"2024-04-25T12:21:24.125831+0000","last_unstale":"2024-04-25T12:21:29.280334+0000","last_undegraded":"2024-04-25T12:21:29.280334+0000","last_fullsized":"2024-04-25T12:21:29.280334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:53.129274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.166193+0000","last_change":"2024-04-25T12:21:24.117441+0000","last_active":"2024-04-25T12:21:29.166193+0000","last_peered":"2024-04-25T12:21:29.166193+0000","last_clean":"2024-04-25T12:21:29.166193+0000","last_became_active":"2024-04-25T12:21:24.116498+0000","last_became_peered":"2024-04-25T12:21:24.116498+0000","last_unstale":"2024-04-25T12:21:29.166193+0000","last_undegraded":"2024-04-25T12:21:29.166193+0000","last_fullsized":"2024-04-25T12:21:29.166193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:06:45.632199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.167962+0000","last_change":"2024-04-25T12:21:24.117995+0000","last_active":"2024-04-25T12:21:29.167962+0000","last_peered":"2024-04-25T12:21:29.167962+0000","last_clean":"2024-04-25T12:21:29.167962+0000","last_became_active":"2024-04-25T12:21:24.114742+0000","last_became_peered":"2024-04-25T12:21:24.114742+0000","last_unstale":"2024-04-25T12:21:29.167962+0000","last_undegraded":"2024-04-25T12:21:29.167962+0000","last_fullsized":"2024-04-25T12:21:29.167962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:59.864082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547009+0000","last_change":"2024-04-25T12:21:24.134863+0000","last_active":"2024-04-25T12:21:29.547009+0000","last_peered":"2024-04-25T12:21:29.547009+0000","last_clean":"2024-04-25T12:21:29.547009+0000","last_became_active":"2024-04-25T12:21:24.126476+0000","last_became_peered":"2024-04-25T12:21:24.126476+0000","last_unstale":"2024-04-25T12:21:29.547009+0000","last_undegraded":"2024-04-25T12:21:29.547009+0000","last_fullsized":"2024-04-25T12:21:29.547009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:19:32.516429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.286222+0000","last_change":"2024-04-25T12:21:24.135699+0000","last_active":"2024-04-25T12:21:29.286222+0000","last_peered":"2024-04-25T12:21:29.286222+0000","last_clean":"2024-04-25T12:21:29.286222+0000","last_became_active":"2024-04-25T12:21:24.135257+0000","last_became_peered":"2024-04-25T12:21:24.135257+0000","last_unstale":"2024-04-25T12:21:29.286222+0000","last_undegraded":"2024-04-25T12:21:29.286222+0000","last_fullsized":"2024-04-25T12:21:29.286222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:55:21.195220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547552+0000","last_change":"2024-04-25T12:21:24.132760+0000","last_active":"2024-04-25T12:21:29.547552+0000","last_peered":"2024-04-25T12:21:29.547552+0000","last_clean":"2024-04-25T12:21:29.547552+0000","last_became_active":"2024-04-25T12:21:24.132225+0000","last_became_peered":"2024-04-25T12:21:24.132225+0000","last_unstale":"2024-04-25T12:21:29.547552+0000","last_undegraded":"2024-04-25T12:21:29.547552+0000","last_fullsized":"2024-04-25T12:21:29.547552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:44:23.025905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.281911+0000","last_change":"2024-04-25T12:21:24.148515+0000","last_active":"2024-04-25T12:21:29.281911+0000","last_peered":"2024-04-25T12:21:29.281911+0000","last_clean":"2024-04-25T12:21:29.281911+0000","last_became_active":"2024-04-25T12:21:24.148025+0000","last_became_peered":"2024-04-25T12:21:24.148025+0000","last_unstale":"2024-04-25T12:21:29.281911+0000","last_undegraded":"2024-04-25T12:21:29.281911+0000","last_fullsized":"2024-04-25T12:21:29.281911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:49:29.665678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.286467+0000","last_change":"2024-04-25T12:21:24.135856+0000","last_active":"2024-04-25T12:21:29.286467+0000","last_peered":"2024-04-25T12:21:29.286467+0000","last_clean":"2024-04-25T12:21:29.286467+0000","last_became_active":"2024-04-25T12:21:24.135310+0000","last_became_peered":"2024-04-25T12:21:24.135310+0000","last_unstale":"2024-04-25T12:21:29.286467+0000","last_undegraded":"2024-04-25T12:21:29.286467+0000","last_fullsized":"2024-04-25T12:21:29.286467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:02.396753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.167926+0000","last_change":"2024-04-25T12:21:24.119002+0000","last_active":"2024-04-25T12:21:29.167926+0000","last_peered":"2024-04-25T12:21:29.167926+0000","last_clean":"2024-04-25T12:21:29.167926+0000","last_became_active":"2024-04-25T12:21:24.112992+0000","last_became_peered":"2024-04-25T12:21:24.112992+0000","last_unstale":"2024-04-25T12:21:29.167926+0000","last_undegraded":"2024-04-25T12:21:29.167926+0000","last_fullsized":"2024-04-25T12:21:29.167926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:44:34.461656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.285101+0000","last_change":"2024-04-25T12:21:24.118251+0000","last_active":"2024-04-25T12:21:29.285101+0000","last_peered":"2024-04-25T12:21:29.285101+0000","last_clean":"2024-04-25T12:21:29.285101+0000","last_became_active":"2024-04-25T12:21:24.117412+0000","last_became_peered":"2024-04-25T12:21:24.117412+0000","last_unstale":"2024-04-25T12:21:29.285101+0000","last_undegraded":"2024-04-25T12:21:29.285101+0000","last_fullsized":"2024-04-25T12:21:29.285101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:44:13.238510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.167670+0000","last_change":"2024-04-25T12:21:24.138641+0000","last_active":"2024-04-25T12:21:29.167670+0000","last_peered":"2024-04-25T12:21:29.167670+0000","last_clean":"2024-04-25T12:21:29.167670+0000","last_became_active":"2024-04-25T12:21:24.137937+0000","last_became_peered":"2024-04-25T12:21:24.137937+0000","last_unstale":"2024-04-25T12:21:29.167670+0000","last_undegraded":"2024-04-25T12:21:29.167670+0000","last_fullsized":"2024-04-25T12:21:29.167670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:55:49.291319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.546657+0000","last_change":"2024-04-25T12:21:24.137779+0000","last_active":"2024-04-25T12:21:29.546657+0000","last_peered":"2024-04-25T12:21:29.546657+0000","last_clean":"2024-04-25T12:21:29.546657+0000","last_became_active":"2024-04-25T12:21:24.137431+0000","last_became_peered":"2024-04-25T12:21:24.137431+0000","last_unstale":"2024-04-25T12:21:29.546657+0000","last_undegraded":"2024-04-25T12:21:29.546657+0000","last_fullsized":"2024-04-25T12:21:29.546657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:24:24.181972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.281098+0000","last_change":"2024-04-25T12:21:24.128960+0000","last_active":"2024-04-25T12:21:29.281098+0000","last_peered":"2024-04-25T12:21:29.281098+0000","last_clean":"2024-04-25T12:21:29.281098+0000","last_became_active":"2024-04-25T12:21:24.128125+0000","last_became_peered":"2024-04-25T12:21:24.128125+0000","last_unstale":"2024-04-25T12:21:29.281098+0000","last_undegraded":"2024-04-25T12:21:29.281098+0000","last_fullsized":"2024-04-25T12:21:29.281098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:01.701850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.550097+0000","last_change":"2024-04-25T12:21:24.149001+0000","last_active":"2024-04-25T12:21:29.550097+0000","last_peered":"2024-04-25T12:21:29.550097+0000","last_clean":"2024-04-25T12:21:29.550097+0000","last_became_active":"2024-04-25T12:21:24.147230+0000","last_became_peered":"2024-04-25T12:21:24.147230+0000","last_unstale":"2024-04-25T12:21:29.550097+0000","last_undegraded":"2024-04-25T12:21:29.550097+0000","last_fullsized":"2024-04-25T12:21:29.550097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:05:17.824845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.166871+0000","last_change":"2024-04-25T12:21:24.119941+0000","last_active":"2024-04-25T12:21:29.166871+0000","last_peered":"2024-04-25T12:21:29.166871+0000","last_clean":"2024-04-25T12:21:29.166871+0000","last_became_active":"2024-04-25T12:21:24.118761+0000","last_became_peered":"2024-04-25T12:21:24.118761+0000","last_unstale":"2024-04-25T12:21:29.166871+0000","last_undegraded":"2024-04-25T12:21:29.166871+0000","last_fullsized":"2024-04-25T12:21:29.166871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:49:41.353812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.168941+0000","last_change":"2024-04-25T12:21:24.144163+0000","last_active":"2024-04-25T12:21:29.168941+0000","last_peered":"2024-04-25T12:21:29.168941+0000","last_clean":"2024-04-25T12:21:29.168941+0000","last_became_active":"2024-04-25T12:21:24.143786+0000","last_became_peered":"2024-04-25T12:21:24.143786+0000","last_unstale":"2024-04-25T12:21:29.168941+0000","last_undegraded":"2024-04-25T12:21:29.168941+0000","last_fullsized":"2024-04-25T12:21:29.168941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:17.961437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.167895+0000","last_change":"2024-04-25T12:21:24.107551+0000","last_active":"2024-04-25T12:21:29.167895+0000","last_peered":"2024-04-25T12:21:29.167895+0000","last_clean":"2024-04-25T12:21:29.167895+0000","last_became_active":"2024-04-25T12:21:24.106818+0000","last_became_peered":"2024-04-25T12:21:24.106818+0000","last_unstale":"2024-04-25T12:21:29.167895+0000","last_undegraded":"2024-04-25T12:21:29.167895+0000","last_fullsized":"2024-04-25T12:21:29.167895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:09:24.627007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.546570+0000","last_change":"2024-04-25T12:21:24.114917+0000","last_active":"2024-04-25T12:21:29.546570+0000","last_peered":"2024-04-25T12:21:29.546570+0000","last_clean":"2024-04-25T12:21:29.546570+0000","last_became_active":"2024-04-25T12:21:24.114237+0000","last_became_peered":"2024-04-25T12:21:24.114237+0000","last_unstale":"2024-04-25T12:21:29.546570+0000","last_undegraded":"2024-04-25T12:21:29.546570+0000","last_fullsized":"2024-04-25T12:21:29.546570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:32:38.296553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.546685+0000","last_change":"2024-04-25T12:21:24.132860+0000","last_active":"2024-04-25T12:21:29.546685+0000","last_peered":"2024-04-25T12:21:29.546685+0000","last_clean":"2024-04-25T12:21:29.546685+0000","last_became_active":"2024-04-25T12:21:24.132094+0000","last_became_peered":"2024-04-25T12:21:24.132094+0000","last_unstale":"2024-04-25T12:21:29.546685+0000","last_undegraded":"2024-04-25T12:21:29.546685+0000","last_fullsized":"2024-04-25T12:21:29.546685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:27:24.026145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.285468+0000","last_change":"2024-04-25T12:21:24.118083+0000","last_active":"2024-04-25T12:21:29.285468+0000","last_peered":"2024-04-25T12:21:29.285468+0000","last_clean":"2024-04-25T12:21:29.285468+0000","last_became_active":"2024-04-25T12:21:24.116766+0000","last_became_peered":"2024-04-25T12:21:24.116766+0000","last_unstale":"2024-04-25T12:21:29.285468+0000","last_undegraded":"2024-04-25T12:21:29.285468+0000","last_fullsized":"2024-04-25T12:21:29.285468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:02.432868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.167503+0000","last_change":"2024-04-25T12:21:24.124288+0000","last_active":"2024-04-25T12:21:29.167503+0000","last_peered":"2024-04-25T12:21:29.167503+0000","last_clean":"2024-04-25T12:21:29.167503+0000","last_became_active":"2024-04-25T12:21:24.116973+0000","last_became_peered":"2024-04-25T12:21:24.116973+0000","last_unstale":"2024-04-25T12:21:29.167503+0000","last_undegraded":"2024-04-25T12:21:29.167503+0000","last_fullsized":"2024-04-25T12:21:29.167503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:34:53.390321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.281584+0000","last_change":"2024-04-25T12:21:24.115615+0000","last_active":"2024-04-25T12:21:29.281584+0000","last_peered":"2024-04-25T12:21:29.281584+0000","last_clean":"2024-04-25T12:21:29.281584+0000","last_became_active":"2024-04-25T12:21:24.114829+0000","last_became_peered":"2024-04-25T12:21:24.114829+0000","last_unstale":"2024-04-25T12:21:29.281584+0000","last_undegraded":"2024-04-25T12:21:29.281584+0000","last_fullsized":"2024-04-25T12:21:29.281584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:17.961437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.281900+0000","last_change":"2024-04-25T12:21:24.117225+0000","last_active":"2024-04-25T12:21:29.281900+0000","last_peered":"2024-04-25T12:21:29.281900+0000","last_clean":"2024-04-25T12:21:29.281900+0000","last_became_active":"2024-04-25T12:21:24.116359+0000","last_became_peered":"2024-04-25T12:21:24.116359+0000","last_unstale":"2024-04-25T12:21:29.281900+0000","last_undegraded":"2024-04-25T12:21:29.281900+0000","last_fullsized":"2024-04-25T12:21:29.281900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:22:27.461512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.550024+0000","last_change":"2024-04-25T12:21:24.145198+0000","last_active":"2024-04-25T12:21:29.550024+0000","last_peered":"2024-04-25T12:21:29.550024+0000","last_clean":"2024-04-25T12:21:29.550024+0000","last_became_active":"2024-04-25T12:21:24.142353+0000","last_became_peered":"2024-04-25T12:21:24.142353+0000","last_unstale":"2024-04-25T12:21:29.550024+0000","last_undegraded":"2024-04-25T12:21:29.550024+0000","last_fullsized":"2024-04-25T12:21:29.550024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:44:24.335226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.285030+0000","last_change":"2024-04-25T12:21:24.128086+0000","last_active":"2024-04-25T12:21:29.285030+0000","last_peered":"2024-04-25T12:21:29.285030+0000","last_clean":"2024-04-25T12:21:29.285030+0000","last_became_active":"2024-04-25T12:21:24.127315+0000","last_became_peered":"2024-04-25T12:21:24.127315+0000","last_unstale":"2024-04-25T12:21:29.285030+0000","last_undegraded":"2024-04-25T12:21:29.285030+0000","last_fullsized":"2024-04-25T12:21:29.285030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:20.513145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.549407+0000","last_change":"2024-04-25T12:21:24.142394+0000","last_active":"2024-04-25T12:21:29.549407+0000","last_peered":"2024-04-25T12:21:29.549407+0000","last_clean":"2024-04-25T12:21:29.549407+0000","last_became_active":"2024-04-25T12:21:24.142029+0000","last_became_peered":"2024-04-25T12:21:24.142029+0000","last_unstale":"2024-04-25T12:21:29.549407+0000","last_undegraded":"2024-04-25T12:21:29.549407+0000","last_fullsized":"2024-04-25T12:21:29.549407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:02:56.129724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.167820+0000","last_change":"2024-04-25T12:21:24.113876+0000","last_active":"2024-04-25T12:21:29.167820+0000","last_peered":"2024-04-25T12:21:29.167820+0000","last_clean":"2024-04-25T12:21:29.167820+0000","last_became_active":"2024-04-25T12:21:24.112339+0000","last_became_peered":"2024-04-25T12:21:24.112339+0000","last_unstale":"2024-04-25T12:21:29.167820+0000","last_undegraded":"2024-04-25T12:21:29.167820+0000","last_fullsized":"2024-04-25T12:21:29.167820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:31:44.641068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.549669+0000","last_change":"2024-04-25T12:21:24.144879+0000","last_active":"2024-04-25T12:21:29.549669+0000","last_peered":"2024-04-25T12:21:29.549669+0000","last_clean":"2024-04-25T12:21:29.549669+0000","last_became_active":"2024-04-25T12:21:24.142422+0000","last_became_peered":"2024-04-25T12:21:24.142422+0000","last_unstale":"2024-04-25T12:21:29.549669+0000","last_undegraded":"2024-04-25T12:21:29.549669+0000","last_fullsized":"2024-04-25T12:21:29.549669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:03.206429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.168142+0000","last_change":"2024-04-25T12:21:24.132561+0000","last_active":"2024-04-25T12:21:29.168142+0000","last_peered":"2024-04-25T12:21:29.168142+0000","last_clean":"2024-04-25T12:21:29.168142+0000","last_became_active":"2024-04-25T12:21:24.131746+0000","last_became_peered":"2024-04-25T12:21:24.131746+0000","last_unstale":"2024-04-25T12:21:29.168142+0000","last_undegraded":"2024-04-25T12:21:29.168142+0000","last_fullsized":"2024-04-25T12:21:29.168142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:24.441417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.546747+0000","last_change":"2024-04-25T12:21:24.111956+0000","last_active":"2024-04-25T12:21:29.546747+0000","last_peered":"2024-04-25T12:21:29.546747+0000","last_clean":"2024-04-25T12:21:29.546747+0000","last_became_active":"2024-04-25T12:21:24.111154+0000","last_became_peered":"2024-04-25T12:21:24.111154+0000","last_unstale":"2024-04-25T12:21:29.546747+0000","last_undegraded":"2024-04-25T12:21:29.546747+0000","last_fullsized":"2024-04-25T12:21:29.546747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:39:56.070884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.548238+0000","last_change":"2024-04-25T12:21:24.134511+0000","last_active":"2024-04-25T12:21:29.548238+0000","last_peered":"2024-04-25T12:21:29.548238+0000","last_clean":"2024-04-25T12:21:29.548238+0000","last_became_active":"2024-04-25T12:21:24.133839+0000","last_became_peered":"2024-04-25T12:21:24.133839+0000","last_unstale":"2024-04-25T12:21:29.548238+0000","last_undegraded":"2024-04-25T12:21:29.548238+0000","last_fullsized":"2024-04-25T12:21:29.548238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:43.263673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.549724+0000","last_change":"2024-04-25T12:21:24.147519+0000","last_active":"2024-04-25T12:21:29.549724+0000","last_peered":"2024-04-25T12:21:29.549724+0000","last_clean":"2024-04-25T12:21:29.549724+0000","last_became_active":"2024-04-25T12:21:24.146805+0000","last_became_peered":"2024-04-25T12:21:24.146805+0000","last_unstale":"2024-04-25T12:21:29.549724+0000","last_undegraded":"2024-04-25T12:21:29.549724+0000","last_fullsized":"2024-04-25T12:21:29.549724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:23.200746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574860,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574861,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T12:21:55.633 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T12:21:55.633 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-25T12:21:55.633 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-25T12:21:55.634 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-25T12:21:55.634 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-25T12:21:55.790 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.782+0000 7ff8a580e640 1 Processor -- start 2024-04-25T12:21:55.790 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.782+0000 7ff8a580e640 1 -- start start 2024-04-25T12:21:55.792 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.782+0000 7ff8a580e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff8a00ca5a0 0x7ff8a0158a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:55.793 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.782+0000 7ff8a580e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff8a00723e0 0x7ff8a0151e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:55.793 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.782+0000 7ff8a580e640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8a00cca40 con 0x7ff8a00ca980 2024-04-25T12:21:55.793 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.782+0000 7ff8a580e640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7ff8a0158f40 con 0x7ff8a00723e0 2024-04-25T12:21:55.793 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.782+0000 7ff8a580e640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7ff8a006cae0 con 0x7ff8a00ca5a0 2024-04-25T12:21:55.793 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.786+0000 7ff8967fc640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7ff8a00ca980 0x7ff8a00cc120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:40836/0 (socket says 172.21.15.86:40836) 2024-04-25T12:21:55.793 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.786+0000 7ff8967fc640 1 -- 172.21.15.86:0/1577717132 learned_addr learned my addr 172.21.15.86:0/1577717132 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-04-25T12:21:55.793 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.786+0000 7ff89effd640 1 --2- 172.21.15.86:0/1577717132 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff8a00ca5a0 0x7ff8a0158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:55.793 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.786+0000 7ff89f7fe640 1 --2- 172.21.15.86:0/1577717132 >> v2:172.21.15.134:3300/0 conn(0x7ff8a00723e0 0x7ff8a0151e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:55.793 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.786+0000 7ff89e7fc640 1 -- 172.21.15.86:0/1577717132 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 944414735 0 0) 0x7ff8a00cca40 con 0x7ff8a00ca980 2024-04-25T12:21:55.793 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.786+0000 7ff89e7fc640 1 -- 172.21.15.86:0/1577717132 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff88c003530 con 0x7ff8a00ca980 2024-04-25T12:21:55.793 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.786+0000 7ff89e7fc640 1 -- 172.21.15.86:0/1577717132 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3894983705 0 0) 0x7ff88c003530 con 0x7ff8a00ca980 2024-04-25T12:21:55.793 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.786+0000 7ff89e7fc640 1 -- 172.21.15.86:0/1577717132 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff8a00ca5a0 msgr2=0x7ff8a0158a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:55.793 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.786+0000 7ff89e7fc640 1 --2- 172.21.15.86:0/1577717132 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff8a00ca5a0 0x7ff8a0158a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:55.793 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.786+0000 7ff89e7fc640 1 -- 172.21.15.86:0/1577717132 >> v2:172.21.15.134:3300/0 conn(0x7ff8a00723e0 msgr2=0x7ff8a0151e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:55.794 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.786+0000 7ff89e7fc640 1 --2- 172.21.15.86:0/1577717132 >> v2:172.21.15.134:3300/0 conn(0x7ff8a00723e0 0x7ff8a0151e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:55.794 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.786+0000 7ff89e7fc640 1 -- 172.21.15.86:0/1577717132 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8a006cd30 con 0x7ff8a00ca980 2024-04-25T12:21:55.794 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.786+0000 7ff89e7fc640 1 -- 172.21.15.86:0/1577717132 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1387950573 0 0) 0x7ff888001680 con 0x7ff8a00ca980 2024-04-25T12:21:55.794 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.786+0000 7ff89e7fc640 1 -- 172.21.15.86:0/1577717132 >> v1:172.21.15.86:6789/0 conn(0x7ff8a00ca980 legacy=0x7ff8a00cc120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:55.794 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.786+0000 7ff89e7fc640 1 --2- 172.21.15.86:0/1577717132 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff88c0039c0 0x7ff88c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:55.794 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.786+0000 7ff89e7fc640 1 --2- 172.21.15.86:0/1577717132 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff8a00ca5a0 0x7ff88c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:55.794 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.786+0000 7ff89e7fc640 1 --2- 172.21.15.86:0/1577717132 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff88c004d50 0x7ff88c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:55.794 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.786+0000 7ff89e7fc640 1 -- 172.21.15.86:0/1577717132 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a0158f40 con 0x7ff88c004d50 2024-04-25T12:21:55.794 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.786+0000 7ff89e7fc640 1 -- 172.21.15.86:0/1577717132 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a006cae0 con 0x7ff88c0039c0 2024-04-25T12:21:55.794 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.786+0000 7ff89e7fc640 1 -- 172.21.15.86:0/1577717132 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7ff88c00b9d0 con 0x7ff8a00ca5a0 2024-04-25T12:21:55.794 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.786+0000 7ff89f7fe640 1 --2- 172.21.15.86:0/1577717132 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff88c004d50 0x7ff88c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:55.794 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.786+0000 7ff89effd640 1 --2- 172.21.15.86:0/1577717132 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff88c0039c0 0x7ff88c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:55.794 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.786+0000 7ff89f7fe640 1 -- 172.21.15.86:0/1577717132 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff8a00ca5a0 msgr2=0x7ff88c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:55.795 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.786+0000 7ff89f7fe640 1 --2- 172.21.15.86:0/1577717132 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff8a00ca5a0 0x7ff88c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:55.795 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.786+0000 7ff89f7fe640 1 -- 172.21.15.86:0/1577717132 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff88c0039c0 msgr2=0x7ff88c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:55.795 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.786+0000 7ff89f7fe640 1 --2- 172.21.15.86:0/1577717132 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff88c0039c0 0x7ff88c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:55.795 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.786+0000 7ff89f7fe640 1 -- 172.21.15.86:0/1577717132 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff88c003530 con 0x7ff88c004d50 2024-04-25T12:21:55.795 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.786+0000 7ff89effd640 1 --2- 172.21.15.86:0/1577717132 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff88c0039c0 0x7ff88c003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:21:55.796 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.786+0000 7ff89f7fe640 1 --2- 172.21.15.86:0/1577717132 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff88c004d50 0x7ff88c0051d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff898009fc0 tx=0x7ff89801eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36e022280e451326 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:55.796 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.786+0000 7ff89e7fc640 1 -- 172.21.15.86:0/1577717132 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8980b4070 con 0x7ff88c004d50 2024-04-25T12:21:55.796 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.786+0000 7ff89e7fc640 1 -- 172.21.15.86:0/1577717132 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8980af440 con 0x7ff88c004d50 2024-04-25T12:21:55.796 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.786+0000 7ff89e7fc640 1 -- 172.21.15.86:0/1577717132 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff898009c10 con 0x7ff88c004d50 2024-04-25T12:21:55.797 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.786+0000 7ff8a580e640 1 -- 172.21.15.86:0/1577717132 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff88c004d50 msgr2=0x7ff88c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:55.797 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.790+0000 7ff8a580e640 1 --2- 172.21.15.86:0/1577717132 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff88c004d50 0x7ff88c0051d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff898009fc0 tx=0x7ff89801eed0 comp rx=0 tx=0).stop 2024-04-25T12:21:55.797 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.790+0000 7ff89f7fe640 1 -- 172.21.15.86:0/1577717132 reap_dead start 2024-04-25T12:21:55.797 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.790+0000 7ff8a580e640 1 -- 172.21.15.86:0/1577717132 shutdown_connections 2024-04-25T12:21:55.797 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.790+0000 7ff8a580e640 1 -- 172.21.15.86:0/1577717132 >> 172.21.15.86:0/1577717132 conn(0x7ff8a006fde0 msgr2=0x7ff8a00701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:55.797 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.790+0000 7ff8a580e640 1 -- 172.21.15.86:0/1577717132 shutdown_connections 2024-04-25T12:21:55.797 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.790+0000 7ff8a580e640 1 -- 172.21.15.86:0/1577717132 wait complete. 2024-04-25T12:21:55.797 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.790+0000 7ff8a580e640 1 Processor -- start 2024-04-25T12:21:55.797 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.790+0000 7ff8a580e640 1 -- start start 2024-04-25T12:21:55.799 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.790+0000 7ff8a580e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff88c004d50 0x7ff8a01dfc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:55.799 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.790+0000 7ff8a580e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff8a01482c0 0x7ff8a00c5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:55.799 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.790+0000 7ff8a580e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff8a0148700 0x7ff8a00c6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:55.799 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.790+0000 7ff8a580e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a006daf0 con 0x7ff8a01482c0 2024-04-25T12:21:55.799 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.790+0000 7ff8a580e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a006d660 con 0x7ff88c004d50 2024-04-25T12:21:55.799 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.790+0000 7ff8a580e640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7ff8a006d2f0 con 0x7ff8a0148700 2024-04-25T12:21:55.799 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.790+0000 7ff8967fc640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff8a01482c0 0x7ff8a00c5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:55.800 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.790+0000 7ff8967fc640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff8a01482c0 0x7ff8a00c5af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:59228/0 (socket says 172.21.15.86:59228) 2024-04-25T12:21:55.800 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.790+0000 7ff8967fc640 1 -- 172.21.15.86:0/2652548211 learned_addr learned my addr 172.21.15.86:0/2652548211 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:55.800 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.790+0000 7ff8967fc640 1 -- 172.21.15.86:0/2652548211 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff8a0148700 msgr2=0x7ff8a00c6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:55.800 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.790+0000 7ff8967fc640 1 --2- 172.21.15.86:0/2652548211 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff8a0148700 0x7ff8a00c6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:55.800 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.790+0000 7ff8967fc640 1 -- 172.21.15.86:0/2652548211 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff88c004d50 msgr2=0x7ff8a01dfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:55.800 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.790+0000 7ff8967fc640 1 --2- 172.21.15.86:0/2652548211 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff88c004d50 0x7ff8a01dfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:55.800 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.790+0000 7ff8967fc640 1 -- 172.21.15.86:0/2652548211 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8a01f08c0 con 0x7ff8a01482c0 2024-04-25T12:21:55.800 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.790+0000 7ff8967fc640 1 --2- 172.21.15.86:0/2652548211 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff8a01482c0 0x7ff8a00c5af0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff88800c700 tx=0x7ff88800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:55.800 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.790+0000 7ff89cff9640 1 -- 172.21.15.86:0/2652548211 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff888018070 con 0x7ff8a01482c0 2024-04-25T12:21:55.800 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.790+0000 7ff89cff9640 1 -- 172.21.15.86:0/2652548211 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff888007500 con 0x7ff8a01482c0 2024-04-25T12:21:55.800 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.790+0000 7ff8a580e640 1 -- 172.21.15.86:0/2652548211 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8a01f0ba0 con 0x7ff8a01482c0 2024-04-25T12:21:55.800 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.790+0000 7ff89cff9640 1 -- 172.21.15.86:0/2652548211 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff888004a30 con 0x7ff8a01482c0 2024-04-25T12:21:55.800 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.790+0000 7ff8a580e640 1 -- 172.21.15.86:0/2652548211 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8a01f1160 con 0x7ff8a01482c0 2024-04-25T12:21:55.801 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.790+0000 7ff8a580e640 1 -- 172.21.15.86:0/2652548211 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8a0075df0 con 0x7ff8a01482c0 2024-04-25T12:21:55.801 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.794+0000 7ff89cff9640 1 -- 172.21.15.86:0/2652548211 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff88801b070 con 0x7ff8a01482c0 2024-04-25T12:21:55.801 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.794+0000 7ff89cff9640 1 --2- 172.21.15.86:0/2652548211 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7ff880068380 0x7ff88006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:55.801 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.794+0000 7ff89cff9640 1 -- 172.21.15.86:0/2652548211 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff8880864c0 con 0x7ff8a01482c0 2024-04-25T12:21:55.801 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.794+0000 7ff89effd640 1 --2- 172.21.15.86:0/2652548211 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7ff880068380 0x7ff88006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:55.801 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.794+0000 7ff89effd640 1 --2- 172.21.15.86:0/2652548211 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7ff880068380 0x7ff88006a840 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff890009a00 tx=0x7ff890008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:55.803 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.798+0000 7ff89cff9640 1 -- 172.21.15.86:0/2652548211 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff888056790 con 0x7ff8a01482c0 2024-04-25T12:21:55.987 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.982+0000 7ff8a580e640 1 -- 172.21.15.86:0/2652548211 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7ff8a01e2180 con 0x7ff8a01482c0 2024-04-25T12:21:55.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.986+0000 7ff89cff9640 1 -- 172.21.15.86:0/2652548211 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+168085 (secure 0 0 0) 0x7ff888056090 con 0x7ff8a01482c0 2024-04-25T12:21:55.995 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:21:55.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.990+0000 7ff8a580e640 1 -- 172.21.15.86:0/2652548211 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7ff880068380 msgr2=0x7ff88006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:55.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.990+0000 7ff8a580e640 1 --2- 172.21.15.86:0/2652548211 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7ff880068380 0x7ff88006a840 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff890009a00 tx=0x7ff890008040 comp rx=0 tx=0).stop 2024-04-25T12:21:55.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.990+0000 7ff8a580e640 1 -- 172.21.15.86:0/2652548211 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff8a01482c0 msgr2=0x7ff8a00c5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:55.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.990+0000 7ff8a580e640 1 --2- 172.21.15.86:0/2652548211 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff8a01482c0 0x7ff8a00c5af0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff88800c700 tx=0x7ff88800cbc0 comp rx=0 tx=0).stop 2024-04-25T12:21:55.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.990+0000 7ff8a580e640 1 -- 172.21.15.86:0/2652548211 shutdown_connections 2024-04-25T12:21:55.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.990+0000 7ff8a580e640 1 --2- 172.21.15.86:0/2652548211 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff8a0148700 0x7ff8a00c6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:55.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.990+0000 7ff8a580e640 1 --2- 172.21.15.86:0/2652548211 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7ff880068380 0x7ff88006a840 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:55.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.990+0000 7ff8a580e640 1 --2- 172.21.15.86:0/2652548211 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff8a01482c0 0x7ff8a00c5af0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:55.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.990+0000 7ff8a580e640 1 --2- 172.21.15.86:0/2652548211 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff88c004d50 0x7ff8a01dfc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:55.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.990+0000 7ff8a580e640 1 -- 172.21.15.86:0/2652548211 >> 172.21.15.86:0/2652548211 conn(0x7ff8a006fde0 msgr2=0x7ff8a0146180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:55.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.990+0000 7ff8a580e640 1 -- 172.21.15.86:0/2652548211 shutdown_connections 2024-04-25T12:21:55.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:55.990+0000 7ff8a580e640 1 -- 172.21.15.86:0/2652548211 wait complete. 2024-04-25T12:21:56.012 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":5,"flags":0,"active_gid":4107,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":3708662606},{"type":"v1","addr":"172.21.15.86:6833","nonce":3708662606}]},"active_addr":"172.21.15.86:6833/3708662606","active_change":"2024-04-25T12:21:03.783718+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4100,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.86:0","nonce":2906386647}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.86:0","nonce":4182578501}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.86:0","nonce":1717148377}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.86:0","nonce":2113878195}]}]} 2024-04-25T12:21:56.016 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-25T12:21:56.016 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-25T12:21:56.016 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T12:21:56.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.126+0000 7f65053ff640 1 Processor -- start 2024-04-25T12:21:56.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.126+0000 7f65053ff640 1 -- start start 2024-04-25T12:21:56.137 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.130+0000 7f65053ff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f650006d1c0 0x7f65000703c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.137 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.130+0000 7f65053ff640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f650006d5a0 0x7f6500154da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.137 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.130+0000 7f65053ff640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65000709e0 con 0x7f65000c8340 2024-04-25T12:21:56.137 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.130+0000 7f65053ff640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f650015bf60 con 0x7f650006d1c0 2024-04-25T12:21:56.137 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.130+0000 7f65053ff640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f650015b350 con 0x7f650006d5a0 2024-04-25T12:21:56.138 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.130+0000 7f64f7fff640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f65000c8340 0x7f650015e8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:40850/0 (socket says 172.21.15.86:40850) 2024-04-25T12:21:56.138 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.130+0000 7f64f7fff640 1 -- 172.21.15.86:0/87985885 learned_addr learned my addr 172.21.15.86:0/87985885 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-04-25T12:21:56.138 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.130+0000 7f64ff7fe640 1 --2- 172.21.15.86:0/87985885 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f650006d5a0 0x7f6500154da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:56.138 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.130+0000 7f64feffd640 1 --2- 172.21.15.86:0/87985885 >> v2:172.21.15.134:3300/0 conn(0x7f650006d1c0 0x7f65000703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:56.138 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.130+0000 7f64fe7fc640 1 -- 172.21.15.86:0/87985885 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1703936594 0 0) 0x7f65000709e0 con 0x7f65000c8340 2024-04-25T12:21:56.138 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.130+0000 7f64fe7fc640 1 -- 172.21.15.86:0/87985885 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f64ec003530 con 0x7f65000c8340 2024-04-25T12:21:56.138 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.130+0000 7f64fe7fc640 1 -- 172.21.15.86:0/87985885 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 696982346 0 0) 0x7f64ec003530 con 0x7f65000c8340 2024-04-25T12:21:56.138 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.130+0000 7f64fe7fc640 1 -- 172.21.15.86:0/87985885 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f650006d5a0 msgr2=0x7f6500154da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:56.138 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.130+0000 7f64fe7fc640 1 --2- 172.21.15.86:0/87985885 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f650006d5a0 0x7f6500154da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.138 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.130+0000 7f64fe7fc640 1 -- 172.21.15.86:0/87985885 >> v2:172.21.15.134:3300/0 conn(0x7f650006d1c0 msgr2=0x7f65000703c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:56.138 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.130+0000 7f64fe7fc640 1 --2- 172.21.15.86:0/87985885 >> v2:172.21.15.134:3300/0 conn(0x7f650006d1c0 0x7f65000703c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.138 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.130+0000 7f64fe7fc640 1 -- 172.21.15.86:0/87985885 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f650015b630 con 0x7f65000c8340 2024-04-25T12:21:56.138 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.130+0000 7f64fe7fc640 1 -- 172.21.15.86:0/87985885 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1387950573 0 0) 0x7f64f0001680 con 0x7f65000c8340 2024-04-25T12:21:56.139 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.130+0000 7f64fe7fc640 1 -- 172.21.15.86:0/87985885 >> v1:172.21.15.86:6789/0 conn(0x7f65000c8340 legacy=0x7f650015e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:56.139 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.130+0000 7f64fe7fc640 1 --2- 172.21.15.86:0/87985885 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f650006d5a0 0x7f64ec0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.139 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.130+0000 7f64fe7fc640 1 --2- 172.21.15.86:0/87985885 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64ec003f60 0x7f64ec004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.139 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.130+0000 7f64fe7fc640 1 --2- 172.21.15.86:0/87985885 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64ec004d50 0x7f64ec0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.139 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.130+0000 7f64fe7fc640 1 -- 172.21.15.86:0/87985885 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f650015bf60 con 0x7f64ec003f60 2024-04-25T12:21:56.139 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.130+0000 7f64fe7fc640 1 -- 172.21.15.86:0/87985885 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f650015b350 con 0x7f64ec004d50 2024-04-25T12:21:56.139 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.130+0000 7f64fe7fc640 1 -- 172.21.15.86:0/87985885 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f64ec00ba20 con 0x7f650006d5a0 2024-04-25T12:21:56.139 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.130+0000 7f64f7fff640 1 --2- 172.21.15.86:0/87985885 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64ec003f60 0x7f64ec004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:56.139 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.130+0000 7f64f7fff640 1 -- 172.21.15.86:0/87985885 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f650006d5a0 msgr2=0x7f64ec0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:56.139 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.130+0000 7f64f7fff640 1 --2- 172.21.15.86:0/87985885 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f650006d5a0 0x7f64ec0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.139 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.130+0000 7f64f7fff640 1 -- 172.21.15.86:0/87985885 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64ec004d50 msgr2=0x7f64ec0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:56.139 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.130+0000 7f64f7fff640 1 --2- 172.21.15.86:0/87985885 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64ec004d50 0x7f64ec0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.139 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.130+0000 7f64f7fff640 1 -- 172.21.15.86:0/87985885 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64ec003530 con 0x7f64ec003f60 2024-04-25T12:21:56.140 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.134+0000 7f64f7fff640 1 --2- 172.21.15.86:0/87985885 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64ec003f60 0x7f64ec004810 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f64f000c190 tx=0x7f64f001cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6ac3a650fadec79 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:56.141 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.134+0000 7f64fe7fc640 1 -- 172.21.15.86:0/87985885 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64f0007d00 con 0x7f64ec003f60 2024-04-25T12:21:56.141 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.134+0000 7f64fe7fc640 1 -- 172.21.15.86:0/87985885 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64f00a9020 con 0x7f64ec003f60 2024-04-25T12:21:56.141 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.134+0000 7f64fe7fc640 1 -- 172.21.15.86:0/87985885 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64f00a5b40 con 0x7f64ec003f60 2024-04-25T12:21:56.141 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.134+0000 7f65053ff640 1 -- 172.21.15.86:0/87985885 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64ec003f60 msgr2=0x7f64ec004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:56.141 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.134+0000 7f65053ff640 1 --2- 172.21.15.86:0/87985885 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64ec003f60 0x7f64ec004810 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f64f000c190 tx=0x7f64f001cc40 comp rx=0 tx=0).stop 2024-04-25T12:21:56.141 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.134+0000 7f64ff7fe640 1 -- 172.21.15.86:0/87985885 reap_dead start 2024-04-25T12:21:56.141 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.134+0000 7f65053ff640 1 -- 172.21.15.86:0/87985885 shutdown_connections 2024-04-25T12:21:56.141 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.134+0000 7f65053ff640 1 -- 172.21.15.86:0/87985885 >> 172.21.15.86:0/87985885 conn(0x7f65000ca570 msgr2=0x7f65000ca980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:56.141 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.134+0000 7f65053ff640 1 -- 172.21.15.86:0/87985885 shutdown_connections 2024-04-25T12:21:56.141 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.134+0000 7f65053ff640 1 -- 172.21.15.86:0/87985885 wait complete. 2024-04-25T12:21:56.143 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.134+0000 7f65053ff640 1 Processor -- start 2024-04-25T12:21:56.144 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.134+0000 7f65053ff640 1 -- start start 2024-04-25T12:21:56.144 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.134+0000 7f65053ff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64ec003f60 0x7f650015ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.144 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.134+0000 7f65053ff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65001e7ef0 0x7f650014af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.144 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.134+0000 7f65053ff640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f65001e4430 0x7f650014b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.144 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.134+0000 7f65053ff640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f650015b000 con 0x7f65001e7ef0 2024-04-25T12:21:56.144 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.134+0000 7f65053ff640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f650015bbf0 con 0x7f64ec003f60 2024-04-25T12:21:56.144 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.134+0000 7f65053ff640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f65000c9db0 con 0x7f65001e4430 2024-04-25T12:21:56.144 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.134+0000 7f64f7fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65001e7ef0 0x7f650014af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:56.144 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.134+0000 7f64f7fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65001e7ef0 0x7f650014af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:59238/0 (socket says 172.21.15.86:59238) 2024-04-25T12:21:56.144 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.134+0000 7f64f7fff640 1 -- 172.21.15.86:0/3162877275 learned_addr learned my addr 172.21.15.86:0/3162877275 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:56.144 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.134+0000 7f64feffd640 1 --2- 172.21.15.86:0/3162877275 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64ec003f60 0x7f650015ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:56.144 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.134+0000 7f64ff7fe640 1 --2- 172.21.15.86:0/3162877275 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f65001e4430 0x7f650014b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:56.144 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.134+0000 7f64f7fff640 1 -- 172.21.15.86:0/3162877275 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f65001e4430 msgr2=0x7f650014b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:56.144 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.134+0000 7f64f7fff640 1 --2- 172.21.15.86:0/3162877275 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f65001e4430 0x7f650014b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.145 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.134+0000 7f64f7fff640 1 -- 172.21.15.86:0/3162877275 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64ec003f60 msgr2=0x7f650015ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:56.145 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.134+0000 7f64f7fff640 1 --2- 172.21.15.86:0/3162877275 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64ec003f60 0x7f650015ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.145 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.134+0000 7f64f7fff640 1 -- 172.21.15.86:0/3162877275 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65001e7140 con 0x7f65001e7ef0 2024-04-25T12:21:56.145 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.134+0000 7f64feffd640 1 --2- 172.21.15.86:0/3162877275 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64ec003f60 0x7f650015ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:21:56.145 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.134+0000 7f64f7fff640 1 --2- 172.21.15.86:0/3162877275 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65001e7ef0 0x7f650014af90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f64f0007040 tx=0x7f64ec005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:56.145 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.134+0000 7f64f77fe640 1 -- 172.21.15.86:0/3162877275 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64f00049f0 con 0x7f65001e7ef0 2024-04-25T12:21:56.145 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.134+0000 7f64f77fe640 1 -- 172.21.15.86:0/3162877275 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64f0000ee0 con 0x7f65001e7ef0 2024-04-25T12:21:56.145 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.134+0000 7f65053ff640 1 -- 172.21.15.86:0/3162877275 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65001e7420 con 0x7f65001e7ef0 2024-04-25T12:21:56.145 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.134+0000 7f64f77fe640 1 -- 172.21.15.86:0/3162877275 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64f0004dd0 con 0x7f65001e7ef0 2024-04-25T12:21:56.145 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.134+0000 7f65053ff640 1 -- 172.21.15.86:0/3162877275 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65001e79e0 con 0x7f65001e7ef0 2024-04-25T12:21:56.145 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.138+0000 7f65053ff640 1 -- 172.21.15.86:0/3162877275 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6500075df0 con 0x7f65001e7ef0 2024-04-25T12:21:56.146 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.138+0000 7f64f77fe640 1 -- 172.21.15.86:0/3162877275 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f64f0007070 con 0x7f65001e7ef0 2024-04-25T12:21:56.146 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.138+0000 7f64f77fe640 1 --2- 172.21.15.86:0/3162877275 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f64e00683b0 0x7f64e006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.146 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.138+0000 7f64f77fe640 1 -- 172.21.15.86:0/3162877275 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f64f0120f20 con 0x7f65001e7ef0 2024-04-25T12:21:56.146 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.138+0000 7f64feffd640 1 --2- 172.21.15.86:0/3162877275 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f64e00683b0 0x7f64e006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:56.146 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.138+0000 7f64feffd640 1 --2- 172.21.15.86:0/3162877275 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f64e00683b0 0x7f64e006a870 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f64e8009a40 tx=0x7f64e8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:56.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.142+0000 7f64f77fe640 1 -- 172.21.15.86:0/3162877275 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f64f0016950 con 0x7f65001e7ef0 2024-04-25T12:21:56.307 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.302+0000 7f65053ff640 1 -- 172.21.15.86:0/3162877275 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f65000c97f0 con 0x7f65001e7ef0 2024-04-25T12:21:56.311 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.302+0000 7f64f77fe640 1 -- 172.21.15.86:0/3162877275 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18514 (secure 0 0 0) 0x7f64f00f11a0 con 0x7f65001e7ef0 2024-04-25T12:21:56.311 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:21:56.311 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":24,"fsid":"f2ef5c0c-9576-4650-b4f7-6cb14247f62a","created":"2024-04-25T12:20:59.241733+0000","modified":"2024-04-25T12:21:28.541128+0000","last_up_change":"2024-04-25T12:21:10.939617+0000","last_in_change":"2024-04-25T12:21:01.534145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T12:21:11.839922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T12:21:21.854040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T12:21:22.406060+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T12:21:26.152386+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1f713f00-ef9f-4a6f-a620-38a8a1f8a822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6801","nonce":2812764579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6803","nonce":2812764579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6807","nonce":2812764579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6805","nonce":2812764579}]},"public_addr":"172.21.15.86:6801/2812764579","cluster_addr":"172.21.15.86:6803/2812764579","heartbeat_back_addr":"172.21.15.86:6807/2812764579","heartbeat_front_addr":"172.21.15.86:6805/2812764579","state":["exists","up"]},{"osd":1,"uuid":"baf6606d-a556-4fbe-a930-855e04ff1534","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6809","nonce":467966038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6811","nonce":467966038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6815","nonce":467966038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6813","nonce":467966038}]},"public_addr":"172.21.15.86:6809/467966038","cluster_addr":"172.21.15.86:6811/467966038","heartbeat_back_addr":"172.21.15.86:6815/467966038","heartbeat_front_addr":"172.21.15.86:6813/467966038","state":["exists","up"]},{"osd":2,"uuid":"c983d68e-6d60-434f-aed6-108420c5dd09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6817","nonce":3279762843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6820","nonce":3279762843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6825","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6827","nonce":3279762843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6824","nonce":3279762843}]},"public_addr":"172.21.15.86:6817/3279762843","cluster_addr":"172.21.15.86:6820/3279762843","heartbeat_back_addr":"172.21.15.86:6827/3279762843","heartbeat_front_addr":"172.21.15.86:6824/3279762843","state":["exists","up"]},{"osd":3,"uuid":"e77657bb-45aa-43bf-ab41-c7377eb495ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6821","nonce":2861354413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6826","nonce":2861354413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6831","nonce":2861354413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6829","nonce":2861354413}]},"public_addr":"172.21.15.86:6821/2861354413","cluster_addr":"172.21.15.86:6826/2861354413","heartbeat_back_addr":"172.21.15.86:6831/2861354413","heartbeat_front_addr":"172.21.15.86:6829/2861354413","state":["exists","up"]},{"osd":4,"uuid":"252bd300-d75a-4b00-be4b-27e6b51de4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6802","nonce":1872913602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6805","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6808","nonce":1872913602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6815","nonce":1872913602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6813","nonce":1872913602}]},"public_addr":"172.21.15.134:6802/1872913602","cluster_addr":"172.21.15.134:6808/1872913602","heartbeat_back_addr":"172.21.15.134:6815/1872913602","heartbeat_front_addr":"172.21.15.134:6813/1872913602","state":["exists","up"]},{"osd":5,"uuid":"4135da3f-7427-4409-a48e-78bd8a7b46ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6801","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6803","nonce":2261413981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6806","nonce":2261413981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6812","nonce":2261413981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6809","nonce":2261413981}]},"public_addr":"172.21.15.134:6803/2261413981","cluster_addr":"172.21.15.134:6806/2261413981","heartbeat_back_addr":"172.21.15.134:6812/2261413981","heartbeat_front_addr":"172.21.15.134:6809/2261413981","state":["exists","up"]},{"osd":6,"uuid":"b6e7a5f1-fa7e-497d-abac-a19994d26820","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6825","nonce":2841082767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6827","nonce":2841082767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6831","nonce":2841082767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6829","nonce":2841082767}]},"public_addr":"172.21.15.134:6825/2841082767","cluster_addr":"172.21.15.134:6827/2841082767","heartbeat_back_addr":"172.21.15.134:6831/2841082767","heartbeat_front_addr":"172.21.15.134:6829/2841082767","state":["exists","up"]},{"osd":7,"uuid":"c5597e50-1962-4103-9124-dd7bceb8ac97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6817","nonce":1277404274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6819","nonce":1277404274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6823","nonce":1277404274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6821","nonce":1277404274}]},"public_addr":"172.21.15.134:6817/1277404274","cluster_addr":"172.21.15.134:6819/1277404274","heartbeat_back_addr":"172.21.15.134:6823/1277404274","heartbeat_front_addr":"172.21.15.134:6821/1277404274","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.018125+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.157958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.113619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.136904+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.844514+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.872629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.775339+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.822867+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T12:21:56.313 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.306+0000 7f65053ff640 1 -- 172.21.15.86:0/3162877275 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f64e00683b0 msgr2=0x7f64e006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:56.313 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.306+0000 7f65053ff640 1 --2- 172.21.15.86:0/3162877275 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f64e00683b0 0x7f64e006a870 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f64e8009a40 tx=0x7f64e8008040 comp rx=0 tx=0).stop 2024-04-25T12:21:56.313 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.306+0000 7f65053ff640 1 -- 172.21.15.86:0/3162877275 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65001e7ef0 msgr2=0x7f650014af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:56.314 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.306+0000 7f65053ff640 1 --2- 172.21.15.86:0/3162877275 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65001e7ef0 0x7f650014af90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f64f0007040 tx=0x7f64ec005840 comp rx=0 tx=0).stop 2024-04-25T12:21:56.314 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.306+0000 7f65053ff640 1 -- 172.21.15.86:0/3162877275 shutdown_connections 2024-04-25T12:21:56.314 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.306+0000 7f65053ff640 1 --2- 172.21.15.86:0/3162877275 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f65001e4430 0x7f650014b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.314 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.306+0000 7f65053ff640 1 --2- 172.21.15.86:0/3162877275 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f64e00683b0 0x7f64e006a870 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.314 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.306+0000 7f65053ff640 1 --2- 172.21.15.86:0/3162877275 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65001e7ef0 0x7f650014af90 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.314 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.306+0000 7f65053ff640 1 --2- 172.21.15.86:0/3162877275 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64ec003f60 0x7f650015ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.314 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.306+0000 7f65053ff640 1 -- 172.21.15.86:0/3162877275 >> 172.21.15.86:0/3162877275 conn(0x7f65000ca570 msgr2=0x7f6500072950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:56.314 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.306+0000 7f65053ff640 1 -- 172.21.15.86:0/3162877275 shutdown_connections 2024-04-25T12:21:56.314 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.306+0000 7f65053ff640 1 -- 172.21.15.86:0/3162877275 wait complete. 2024-04-25T12:21:56.329 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-25T12:21:56.330 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T12:21:56.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.434+0000 7f4d79d44640 1 Processor -- start 2024-04-25T12:21:56.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.434+0000 7f4d79d44640 1 -- start start 2024-04-25T12:21:56.444 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.438+0000 7f4d79d44640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4d740c33b0 0x7f4d7406de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.444 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.438+0000 7f4d79d44640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d740c2740 con 0x7f4d7406da80 2024-04-25T12:21:56.444 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.438+0000 7f4d79d44640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d74067c00 con 0x7f4d7406e8e0 2024-04-25T12:21:56.444 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.438+0000 7f4d79d44640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f4d7415bb70 con 0x7f4d740c33b0 2024-04-25T12:21:56.444 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.438+0000 7f4d737fe640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f4d7406da80 0x7f4d740c7970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:40854/0 (socket says 172.21.15.86:40854) 2024-04-25T12:21:56.444 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.438+0000 7f4d737fe640 1 -- 172.21.15.86:0/1196277399 learned_addr learned my addr 172.21.15.86:0/1196277399 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-04-25T12:21:56.444 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.438+0000 7f4d72ffd640 1 --2- 172.21.15.86:0/1196277399 >> v2:172.21.15.86:3300/0 conn(0x7f4d740c33b0 0x7f4d7406de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:56.445 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.438+0000 7f4d727fc640 1 -- 172.21.15.86:0/1196277399 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3741878640 0 0) 0x7f4d640014a0 con 0x7f4d7406da80 2024-04-25T12:21:56.445 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.438+0000 7f4d727fc640 1 -- 172.21.15.86:0/1196277399 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d60003530 con 0x7f4d7406da80 2024-04-25T12:21:56.445 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.438+0000 7f4d727fc640 1 -- 172.21.15.86:0/1196277399 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3233322501 0 0) 0x7f4d60003530 con 0x7f4d7406da80 2024-04-25T12:21:56.445 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.438+0000 7f4d72ffd640 1 -- 172.21.15.86:0/1196277399 >> v1:172.21.15.134:6789/0 conn(0x7f4d7406e8e0 legacy=0x7f4d74165980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:56.445 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.438+0000 7f4d72ffd640 1 -- 172.21.15.86:0/1196277399 >> v1:172.21.15.86:6789/0 conn(0x7f4d7406da80 legacy=0x7f4d740c7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:56.445 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.438+0000 7f4d72ffd640 1 -- 172.21.15.86:0/1196277399 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d740676a0 con 0x7f4d740c33b0 2024-04-25T12:21:56.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.442+0000 7f4d72ffd640 1 --2- 172.21.15.86:0/1196277399 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d740c33b0 0x7f4d7406de60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c0097c0 tx=0x7f4d5c01eb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4194fc78326ec18 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:56.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.442+0000 7f4d727fc640 1 -- 172.21.15.86:0/1196277399 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c0b5070 con 0x7f4d740c33b0 2024-04-25T12:21:56.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.442+0000 7f4d727fc640 1 -- 172.21.15.86:0/1196277399 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d5c0a8630 con 0x7f4d740c33b0 2024-04-25T12:21:56.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.442+0000 7f4d727fc640 1 -- 172.21.15.86:0/1196277399 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d64001bd0 con 0x7f4d740c33b0 2024-04-25T12:21:56.451 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.442+0000 7f4d79d44640 1 -- 172.21.15.86:0/1196277399 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d740c33b0 msgr2=0x7f4d7406de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:56.451 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.442+0000 7f4d79d44640 1 --2- 172.21.15.86:0/1196277399 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d740c33b0 0x7f4d7406de60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c0097c0 tx=0x7f4d5c01eb70 comp rx=0 tx=0).stop 2024-04-25T12:21:56.451 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.442+0000 7f4d79d44640 1 -- 172.21.15.86:0/1196277399 shutdown_connections 2024-04-25T12:21:56.451 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.442+0000 7f4d79d44640 1 --2- 172.21.15.86:0/1196277399 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d740c33b0 0x7f4d7406de60 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.451 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.442+0000 7f4d79d44640 1 -- 172.21.15.86:0/1196277399 >> 172.21.15.86:0/1196277399 conn(0x7f4d740c9a70 msgr2=0x7f4d740c9e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:56.451 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.442+0000 7f4d79d44640 1 -- 172.21.15.86:0/1196277399 shutdown_connections 2024-04-25T12:21:56.451 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.442+0000 7f4d79d44640 1 -- 172.21.15.86:0/1196277399 wait complete. 2024-04-25T12:21:56.451 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.446+0000 7f4d79d44640 1 Processor -- start 2024-04-25T12:21:56.452 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.446+0000 7f4d79d44640 1 -- start start 2024-04-25T12:21:56.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.446+0000 7f4d79d44640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d7406da80 0x7f4d740c4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.446+0000 7f4d79d44640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d7406e8e0 0x7f4d7415a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.446+0000 7f4d79d44640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d740c33b0 0x7f4d74148a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.446+0000 7f4d79d44640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4d7415c000 con 0x7f4d7406da80 2024-04-25T12:21:56.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.446+0000 7f4d79d44640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4d7415b280 con 0x7f4d740c33b0 2024-04-25T12:21:56.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.446+0000 7f4d79d44640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f4d7415b520 con 0x7f4d7406e8e0 2024-04-25T12:21:56.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.446+0000 7f4d737fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d7406da80 0x7f4d740c4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:56.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.446+0000 7f4d737fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d7406da80 0x7f4d740c4370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:59262/0 (socket says 172.21.15.86:59262) 2024-04-25T12:21:56.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.446+0000 7f4d737fe640 1 -- 172.21.15.86:0/513711074 learned_addr learned my addr 172.21.15.86:0/513711074 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:56.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.446+0000 7f4d72ffd640 1 --2- 172.21.15.86:0/513711074 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d7406e8e0 0x7f4d7415a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:56.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.446+0000 7f4d73fff640 1 --2- 172.21.15.86:0/513711074 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d740c33b0 0x7f4d74148a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:56.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.446+0000 7f4d737fe640 1 -- 172.21.15.86:0/513711074 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d7406e8e0 msgr2=0x7f4d7415a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:56.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.446+0000 7f4d737fe640 1 --2- 172.21.15.86:0/513711074 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d7406e8e0 0x7f4d7415a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.455 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.446+0000 7f4d737fe640 1 -- 172.21.15.86:0/513711074 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d740c33b0 msgr2=0x7f4d74148a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:56.455 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.446+0000 7f4d737fe640 1 --2- 172.21.15.86:0/513711074 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d740c33b0 0x7f4d74148a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.455 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.446+0000 7f4d737fe640 1 -- 172.21.15.86:0/513711074 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d7414ec00 con 0x7f4d7406da80 2024-04-25T12:21:56.455 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.446+0000 7f4d737fe640 1 --2- 172.21.15.86:0/513711074 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d7406da80 0x7f4d740c4370 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4d64001af0 tx=0x7f4d6400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:56.455 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.446+0000 7f4d6bfff640 1 -- 172.21.15.86:0/513711074 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d64012400 con 0x7f4d7406da80 2024-04-25T12:21:56.455 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.446+0000 7f4d6bfff640 1 -- 172.21.15.86:0/513711074 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d640125a0 con 0x7f4d7406da80 2024-04-25T12:21:56.455 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.446+0000 7f4d79d44640 1 -- 172.21.15.86:0/513711074 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d740c4a00 con 0x7f4d7406da80 2024-04-25T12:21:56.455 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.446+0000 7f4d6bfff640 1 -- 172.21.15.86:0/513711074 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d640129d0 con 0x7f4d7406da80 2024-04-25T12:21:56.455 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.446+0000 7f4d79d44640 1 -- 172.21.15.86:0/513711074 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d741f4860 con 0x7f4d7406da80 2024-04-25T12:21:56.456 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.446+0000 7f4d79d44640 1 -- 172.21.15.86:0/513711074 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d74075df0 con 0x7f4d7406da80 2024-04-25T12:21:56.456 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.450+0000 7f4d6bfff640 1 -- 172.21.15.86:0/513711074 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4d64012b70 con 0x7f4d7406da80 2024-04-25T12:21:56.456 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.450+0000 7f4d6bfff640 1 --2- 172.21.15.86:0/513711074 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f4d54068380 0x7f4d5406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.456 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.450+0000 7f4d6bfff640 1 -- 172.21.15.86:0/513711074 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f4d64087670 con 0x7f4d7406da80 2024-04-25T12:21:56.456 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.450+0000 7f4d72ffd640 1 --2- 172.21.15.86:0/513711074 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f4d54068380 0x7f4d5406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:56.456 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.450+0000 7f4d72ffd640 1 --2- 172.21.15.86:0/513711074 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f4d54068380 0x7f4d5406a840 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c0b2000 tx=0x7f4d5c0aa070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:56.460 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.454+0000 7f4d6bfff640 1 -- 172.21.15.86:0/513711074 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4d740c2740 con 0x7f4d7406da80 2024-04-25T12:21:56.609 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.602+0000 7f4d79d44640 1 -- 172.21.15.86:0/513711074 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4d7406e6c0 con 0x7f4d7406da80 2024-04-25T12:21:56.612 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.606+0000 7f4d6bfff640 1 -- 172.21.15.86:0/513711074 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18514 (secure 0 0 0) 0x7f4d64057860 con 0x7f4d7406da80 2024-04-25T12:21:56.612 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:21:56.612 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":24,"fsid":"f2ef5c0c-9576-4650-b4f7-6cb14247f62a","created":"2024-04-25T12:20:59.241733+0000","modified":"2024-04-25T12:21:28.541128+0000","last_up_change":"2024-04-25T12:21:10.939617+0000","last_in_change":"2024-04-25T12:21:01.534145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T12:21:11.839922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T12:21:21.854040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T12:21:22.406060+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T12:21:26.152386+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1f713f00-ef9f-4a6f-a620-38a8a1f8a822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6801","nonce":2812764579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6803","nonce":2812764579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6807","nonce":2812764579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6805","nonce":2812764579}]},"public_addr":"172.21.15.86:6801/2812764579","cluster_addr":"172.21.15.86:6803/2812764579","heartbeat_back_addr":"172.21.15.86:6807/2812764579","heartbeat_front_addr":"172.21.15.86:6805/2812764579","state":["exists","up"]},{"osd":1,"uuid":"baf6606d-a556-4fbe-a930-855e04ff1534","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6809","nonce":467966038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6811","nonce":467966038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6815","nonce":467966038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6813","nonce":467966038}]},"public_addr":"172.21.15.86:6809/467966038","cluster_addr":"172.21.15.86:6811/467966038","heartbeat_back_addr":"172.21.15.86:6815/467966038","heartbeat_front_addr":"172.21.15.86:6813/467966038","state":["exists","up"]},{"osd":2,"uuid":"c983d68e-6d60-434f-aed6-108420c5dd09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6817","nonce":3279762843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6820","nonce":3279762843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6825","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6827","nonce":3279762843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6824","nonce":3279762843}]},"public_addr":"172.21.15.86:6817/3279762843","cluster_addr":"172.21.15.86:6820/3279762843","heartbeat_back_addr":"172.21.15.86:6827/3279762843","heartbeat_front_addr":"172.21.15.86:6824/3279762843","state":["exists","up"]},{"osd":3,"uuid":"e77657bb-45aa-43bf-ab41-c7377eb495ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6821","nonce":2861354413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6826","nonce":2861354413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6831","nonce":2861354413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6829","nonce":2861354413}]},"public_addr":"172.21.15.86:6821/2861354413","cluster_addr":"172.21.15.86:6826/2861354413","heartbeat_back_addr":"172.21.15.86:6831/2861354413","heartbeat_front_addr":"172.21.15.86:6829/2861354413","state":["exists","up"]},{"osd":4,"uuid":"252bd300-d75a-4b00-be4b-27e6b51de4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6802","nonce":1872913602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6805","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6808","nonce":1872913602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6815","nonce":1872913602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6813","nonce":1872913602}]},"public_addr":"172.21.15.134:6802/1872913602","cluster_addr":"172.21.15.134:6808/1872913602","heartbeat_back_addr":"172.21.15.134:6815/1872913602","heartbeat_front_addr":"172.21.15.134:6813/1872913602","state":["exists","up"]},{"osd":5,"uuid":"4135da3f-7427-4409-a48e-78bd8a7b46ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6801","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6803","nonce":2261413981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6806","nonce":2261413981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6812","nonce":2261413981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6809","nonce":2261413981}]},"public_addr":"172.21.15.134:6803/2261413981","cluster_addr":"172.21.15.134:6806/2261413981","heartbeat_back_addr":"172.21.15.134:6812/2261413981","heartbeat_front_addr":"172.21.15.134:6809/2261413981","state":["exists","up"]},{"osd":6,"uuid":"b6e7a5f1-fa7e-497d-abac-a19994d26820","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6825","nonce":2841082767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6827","nonce":2841082767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6831","nonce":2841082767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6829","nonce":2841082767}]},"public_addr":"172.21.15.134:6825/2841082767","cluster_addr":"172.21.15.134:6827/2841082767","heartbeat_back_addr":"172.21.15.134:6831/2841082767","heartbeat_front_addr":"172.21.15.134:6829/2841082767","state":["exists","up"]},{"osd":7,"uuid":"c5597e50-1962-4103-9124-dd7bceb8ac97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6817","nonce":1277404274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6819","nonce":1277404274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6823","nonce":1277404274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6821","nonce":1277404274}]},"public_addr":"172.21.15.134:6817/1277404274","cluster_addr":"172.21.15.134:6819/1277404274","heartbeat_back_addr":"172.21.15.134:6823/1277404274","heartbeat_front_addr":"172.21.15.134:6821/1277404274","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.018125+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.157958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.113619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.136904+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.844514+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.872629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.775339+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.822867+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T12:21:56.614 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.606+0000 7f4d79d44640 1 -- 172.21.15.86:0/513711074 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f4d54068380 msgr2=0x7f4d5406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:56.614 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.606+0000 7f4d79d44640 1 --2- 172.21.15.86:0/513711074 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f4d54068380 0x7f4d5406a840 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c0b2000 tx=0x7f4d5c0aa070 comp rx=0 tx=0).stop 2024-04-25T12:21:56.614 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.606+0000 7f4d79d44640 1 -- 172.21.15.86:0/513711074 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d7406da80 msgr2=0x7f4d740c4370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:56.615 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.606+0000 7f4d79d44640 1 --2- 172.21.15.86:0/513711074 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d7406da80 0x7f4d740c4370 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4d64001af0 tx=0x7f4d6400a430 comp rx=0 tx=0).stop 2024-04-25T12:21:56.615 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.606+0000 7f4d79d44640 1 -- 172.21.15.86:0/513711074 shutdown_connections 2024-04-25T12:21:56.615 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.606+0000 7f4d79d44640 1 --2- 172.21.15.86:0/513711074 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d740c33b0 0x7f4d74148a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.615 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.606+0000 7f4d79d44640 1 --2- 172.21.15.86:0/513711074 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d7406e8e0 0x7f4d7415a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.615 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.606+0000 7f4d79d44640 1 --2- 172.21.15.86:0/513711074 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f4d54068380 0x7f4d5406a840 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.615 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.606+0000 7f4d79d44640 1 --2- 172.21.15.86:0/513711074 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d7406da80 0x7f4d740c4370 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.615 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.606+0000 7f4d79d44640 1 -- 172.21.15.86:0/513711074 >> 172.21.15.86:0/513711074 conn(0x7f4d740c9a70 msgr2=0x7f4d741536a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:56.615 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.606+0000 7f4d79d44640 1 -- 172.21.15.86:0/513711074 shutdown_connections 2024-04-25T12:21:56.615 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.606+0000 7f4d79d44640 1 -- 172.21.15.86:0/513711074 wait complete. 2024-04-25T12:21:56.630 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-25T12:21:56.630 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-25T12:21:56.631 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-25T12:21:56.631 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-25T12:21:56.632 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-25T12:21:56.632 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-25T12:21:56.632 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-25T12:21:56.633 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-25T12:21:56.806 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.798+0000 7f5330ccd640 1 Processor -- start 2024-04-25T12:21:56.807 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.798+0000 7ff036916640 1 Processor -- start 2024-04-25T12:21:56.807 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.798+0000 7ff036916640 1 -- start start 2024-04-25T12:21:56.807 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.798+0000 7f5330ccd640 1 -- start start 2024-04-25T12:21:56.807 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7fc98f59e640 1 Processor -- start 2024-04-25T12:21:56.808 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7fc98f59e640 1 -- start start 2024-04-25T12:21:56.808 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7f96bb59e640 1 Processor -- start 2024-04-25T12:21:56.808 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7f96bb59e640 1 -- start start 2024-04-25T12:21:56.809 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7f5330ccd640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f532c151110 0x7f532c0c3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.809 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7f5330ccd640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f532c157430 0x7f532c1578a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.809 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7f5330ccd640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f532c15a7e0 con 0x7f532c0c88e0 2024-04-25T12:21:56.809 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7f5330ccd640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f532c156f50 con 0x7f532c151110 2024-04-25T12:21:56.809 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7f5330ccd640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f532c157de0 con 0x7f532c157430 2024-04-25T12:21:56.809 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7ff036916640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff0280d5000 0x7ff02804c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7f408b59e640 1 Processor -- start 2024-04-25T12:21:56.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7f532b7fe640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f532c151110 0x7f532c0c3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:56.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7f532b7fe640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f532c151110 0x7f532c0c3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:59266/0 (socket says 172.21.15.86:59266) 2024-04-25T12:21:56.810 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7f532b7fe640 1 -- 172.21.15.86:0/2159069139 learned_addr learned my addr 172.21.15.86:0/2159069139 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:56.811 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7ff036916640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff0280347a0 0x7ff0280dad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.811 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7f408b59e640 1 -- start start 2024-04-25T12:21:56.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7ff02ffff640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff0280d5000 0x7ff02804c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:56.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7ff02ffff640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff0280d5000 0x7ff02804c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:59280/0 (socket says 172.21.15.86:59280) 2024-04-25T12:21:56.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7ff02ffff640 1 -- 172.21.15.86:0/1933832938 learned_addr learned my addr 172.21.15.86:0/1933832938 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:56.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7ff036916640 1 --2- 172.21.15.86:0/1933832938 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff028050cb0 0x7ff0280db270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7ff036916640 1 -- 172.21.15.86:0/1933832938 --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7ff02804c820 con 0x7ff0280d5000 2024-04-25T12:21:56.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7ff036916640 1 -- 172.21.15.86:0/1933832938 --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7ff02804b990 con 0x7ff0280347a0 2024-04-25T12:21:56.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7ff036916640 1 -- 172.21.15.86:0/1933832938 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7ff02804bc70 con 0x7ff028050cb0 2024-04-25T12:21:56.813 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7fadb3171640 1 Processor -- start 2024-04-25T12:21:56.813 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7ff02f7fe640 1 --2- 172.21.15.86:0/1933832938 >> v2:172.21.15.134:3300/0 conn(0x7ff0280347a0 0x7ff0280dad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:56.813 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7fadb3171640 1 -- start start 2024-04-25T12:21:56.813 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7f532b7fe640 1 -- 172.21.15.86:0/2159069139 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f532c157430 msgr2=0x7f532c1578a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T12:21:56.814 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7f532b7fe640 1 --2- 172.21.15.86:0/2159069139 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f532c157430 0x7f532c1578a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.814 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7f532b7fe640 1 -- 172.21.15.86:0/2159069139 >> v1:172.21.15.134:6789/0 conn(0x7f532c0c88e0 legacy=0x7f532c0c95d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T12:21:56.814 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7f532b7fe640 1 -- 172.21.15.86:0/2159069139 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f532c1514f0 con 0x7f532c151110 2024-04-25T12:21:56.814 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7ff034eb3640 1 --2- 172.21.15.86:0/1933832938 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff028050cb0 0x7ff0280db270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:56.814 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7f96bb59e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f96b40d5800 0x7f96b404c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.815 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7fadb3171640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fada40d5c30 0x7fada404c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.815 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7f96bb59e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f96b4046200 0x7f96b40def90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.815 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7fadb3171640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fada404d840 0x7fada4046340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.816 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7f408b59e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f408c152e70 0x7f408c0c47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.816 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7fadb3171640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fada4046880 0x7fada40df020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.816 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7f408b59e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f408c15caa0 0x7f408c06e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.816 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7f408b59e640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f408c0c4e50 con 0x7f408c06e020 2024-04-25T12:21:56.817 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7fadb3171640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7fada404c9f0 con 0x7fada40d5c30 2024-04-25T12:21:56.817 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7fadb3171640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fada4046cb0 con 0x7fada404d840 2024-04-25T12:21:56.817 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7fadb3171640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fada4008760 con 0x7fada4046880 2024-04-25T12:21:56.817 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7f408b59e640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f408c06e9a0 con 0x7f408c152e70 2024-04-25T12:21:56.817 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7f408b59e640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f408c0c8e70 con 0x7f408c15caa0 2024-04-25T12:21:56.818 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7f96ba59c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f96b40d5800 0x7f96b404c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:56.818 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7f96ba59c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f96b40d5800 0x7f96b404c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.86:42862/0 (socket says 172.21.15.86:42862) 2024-04-25T12:21:56.818 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7fadb196e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fada404d840 0x7fada4046340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:56.818 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7f96ba59c640 1 -- 172.21.15.86:0/2432431801 learned_addr learned my addr 172.21.15.86:0/2432431801 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:56.819 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7fadb2970640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fada4046880 0x7fada40df020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:56.819 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7fadb2970640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fada4046880 0x7fada40df020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.86:42864/0 (socket says 172.21.15.86:42864) 2024-04-25T12:21:56.819 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7fadb2970640 1 -- 172.21.15.86:0/142184401 learned_addr learned my addr 172.21.15.86:0/142184401 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:56.819 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7f408ad9d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f408c15caa0 0x7f408c06e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:56.819 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7f4089d9b640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f408c06e020 0x7f408c15c390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.86:59402/0 (socket says 172.21.15.86:59402) 2024-04-25T12:21:56.820 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7f4089d9b640 1 -- 172.21.15.86:0/764378629 learned_addr learned my addr 172.21.15.86:0/764378629 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-04-25T12:21:56.820 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7f96bb59e640 1 -- 172.21.15.86:0/2432431801 --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96b4035290 con 0x7f96b40d5be0 2024-04-25T12:21:56.820 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7f408a59c640 1 --2- 172.21.15.86:0/764378629 >> v2:172.21.15.134:3300/0 conn(0x7f408c152e70 0x7f408c0c47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:56.821 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7f96bad9d640 1 --2- 172.21.15.86:0/2432431801 >> v2:172.21.15.134:3300/0 conn(0x7f96b4046200 0x7f96b40def90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:56.821 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7f96bb59e640 1 -- 172.21.15.86:0/2432431801 --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f96b4005fc0 con 0x7f96b4046200 2024-04-25T12:21:56.821 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7f96bb59e640 1 -- 172.21.15.86:0/2432431801 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f96b4035530 con 0x7f96b40d5800 2024-04-25T12:21:56.821 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7ff034eb3640 1 -- 172.21.15.86:0/1933832938 >> v2:172.21.15.134:3300/0 conn(0x7ff0280347a0 msgr2=0x7ff0280dad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:56.821 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7ff034eb3640 1 --2- 172.21.15.86:0/1933832938 >> v2:172.21.15.134:3300/0 conn(0x7ff0280347a0 0x7ff0280dad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.821 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7ff034eb3640 1 -- 172.21.15.86:0/1933832938 >> v2:172.21.15.86:3300/0 conn(0x7ff0280d5000 msgr2=0x7ff02804c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:56.822 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7ff034eb3640 1 --2- 172.21.15.86:0/1933832938 >> v2:172.21.15.86:3300/0 conn(0x7ff0280d5000 0x7ff02804c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.822 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7ff034eb3640 1 -- 172.21.15.86:0/1933832938 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff028006a50 con 0x7ff028050cb0 2024-04-25T12:21:56.822 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7fadb2970640 1 -- 172.21.15.86:0/142184401 >> v2:172.21.15.134:3300/0 conn(0x7fada404d840 msgr2=0x7fada4046340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:56.822 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7fadb2970640 1 --2- 172.21.15.86:0/142184401 >> v2:172.21.15.134:3300/0 conn(0x7fada404d840 0x7fada4046340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.822 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7fadb2970640 1 -- 172.21.15.86:0/142184401 >> v2:172.21.15.86:3300/0 conn(0x7fada40d5c30 msgr2=0x7fada404c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:56.822 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7fadb2970640 1 --2- 172.21.15.86:0/142184401 >> v2:172.21.15.86:3300/0 conn(0x7fada40d5c30 0x7fada404c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.822 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7fadb2970640 1 -- 172.21.15.86:0/142184401 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fada4008a40 con 0x7fada4046880 2024-04-25T12:21:56.823 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7f408959a640 1 -- 172.21.15.86:0/764378629 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2227241699 0 0) 0x7f408c0c4e50 con 0x7f408c06e020 2024-04-25T12:21:56.823 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7f408959a640 1 -- 172.21.15.86:0/764378629 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4074003530 con 0x7f408c06e020 2024-04-25T12:21:56.823 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7f408959a640 1 -- 172.21.15.86:0/764378629 <== mon.1 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 69365543 0 0) 0x7f4074003530 con 0x7f408c06e020 2024-04-25T12:21:56.823 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7f408959a640 1 -- 172.21.15.86:0/764378629 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f408c15caa0 msgr2=0x7f408c06e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:56.823 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7f408959a640 1 --2- 172.21.15.86:0/764378629 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f408c15caa0 0x7f408c06e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.823 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7f408959a640 1 -- 172.21.15.86:0/764378629 >> v2:172.21.15.134:3300/0 conn(0x7f408c152e70 msgr2=0x7f408c0c47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:56.823 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7f408959a640 1 --2- 172.21.15.86:0/764378629 >> v2:172.21.15.134:3300/0 conn(0x7f408c152e70 0x7f408c0c47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.823 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7f408959a640 1 -- 172.21.15.86:0/764378629 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f408c0c9150 con 0x7f408c06e020 2024-04-25T12:21:56.824 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7fc98f59e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9901595f0 0x7fc99006cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.824 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7fc98f59e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc990163340 0x7fc99006d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.824 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7fc98f59e640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc990070880 con 0x7fc9900ca970 2024-04-25T12:21:56.824 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7fc98f59e640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fc9900caed0 con 0x7fc990163340 2024-04-25T12:21:56.824 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7fc98f59e640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fc990070b60 con 0x7fc9901595f0 2024-04-25T12:21:56.824 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7ff034eb3640 1 --2- 172.21.15.86:0/1933832938 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff028050cb0 0x7ff0280db270 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff030069360 tx=0x7ff03009b360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56b69c6e82d722fc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:56.825 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7f27c71d1640 1 Processor -- start 2024-04-25T12:21:56.825 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7f27c71d1640 1 -- start start 2024-04-25T12:21:56.825 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7f27c71d1640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f27c00c92b0 0x7f27c00c3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.825 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7f27c71d1640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f27c00c89c0 0x7f27c00c4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.825 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7f27c71d1640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27c00c45e0 con 0x7f27c00c9690 2024-04-25T12:21:56.825 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7f27c71d1640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f27c016b270 con 0x7f27c00c89c0 2024-04-25T12:21:56.826 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.802+0000 7f27c71d1640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f27c016b550 con 0x7f27c00c92b0 2024-04-25T12:21:56.826 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7f27c69d0640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f27c00c89c0 0x7f27c00c4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:56.826 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7f27c69d0640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f27c00c89c0 0x7f27c00c4000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:59290/0 (socket says 172.21.15.86:59290) 2024-04-25T12:21:56.826 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7f27c69d0640 1 -- 172.21.15.86:0/2413793892 learned_addr learned my addr 172.21.15.86:0/2413793892 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:56.826 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7f27c61cf640 1 --2- 172.21.15.86:0/2413793892 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f27c00c92b0 0x7f27c00c3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:56.826 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7fc98e59c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9901595f0 0x7fc99006cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:56.826 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7fc98e59c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9901595f0 0x7fc99006cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.86:42880/0 (socket says 172.21.15.86:42880) 2024-04-25T12:21:56.827 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7fc98e59c640 1 -- 172.21.15.86:0/2158730857 learned_addr learned my addr 172.21.15.86:0/2158730857 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:56.827 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7ff02effd640 1 -- 172.21.15.86:0/1933832938 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff030130070 con 0x7ff028050cb0 2024-04-25T12:21:56.827 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7f27c69d0640 1 -- 172.21.15.86:0/2413793892 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f27c00c92b0 msgr2=0x7f27c00c3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:56.827 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7f27c69d0640 1 --2- 172.21.15.86:0/2413793892 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f27c00c92b0 0x7f27c00c3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7f27c69d0640 1 -- 172.21.15.86:0/2413793892 >> v1:172.21.15.86:6789/0 conn(0x7f27c00c9690 legacy=0x7f27c0164e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:56.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7f27c69d0640 1 -- 172.21.15.86:0/2413793892 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27c016b830 con 0x7f27c00c89c0 2024-04-25T12:21:56.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7ff02effd640 1 -- 172.21.15.86:0/1933832938 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff03012b640 con 0x7ff028050cb0 2024-04-25T12:21:56.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7ff02effd640 1 -- 172.21.15.86:0/1933832938 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff03012bab0 con 0x7ff028050cb0 2024-04-25T12:21:56.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7ff036916640 1 -- 172.21.15.86:0/1933832938 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff028050cb0 msgr2=0x7ff0280db270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:56.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7ff036916640 1 --2- 172.21.15.86:0/1933832938 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff028050cb0 0x7ff0280db270 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff030069360 tx=0x7ff03009b360 comp rx=0 tx=0).stop 2024-04-25T12:21:56.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7fc98e59c640 1 -- 172.21.15.86:0/2158730857 >> v2:172.21.15.134:3300/0 conn(0x7fc990163340 msgr2=0x7fc99006d020 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T12:21:56.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7fc98e59c640 1 --2- 172.21.15.86:0/2158730857 >> v2:172.21.15.134:3300/0 conn(0x7fc990163340 0x7fc99006d020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7fc98e59c640 1 -- 172.21.15.86:0/2158730857 >> v1:172.21.15.86:6789/0 conn(0x7fc9900ca970 legacy=0x7fc990162c30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T12:21:56.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7fc98e59c640 1 -- 172.21.15.86:0/2158730857 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc990070e40 con 0x7fc9901595f0 2024-04-25T12:21:56.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7fb4bb59e640 1 Processor -- start 2024-04-25T12:21:56.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7fadb2970640 1 --2- 172.21.15.86:0/142184401 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fada4046880 0x7fada40df020 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fadac0512e0 tx=0x7fadac09b3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c66237dc1afd1593 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:56.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7f408959a640 1 -- 172.21.15.86:0/764378629 <== mon.1 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1387950573 0 0) 0x7f4084001a00 con 0x7f408c06e020 2024-04-25T12:21:56.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7f408959a640 1 -- 172.21.15.86:0/764378629 >> v1:172.21.15.134:6789/0 conn(0x7f408c06e020 legacy=0x7f408c15c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:56.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7f408959a640 1 --2- 172.21.15.86:0/764378629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4074003a30 0x7f4074003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7f408959a640 1 --2- 172.21.15.86:0/764378629 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4074004810 0x7f4074004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7f408959a640 1 --2- 172.21.15.86:0/764378629 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f408c15caa0 0x7f40740051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7f408959a640 1 -- 172.21.15.86:0/764378629 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f408c06e9a0 con 0x7f4074004810 2024-04-25T12:21:56.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7f408959a640 1 -- 172.21.15.86:0/764378629 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f408c0c8e70 con 0x7f4074003a30 2024-04-25T12:21:56.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7f408959a640 1 -- 172.21.15.86:0/764378629 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f407400ba20 con 0x7f408c15caa0 2024-04-25T12:21:56.831 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7f96bad9d640 1 -- 172.21.15.86:0/2432431801 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f96b40d5800 msgr2=0x7f96b404c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:56.831 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7f96bad9d640 1 --2- 172.21.15.86:0/2432431801 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f96b40d5800 0x7f96b404c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.831 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7f96bad9d640 1 -- 172.21.15.86:0/2432431801 >> v1:172.21.15.86:6789/0 conn(0x7f96b40d5be0 legacy=0x7f96b4045af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:56.831 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7f96bad9d640 1 -- 172.21.15.86:0/2432431801 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96b4035810 con 0x7f96b4046200 2024-04-25T12:21:56.831 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7f96bad9d640 1 --2- 172.21.15.86:0/2432431801 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96b4046200 0x7f96b40def90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f96bc06ac00 tx=0x7f96bc09b300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1553042ea5235877 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:56.831 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7ff036916640 1 -- 172.21.15.86:0/1933832938 shutdown_connections 2024-04-25T12:21:56.831 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7ff036916640 1 --2- 172.21.15.86:0/1933832938 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff028050cb0 0x7ff0280db270 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.831 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7ff036916640 1 --2- 172.21.15.86:0/1933832938 >> v2:172.21.15.134:3300/0 conn(0x7ff0280347a0 0x7ff0280dad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.831 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7ff036916640 1 --2- 172.21.15.86:0/1933832938 >> v2:172.21.15.86:3300/0 conn(0x7ff0280d5000 0x7ff02804c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.832 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7ff036916640 1 -- 172.21.15.86:0/1933832938 >> 172.21.15.86:0/1933832938 conn(0x7ff028050190 msgr2=0x7ff0280505a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:56.832 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7fadb116d640 1 -- 172.21.15.86:0/142184401 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadac130070 con 0x7fada4046880 2024-04-25T12:21:56.832 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7fadb116d640 1 -- 172.21.15.86:0/142184401 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadac12b640 con 0x7fada4046880 2024-04-25T12:21:56.832 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7fadb116d640 1 -- 172.21.15.86:0/142184401 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadac12bab0 con 0x7fada4046880 2024-04-25T12:21:56.832 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7f408a59c640 1 --2- 172.21.15.86:0/764378629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4074003a30 0x7f4074003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:56.832 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7f408ad9d640 1 --2- 172.21.15.86:0/764378629 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f408c15caa0 0x7f40740051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:56.833 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7ff036916640 1 -- 172.21.15.86:0/1933832938 shutdown_connections 2024-04-25T12:21:56.833 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7f96b959a640 1 -- 172.21.15.86:0/2432431801 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96bc130070 con 0x7f96b4046200 2024-04-25T12:21:56.833 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7f96b959a640 1 -- 172.21.15.86:0/2432431801 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96bc12b640 con 0x7f96b4046200 2024-04-25T12:21:56.833 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7f96b959a640 1 -- 172.21.15.86:0/2432431801 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96bc12bab0 con 0x7f96b4046200 2024-04-25T12:21:56.834 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7fadb3171640 1 -- 172.21.15.86:0/142184401 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fada4046880 msgr2=0x7fada40df020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:56.834 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7fadb3171640 1 --2- 172.21.15.86:0/142184401 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fada4046880 0x7fada40df020 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fadac0512e0 tx=0x7fadac09b3a0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.834 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7f408ad9d640 1 -- 172.21.15.86:0/764378629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4074003a30 msgr2=0x7f4074003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:56.835 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7f408ad9d640 1 --2- 172.21.15.86:0/764378629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4074003a30 0x7f4074003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.835 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7f408ad9d640 1 -- 172.21.15.86:0/764378629 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4074004810 msgr2=0x7f4074004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:56.835 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7f408ad9d640 1 --2- 172.21.15.86:0/764378629 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4074004810 0x7f4074004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.835 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7f408ad9d640 1 -- 172.21.15.86:0/764378629 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4074003530 con 0x7f408c15caa0 2024-04-25T12:21:56.835 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7f532b7fe640 1 --2- 172.21.15.86:0/2159069139 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f532c151110 0x7f532c0c3ac0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f532c06ca00 tx=0x7f532401f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc00a5034ca39d9c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:56.835 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7ff036916640 1 -- 172.21.15.86:0/1933832938 wait complete. 2024-04-25T12:21:56.836 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7ff036916640 1 Processor -- start 2024-04-25T12:21:56.836 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7f532a7fc640 1 -- 172.21.15.86:0/2159069139 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53240b4070 con 0x7f532c151110 2024-04-25T12:21:56.836 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7f532a7fc640 1 -- 172.21.15.86:0/2159069139 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53240af400 con 0x7f532c151110 2024-04-25T12:21:56.836 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7f532a7fc640 1 -- 172.21.15.86:0/2159069139 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53240af7d0 con 0x7f532c151110 2024-04-25T12:21:56.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7f27c69d0640 1 --2- 172.21.15.86:0/2413793892 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27c00c89c0 0x7f27c00c4000 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f27b8007eb0 tx=0x7f27b8020620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1b444dbbd5b9121 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:56.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7f27c51cd640 1 -- 172.21.15.86:0/2413793892 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b80b0430 con 0x7f27c00c89c0 2024-04-25T12:21:56.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7f27c51cd640 1 -- 172.21.15.86:0/2413793892 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27b80b5070 con 0x7f27c00c89c0 2024-04-25T12:21:56.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7f27c51cd640 1 -- 172.21.15.86:0/2413793892 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b80b07f0 con 0x7f27c00c89c0 2024-04-25T12:21:56.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7fb4bb59e640 1 -- start start 2024-04-25T12:21:56.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7fb4bb59e640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb4bc0c5a00 0x7fb4bc0cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7fb4bb59e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb4bc0cc150 0x7fb4bc15e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.838 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7fb4bb59e640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4bc0c6260 con 0x7fb4bc154f30 2024-04-25T12:21:56.838 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7fb4bb59e640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7fb4bc0c6540 con 0x7fb4bc0c5a00 2024-04-25T12:21:56.838 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7fb4bb59e640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fb4bc0c6820 con 0x7fb4bc0cc150 2024-04-25T12:21:56.838 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7f96bb59e640 1 -- 172.21.15.86:0/2432431801 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96b4046200 msgr2=0x7f96b40def90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:56.838 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7f96bb59e640 1 --2- 172.21.15.86:0/2432431801 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96b4046200 0x7f96b40def90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f96bc06ac00 tx=0x7f96bc09b300 comp rx=0 tx=0).stop 2024-04-25T12:21:56.838 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7fadb3171640 1 -- 172.21.15.86:0/142184401 shutdown_connections 2024-04-25T12:21:56.838 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7fadb3171640 1 --2- 172.21.15.86:0/142184401 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fada4046880 0x7fada40df020 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.838 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7fadb3171640 1 --2- 172.21.15.86:0/142184401 >> v2:172.21.15.134:3300/0 conn(0x7fada404d840 0x7fada4046340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.839 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7fadb3171640 1 --2- 172.21.15.86:0/142184401 >> v2:172.21.15.86:3300/0 conn(0x7fada40d5c30 0x7fada404c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.839 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.806+0000 7fadb3171640 1 -- 172.21.15.86:0/142184401 >> 172.21.15.86:0/142184401 conn(0x7fada404dd40 msgr2=0x7fada404e150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:56.839 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7fb4b3fff640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb4bc0c5a00 0x7fb4bc0cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:56.839 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7fb4b3fff640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb4bc0c5a00 0x7fb4bc0cbc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:59298/0 (socket says 172.21.15.86:59298) 2024-04-25T12:21:56.839 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7fb4b3fff640 1 -- 172.21.15.86:0/881889582 learned_addr learned my addr 172.21.15.86:0/881889582 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:56.840 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7fb4bad9d640 1 --2- 172.21.15.86:0/881889582 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb4bc0cc150 0x7fb4bc15e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:56.840 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7fb4b3fff640 1 -- 172.21.15.86:0/881889582 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb4bc0cc150 msgr2=0x7fb4bc15e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:56.840 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7fb4b3fff640 1 --2- 172.21.15.86:0/881889582 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb4bc0cc150 0x7fb4bc15e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.840 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7fb4b3fff640 1 -- 172.21.15.86:0/881889582 >> v1:172.21.15.134:6789/0 conn(0x7fb4bc154f30 legacy=0x7fb4bc0cb040 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T12:21:56.840 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7fb4b3fff640 1 -- 172.21.15.86:0/881889582 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4bc0c6b00 con 0x7fb4bc0c5a00 2024-04-25T12:21:56.840 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7fadb3171640 1 -- 172.21.15.86:0/142184401 shutdown_connections 2024-04-25T12:21:56.840 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7fadb3171640 1 -- 172.21.15.86:0/142184401 wait complete. 2024-04-25T12:21:56.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7ff036916640 1 -- start start 2024-04-25T12:21:56.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7ff036916640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0280347a0 0x7ff0280c3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7ff036916640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff028050cb0 0x7ff0280e5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7ff036916640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0280d5000 0x7ff0280c7c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7ff036916640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff028045130 con 0x7ff0280347a0 2024-04-25T12:21:56.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7ff036916640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff028007010 con 0x7ff0280d5000 2024-04-25T12:21:56.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7ff036916640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7ff0280d53e0 con 0x7ff028050cb0 2024-04-25T12:21:56.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7f5330ccd640 1 -- 172.21.15.86:0/2159069139 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f532c151110 msgr2=0x7f532c0c3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:56.842 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7f5330ccd640 1 --2- 172.21.15.86:0/2159069139 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f532c151110 0x7f532c0c3ac0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f532c06ca00 tx=0x7f532401f1e0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.842 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7ff02ffff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0280347a0 0x7ff0280c3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:56.842 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7ff02ffff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0280347a0 0x7ff0280c3b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:59306/0 (socket says 172.21.15.86:59306) 2024-04-25T12:21:56.842 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7ff02ffff640 1 -- 172.21.15.86:0/1883770888 learned_addr learned my addr 172.21.15.86:0/1883770888 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:56.842 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7f96bb59e640 1 -- 172.21.15.86:0/2432431801 shutdown_connections 2024-04-25T12:21:56.843 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7f96bb59e640 1 --2- 172.21.15.86:0/2432431801 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96b4046200 0x7f96b40def90 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.843 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7f96bb59e640 1 --2- 172.21.15.86:0/2432431801 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f96b40d5800 0x7f96b404c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.843 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7f96bb59e640 1 -- 172.21.15.86:0/2432431801 >> 172.21.15.86:0/2432431801 conn(0x7f96b4050190 msgr2=0x7f96b40505a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:56.843 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7ff02f7fe640 1 --2- 172.21.15.86:0/1883770888 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff028050cb0 0x7ff0280e5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:56.843 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7fc98e59c640 1 --2- 172.21.15.86:0/2158730857 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9901595f0 0x7fc99006cae0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc980009870 tx=0x7fc98001c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9574317f28ecb08e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:56.844 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7ff034eb3640 1 --2- 172.21.15.86:0/1883770888 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0280d5000 0x7ff0280c7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:56.844 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7ff02ffff640 1 -- 172.21.15.86:0/1883770888 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff028050cb0 msgr2=0x7ff0280e5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:56.844 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7ff02ffff640 1 --2- 172.21.15.86:0/1883770888 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff028050cb0 0x7ff0280e5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.844 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7ff02ffff640 1 -- 172.21.15.86:0/1883770888 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0280d5000 msgr2=0x7ff0280c7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:56.844 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7ff02ffff640 1 --2- 172.21.15.86:0/1883770888 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0280d5000 0x7ff0280c7c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.844 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7ff02ffff640 1 -- 172.21.15.86:0/1883770888 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0280e5e80 con 0x7ff0280347a0 2024-04-25T12:21:56.845 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7fc98d59a640 1 -- 172.21.15.86:0/2158730857 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9800b1070 con 0x7fc9901595f0 2024-04-25T12:21:56.845 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7fc98d59a640 1 -- 172.21.15.86:0/2158730857 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9800ac410 con 0x7fc9901595f0 2024-04-25T12:21:56.845 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7fc98d59a640 1 -- 172.21.15.86:0/2158730857 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9800ac7e0 con 0x7fc9901595f0 2024-04-25T12:21:56.845 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7ff02ffff640 1 --2- 172.21.15.86:0/1883770888 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0280347a0 0x7ff0280c3b20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff02400ba90 tx=0x7ff02400bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:56.845 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7ff02cff9640 1 -- 172.21.15.86:0/1883770888 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff024008e40 con 0x7ff0280347a0 2024-04-25T12:21:56.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7fadb3171640 1 Processor -- start 2024-04-25T12:21:56.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7ff02cff9640 1 -- 172.21.15.86:0/1883770888 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff024019070 con 0x7ff0280347a0 2024-04-25T12:21:56.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7ff036916640 1 -- 172.21.15.86:0/1883770888 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0280bfeb0 con 0x7ff0280347a0 2024-04-25T12:21:56.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7fc98f59e640 1 -- 172.21.15.86:0/2158730857 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9901595f0 msgr2=0x7fc99006cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:56.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7fc98f59e640 1 --2- 172.21.15.86:0/2158730857 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9901595f0 0x7fc99006cae0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc980009870 tx=0x7fc98001c3f0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7fadb3171640 1 -- start start 2024-04-25T12:21:56.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7fc98f59e640 1 -- 172.21.15.86:0/2158730857 shutdown_connections 2024-04-25T12:21:56.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7fc98f59e640 1 --2- 172.21.15.86:0/2158730857 >> v2:172.21.15.134:3300/0 conn(0x7fc990163340 0x7fc99006d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7fc98f59e640 1 --2- 172.21.15.86:0/2158730857 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9901595f0 0x7fc99006cae0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7fc98f59e640 1 -- 172.21.15.86:0/2158730857 >> 172.21.15.86:0/2158730857 conn(0x7fc9900cb0e0 msgr2=0x7fc9900cb4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:56.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7ff02cff9640 1 -- 172.21.15.86:0/1883770888 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff024014620 con 0x7ff0280347a0 2024-04-25T12:21:56.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7ff036916640 1 -- 172.21.15.86:0/1883770888 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff02804e270 con 0x7ff0280347a0 2024-04-25T12:21:56.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7fadb3171640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fada4046880 0x7fada40359f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7fadb3171640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fada404d840 0x7fada4036eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7fadb3171640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fada40d5c30 0x7fada4047760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7fadb3171640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fada40092e0 con 0x7fada404d840 2024-04-25T12:21:56.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7fadb3171640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fada4009000 con 0x7fada40d5c30 2024-04-25T12:21:56.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7fadb3171640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fada40d6010 con 0x7fada4046880 2024-04-25T12:21:56.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7fadb216f640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fada4046880 0x7fada40359f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:56.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7fc98f59e640 1 -- 172.21.15.86:0/2158730857 shutdown_connections 2024-04-25T12:21:56.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7f5330ccd640 1 -- 172.21.15.86:0/2159069139 shutdown_connections 2024-04-25T12:21:56.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7f5330ccd640 1 --2- 172.21.15.86:0/2159069139 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f532c157430 0x7f532c1578a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7f5330ccd640 1 --2- 172.21.15.86:0/2159069139 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f532c151110 0x7f532c0c3ac0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7f5330ccd640 1 -- 172.21.15.86:0/2159069139 >> 172.21.15.86:0/2159069139 conn(0x7f532c06eb20 msgr2=0x7f532c06ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:56.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7fadb216f640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fada4046880 0x7fada40359f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.86:42936/0 (socket says 172.21.15.86:42936) 2024-04-25T12:21:56.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7fadb216f640 1 -- 172.21.15.86:0/3377260739 learned_addr learned my addr 172.21.15.86:0/3377260739 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:56.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7f96bb59e640 1 -- 172.21.15.86:0/2432431801 shutdown_connections 2024-04-25T12:21:56.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7f96bb59e640 1 -- 172.21.15.86:0/2432431801 wait complete. 2024-04-25T12:21:56.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7fadb216f640 1 -- 172.21.15.86:0/3377260739 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fada40d5c30 msgr2=0x7fada4047760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:56.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7fadb216f640 1 --2- 172.21.15.86:0/3377260739 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fada40d5c30 0x7fada4047760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7fadb216f640 1 -- 172.21.15.86:0/3377260739 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fada404d840 msgr2=0x7fada4036eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:56.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7fadb216f640 1 --2- 172.21.15.86:0/3377260739 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fada404d840 0x7fada4036eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7fadb216f640 1 -- 172.21.15.86:0/3377260739 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fada40d6730 con 0x7fada4046880 2024-04-25T12:21:56.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7fadb216f640 1 --2- 172.21.15.86:0/3377260739 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fada4046880 0x7fada40359f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fada800b410 tx=0x7fada800b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:56.852 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7f27c71d1640 1 -- 172.21.15.86:0/2413793892 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27c00c89c0 msgr2=0x7f27c00c4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:56.852 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7f27c71d1640 1 --2- 172.21.15.86:0/2413793892 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27c00c89c0 0x7f27c00c4000 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f27b8007eb0 tx=0x7f27b8020620 comp rx=0 tx=0).stop 2024-04-25T12:21:56.852 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7f27c71d1640 1 -- 172.21.15.86:0/2413793892 shutdown_connections 2024-04-25T12:21:56.852 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7f27c71d1640 1 --2- 172.21.15.86:0/2413793892 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27c00c89c0 0x7f27c00c4000 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.852 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7f27c71d1640 1 --2- 172.21.15.86:0/2413793892 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f27c00c92b0 0x7f27c00c3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.852 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.810+0000 7f27c71d1640 1 -- 172.21.15.86:0/2413793892 >> 172.21.15.86:0/2413793892 conn(0x7f27c006eb20 msgr2=0x7f27c006ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:56.852 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7fada2ffd640 1 -- 172.21.15.86:0/3377260739 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada8015020 con 0x7fada4046880 2024-04-25T12:21:56.853 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7fada2ffd640 1 -- 172.21.15.86:0/3377260739 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fada8011850 con 0x7fada4046880 2024-04-25T12:21:56.853 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7fadb3171640 1 -- 172.21.15.86:0/3377260739 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fada40d8c40 con 0x7fada4046880 2024-04-25T12:21:56.853 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7fada2ffd640 1 -- 172.21.15.86:0/3377260739 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada8011c40 con 0x7fada4046880 2024-04-25T12:21:56.853 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7f96bb59e640 1 Processor -- start 2024-04-25T12:21:56.853 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7f408ad9d640 1 --2- 172.21.15.86:0/764378629 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f408c15caa0 0x7f40740051d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f407c009ae0 tx=0x7f407c01cab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8844e0f9a30b0bf1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:56.854 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7ff036916640 1 -- 172.21.15.86:0/1883770888 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff0280bfc50 con 0x7ff0280347a0 2024-04-25T12:21:56.854 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7fc98f59e640 1 -- 172.21.15.86:0/2158730857 wait complete. 2024-04-25T12:21:56.854 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7fc98f59e640 1 Processor -- start 2024-04-25T12:21:56.854 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7fb4b3fff640 1 --2- 172.21.15.86:0/881889582 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4bc0c5a00 0x7fb4bc0cbc10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac009870 tx=0x7fb4ac01ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55c362efc61cc7f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:56.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7f96bb59e640 1 -- start start 2024-04-25T12:21:56.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7fadb3171640 1 -- 172.21.15.86:0/3377260739 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fada40d9200 con 0x7fada4046880 2024-04-25T12:21:56.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7ff02cff9640 1 -- 172.21.15.86:0/1883770888 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff024008040 con 0x7ff0280347a0 2024-04-25T12:21:56.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7fb4b9d9b640 1 -- 172.21.15.86:0/881889582 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4ac0b5070 con 0x7fb4bc0c5a00 2024-04-25T12:21:56.856 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7fb4b9d9b640 1 -- 172.21.15.86:0/881889582 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4ac0a89d0 con 0x7fb4bc0c5a00 2024-04-25T12:21:56.856 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7f5330ccd640 1 -- 172.21.15.86:0/2159069139 shutdown_connections 2024-04-25T12:21:56.856 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7fb4b9d9b640 1 -- 172.21.15.86:0/881889582 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4ac0a8da0 con 0x7fb4bc0c5a00 2024-04-25T12:21:56.856 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7f408959a640 1 -- 172.21.15.86:0/764378629 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f407c0b2070 con 0x7f408c15caa0 2024-04-25T12:21:56.857 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7fc98f59e640 1 -- start start 2024-04-25T12:21:56.857 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7fc98f59e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9900ca970 0x7fc9901604d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.857 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7fc98f59e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9901595f0 0x7fc990160a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.857 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7fc98f59e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc990163340 0x7fc990161cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.857 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7fc98f59e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc990159b50 con 0x7fc9901595f0 2024-04-25T12:21:56.857 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7fc98f59e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc9901599d0 con 0x7fc9900ca970 2024-04-25T12:21:56.857 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7fc98f59e640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fc9900c9790 con 0x7fc990163340 2024-04-25T12:21:56.857 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7fc98e59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9900ca970 0x7fc9901604d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:56.857 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7f408959a640 1 -- 172.21.15.86:0/764378629 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f407c0a56a0 con 0x7f408c15caa0 2024-04-25T12:21:56.858 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7f408959a640 1 -- 172.21.15.86:0/764378629 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f407c0096b0 con 0x7f408c15caa0 2024-04-25T12:21:56.858 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7f408b59e640 1 -- 172.21.15.86:0/764378629 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f408c15caa0 msgr2=0x7f40740051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:56.858 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7fc98e59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9900ca970 0x7fc9901604d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.86:55202/0 (socket says 172.21.15.86:55202) 2024-04-25T12:21:56.858 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7fc98e59c640 1 -- 172.21.15.86:0/2729288220 learned_addr learned my addr 172.21.15.86:0/2729288220 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:56.858 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7fc98ed9d640 1 --2- 172.21.15.86:0/2729288220 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc990163340 0x7fc990161cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:56.859 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7f408b59e640 1 --2- 172.21.15.86:0/764378629 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f408c15caa0 0x7f40740051d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f407c009ae0 tx=0x7f407c01cab0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.859 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7f5330ccd640 1 -- 172.21.15.86:0/2159069139 wait complete. 2024-04-25T12:21:56.859 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7f408ad9d640 1 -- 172.21.15.86:0/764378629 reap_dead start 2024-04-25T12:21:56.860 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7f408b59e640 1 -- 172.21.15.86:0/764378629 shutdown_connections 2024-04-25T12:21:56.860 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7f408b59e640 1 -- 172.21.15.86:0/764378629 >> 172.21.15.86:0/764378629 conn(0x7f408c06f940 msgr2=0x7f408c06fd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:56.860 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7f408b59e640 1 -- 172.21.15.86:0/764378629 shutdown_connections 2024-04-25T12:21:56.860 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7fb4bb59e640 1 -- 172.21.15.86:0/881889582 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4bc0c5a00 msgr2=0x7fb4bc0cbc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:56.860 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7fb4bb59e640 1 --2- 172.21.15.86:0/881889582 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4bc0c5a00 0x7fb4bc0cbc10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac009870 tx=0x7fb4ac01ed30 comp rx=0 tx=0).stop 2024-04-25T12:21:56.860 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7f5330ccd640 1 Processor -- start 2024-04-25T12:21:56.861 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7fc98e59c640 1 -- 172.21.15.86:0/2729288220 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc990163340 msgr2=0x7fc990161cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:56.861 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7fc98e59c640 1 --2- 172.21.15.86:0/2729288220 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc990163340 0x7fc990161cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.861 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7fc98e59c640 1 -- 172.21.15.86:0/2729288220 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9901595f0 msgr2=0x7fc990160a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:56.861 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7fc98e59c640 1 --2- 172.21.15.86:0/2729288220 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9901595f0 0x7fc990160a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.861 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7fc98e59c640 1 -- 172.21.15.86:0/2729288220 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9901f8f10 con 0x7fc9900ca970 2024-04-25T12:21:56.861 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7fc98e59c640 1 --2- 172.21.15.86:0/2729288220 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9900ca970 0x7fc9901604d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc98001aaa0 tx=0x7fc980019190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:56.861 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7fc97effd640 1 -- 172.21.15.86:0/2729288220 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9800b9070 con 0x7fc9900ca970 2024-04-25T12:21:56.862 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7fc97effd640 1 -- 172.21.15.86:0/2729288220 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9800b5410 con 0x7fc9900ca970 2024-04-25T12:21:56.862 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7fc97effd640 1 -- 172.21.15.86:0/2729288220 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9800b1040 con 0x7fc9900ca970 2024-04-25T12:21:56.862 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7fc98ed9d640 1 --2- 172.21.15.86:0/2729288220 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc990163340 0x7fc990161cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T12:21:56.862 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7fadb3171640 1 -- 172.21.15.86:0/3377260739 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fada40d64d0 con 0x7fada4046880 2024-04-25T12:21:56.862 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7fada2ffd640 1 -- 172.21.15.86:0/3377260739 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fada8018020 con 0x7fada4046880 2024-04-25T12:21:56.862 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7fada2ffd640 1 --2- 172.21.15.86:0/3377260739 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fad90068450 0x7fad9006a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.862 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7fada2ffd640 1 -- 172.21.15.86:0/3377260739 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fada8087380 con 0x7fada4046880 2024-04-25T12:21:56.862 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7fada2ffd640 1 --2- 172.21.15.86:0/3377260739 >> [v2:172.21.15.86:6818/2861354413,v1:172.21.15.86:6821/2861354413] conn(0x7fad90071bc0 0x7fad90074000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.862 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7fada2ffd640 1 -- 172.21.15.86:0/3377260739 --> [v2:172.21.15.86:6818/2861354413,v1:172.21.15.86:6821/2861354413] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fad900746d0 con 0x7fad90071bc0 2024-04-25T12:21:56.863 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7fada2ffd640 1 -- 172.21.15.86:0/3377260739 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fada8087770 con 0x7fada4046880 2024-04-25T12:21:56.863 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7fadb196e640 1 --2- 172.21.15.86:0/3377260739 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fad90068450 0x7fad9006a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:56.863 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7fadb2970640 1 --2- 172.21.15.86:0/3377260739 >> [v2:172.21.15.86:6818/2861354413,v1:172.21.15.86:6821/2861354413] conn(0x7fad90071bc0 0x7fad90074000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:56.863 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7f408b59e640 1 -- 172.21.15.86:0/764378629 wait complete. 2024-04-25T12:21:56.863 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7f408b59e640 1 Processor -- start 2024-04-25T12:21:56.863 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7f5330ccd640 1 -- start start 2024-04-25T12:21:56.863 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7f5330ccd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f532c0c88e0 0x7f532c200990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.864 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7f5330ccd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f532c151110 0x7f532c0c5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.864 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7f5330ccd640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f532c157430 0x7f532c1531f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.864 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7f5330ccd640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f532c15b040 con 0x7f532c0c88e0 2024-04-25T12:21:56.864 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7f5330ccd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f532c15ad60 con 0x7f532c151110 2024-04-25T12:21:56.864 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7f5330ccd640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f532c15b320 con 0x7f532c157430 2024-04-25T12:21:56.864 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7f532bfff640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f532c157430 0x7f532c1531f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:56.864 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7f532bfff640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f532c157430 0x7f532c1531f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.86:42968/0 (socket says 172.21.15.86:42968) 2024-04-25T12:21:56.864 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7f532bfff640 1 -- 172.21.15.86:0/222886130 learned_addr learned my addr 172.21.15.86:0/222886130 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:56.864 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7f96bb59e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f96b40d5800 0x7f96b40d3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.864 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7f96bb59e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96b40d5be0 0x7f96b40d1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.865 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7f96bb59e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96b4047510 0x7f96b40d1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.865 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7f96bb59e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f96b4006250 con 0x7f96b40d5be0 2024-04-25T12:21:56.865 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7f96bb59e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f96b4035dd0 con 0x7f96b4047510 2024-04-25T12:21:56.865 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7f96bb59e640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f96b40063d0 con 0x7f96b40d5800 2024-04-25T12:21:56.865 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7f96ba59c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f96b40d5800 0x7f96b40d3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:56.865 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7f96ba59c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f96b40d5800 0x7f96b40d3be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.86:42948/0 (socket says 172.21.15.86:42948) 2024-04-25T12:21:56.865 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7f96ba59c640 1 -- 172.21.15.86:0/3007317641 learned_addr learned my addr 172.21.15.86:0/3007317641 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:56.865 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7f96bad9d640 1 --2- 172.21.15.86:0/3007317641 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96b4047510 0x7f96b40d1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:56.865 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.814+0000 7f96b9d9b640 1 --2- 172.21.15.86:0/3007317641 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96b40d5be0 0x7f96b40d1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:56.865 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7f96b9d9b640 1 -- 172.21.15.86:0/3007317641 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f96b40d5800 msgr2=0x7f96b40d3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:56.865 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7f96b9d9b640 1 --2- 172.21.15.86:0/3007317641 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f96b40d5800 0x7f96b40d3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.865 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7f96b9d9b640 1 -- 172.21.15.86:0/3007317641 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96b4047510 msgr2=0x7f96b40d1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:56.865 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7f96b9d9b640 1 --2- 172.21.15.86:0/3007317641 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96b4047510 0x7f96b40d1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.866 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7f96b9d9b640 1 -- 172.21.15.86:0/3007317641 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96b4050d80 con 0x7f96b40d5be0 2024-04-25T12:21:56.866 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7f96b9d9b640 1 --2- 172.21.15.86:0/3007317641 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96b40d5be0 0x7f96b40d1ab0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f96b001d430 tx=0x7f96b001d8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:56.866 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7f96aaffd640 1 -- 172.21.15.86:0/3007317641 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b0028070 con 0x7f96b40d5be0 2024-04-25T12:21:56.866 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7f96aaffd640 1 -- 172.21.15.86:0/3007317641 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96b00052e0 con 0x7f96b40d5be0 2024-04-25T12:21:56.866 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7f96aaffd640 1 -- 172.21.15.86:0/3007317641 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b0003840 con 0x7f96b40d5be0 2024-04-25T12:21:56.866 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7f96bb59e640 1 -- 172.21.15.86:0/3007317641 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96b4030180 con 0x7f96b40d5be0 2024-04-25T12:21:56.866 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7f96bb59e640 1 -- 172.21.15.86:0/3007317641 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96b4031420 con 0x7f96b40d5be0 2024-04-25T12:21:56.866 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7f96bb59e640 1 -- 172.21.15.86:0/3007317641 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f96b40053a0 con 0x7f96b40d5be0 2024-04-25T12:21:56.866 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7fadb2970640 1 --2- 172.21.15.86:0/3377260739 >> [v2:172.21.15.86:6818/2861354413,v1:172.21.15.86:6821/2861354413] conn(0x7fad90071bc0 0x7fad90074000 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:56.867 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7fadb196e640 1 --2- 172.21.15.86:0/3377260739 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fad90068450 0x7fad9006a910 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fad9c006aa0 tx=0x7fad9c006a30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:56.867 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7fc98f59e640 1 -- 172.21.15.86:0/2729288220 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc990155d90 con 0x7fc9900ca970 2024-04-25T12:21:56.867 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7fb4bb59e640 1 -- 172.21.15.86:0/881889582 shutdown_connections 2024-04-25T12:21:56.867 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7fb4bb59e640 1 --2- 172.21.15.86:0/881889582 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb4bc0cc150 0x7fb4bc15e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.867 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7fb4bb59e640 1 --2- 172.21.15.86:0/881889582 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4bc0c5a00 0x7fb4bc0cbc10 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.867 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7fb4bb59e640 1 -- 172.21.15.86:0/881889582 >> 172.21.15.86:0/881889582 conn(0x7fb4bc0cd540 msgr2=0x7fb4bc0cd950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:56.868 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7f532bfff640 1 -- 172.21.15.86:0/222886130 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f532c151110 msgr2=0x7f532c0c5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:56.868 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7f532bfff640 1 --2- 172.21.15.86:0/222886130 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f532c151110 0x7f532c0c5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.868 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7f532bfff640 1 -- 172.21.15.86:0/222886130 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f532c0c88e0 msgr2=0x7f532c200990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:56.868 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7f532bfff640 1 --2- 172.21.15.86:0/222886130 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f532c0c88e0 0x7f532c200990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.868 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7fc98f59e640 1 -- 172.21.15.86:0/2729288220 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9901567c0 con 0x7fc9900ca970 2024-04-25T12:21:56.868 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7fb4bb59e640 1 -- 172.21.15.86:0/881889582 shutdown_connections 2024-04-25T12:21:56.869 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7f532bfff640 1 -- 172.21.15.86:0/222886130 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f532c153fc0 con 0x7f532c157430 2024-04-25T12:21:56.869 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7ff02cff9640 1 --2- 172.21.15.86:0/1883770888 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7ff014068380 0x7ff01406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.869 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7f532bfff640 1 --2- 172.21.15.86:0/222886130 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f532c157430 0x7f532c1531f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f531c00b440 tx=0x7f531c00b900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:56.870 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7f5313fff640 1 -- 172.21.15.86:0/222886130 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f531c015020 con 0x7f532c157430 2024-04-25T12:21:56.870 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7f5313fff640 1 -- 172.21.15.86:0/222886130 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f531c011850 con 0x7f532c157430 2024-04-25T12:21:56.870 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7f5313fff640 1 -- 172.21.15.86:0/222886130 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f531c011c40 con 0x7f532c157430 2024-04-25T12:21:56.870 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7fb4bb59e640 1 -- 172.21.15.86:0/881889582 wait complete. 2024-04-25T12:21:56.870 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7fb4bb59e640 1 Processor -- start 2024-04-25T12:21:56.870 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7f408b59e640 1 -- start start 2024-04-25T12:21:56.871 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7f408b59e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f408c0cc500 0x7f408c1414d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.871 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7f408b59e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f408c0cc8e0 0x7f408c141a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.871 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7f408b59e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f408c1503a0 0x7f408c1f8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.871 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7f408b59e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f408c0c9a60 con 0x7f408c1503a0 2024-04-25T12:21:56.871 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7f408b59e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f408c0c9710 con 0x7f408c0cc8e0 2024-04-25T12:21:56.871 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7f4089d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f408c0cc8e0 0x7f408c141a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:56.871 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7f4089d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f408c0cc8e0 0x7f408c141a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.86:55230/0 (socket says 172.21.15.86:55230) 2024-04-25T12:21:56.871 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7f4089d9b640 1 -- 172.21.15.86:0/905537120 learned_addr learned my addr 172.21.15.86:0/905537120 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:56.871 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7f408b59e640 1 -- 172.21.15.86:0/905537120 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f408c153250 con 0x7f408c0cc500 2024-04-25T12:21:56.872 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7f5330ccd640 1 -- 172.21.15.86:0/222886130 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f532c154230 con 0x7f532c157430 2024-04-25T12:21:56.872 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7f5330ccd640 1 -- 172.21.15.86:0/222886130 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f532c0c4b10 con 0x7f532c157430 2024-04-25T12:21:56.872 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7f5330ccd640 1 -- 172.21.15.86:0/222886130 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f532c076360 con 0x7f532c157430 2024-04-25T12:21:56.872 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.818+0000 7ff02cff9640 1 -- 172.21.15.86:0/1883770888 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff02408de20 con 0x7ff0280347a0 2024-04-25T12:21:56.872 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7ff02f7fe640 1 --2- 172.21.15.86:0/1883770888 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7ff014068380 0x7ff01406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:56.873 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7f408a59c640 1 --2- 172.21.15.86:0/905537120 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f408c0cc500 0x7f408c1414d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:56.873 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7ff02cff9640 1 --2- 172.21.15.86:0/1883770888 >> [v2:172.21.15.86:6800/2812764579,v1:172.21.15.86:6801/2812764579] conn(0x7ff014071b00 0x7ff014073f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.873 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7f4089d9b640 1 -- 172.21.15.86:0/905537120 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f408c0cc500 msgr2=0x7f408c1414d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:56.874 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7f96aaffd640 1 -- 172.21.15.86:0/3007317641 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f96b000e020 con 0x7f96b40d5be0 2024-04-25T12:21:56.874 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7f96aaffd640 1 --2- 172.21.15.86:0/3007317641 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f969c068380 0x7f969c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.874 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7f96aaffd640 1 -- 172.21.15.86:0/3007317641 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f96b0085c70 con 0x7f96b40d5be0 2024-04-25T12:21:56.874 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7f96aaffd640 1 --2- 172.21.15.86:0/3007317641 >> [v2:172.21.15.134:6816/1277404274,v1:172.21.15.134:6817/1277404274] conn(0x7f969c071a80 0x7f969c073ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.874 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7f96aaffd640 1 -- 172.21.15.86:0/3007317641 --> [v2:172.21.15.134:6816/1277404274,v1:172.21.15.134:6817/1277404274] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f96b0027ec0 con 0x7f969c071a80 2024-04-25T12:21:56.874 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7f96aaffd640 1 -- 172.21.15.86:0/3007317641 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f96b0086060 con 0x7f96b40d5be0 2024-04-25T12:21:56.874 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7f96ba59c640 1 --2- 172.21.15.86:0/3007317641 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f969c068380 0x7f969c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:56.874 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7fada2ffd640 1 -- 172.21.15.86:0/3377260739 <== osd.3 v2:172.21.15.86:6818/2861354413 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fad900746d0 con 0x7fad90071bc0 2024-04-25T12:21:56.875 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7ff02cff9640 1 -- 172.21.15.86:0/1883770888 --> [v2:172.21.15.86:6800/2812764579,v1:172.21.15.86:6801/2812764579] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff024012e50 con 0x7ff014071b00 2024-04-25T12:21:56.875 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7ff02cff9640 1 -- 172.21.15.86:0/1883770888 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff024091050 con 0x7ff0280347a0 2024-04-25T12:21:56.875 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7ff02f7fe640 1 --2- 172.21.15.86:0/1883770888 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7ff014068380 0x7ff01406a840 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff01c009a50 tx=0x7ff01c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:56.875 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7ff034eb3640 1 --2- 172.21.15.86:0/1883770888 >> [v2:172.21.15.86:6800/2812764579,v1:172.21.15.86:6801/2812764579] conn(0x7ff014071b00 0x7ff014073f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:56.875 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7ff034eb3640 1 --2- 172.21.15.86:0/1883770888 >> [v2:172.21.15.86:6800/2812764579,v1:172.21.15.86:6801/2812764579] conn(0x7ff014071b00 0x7ff014073f40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:56.875 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7fb4bb59e640 1 -- start start 2024-04-25T12:21:56.875 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7fb4bb59e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb4bc0c5a00 0x7fb4bc15c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.876 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7fb4bb59e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4bc0cc150 0x7fb4bc153ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.876 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7fb4bb59e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb4bc154f30 0x7fb4bc14a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.876 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7fb4bb59e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb4bc155490 con 0x7fb4bc0cc150 2024-04-25T12:21:56.876 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7fb4bb59e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb4bc155310 con 0x7fb4bc154f30 2024-04-25T12:21:56.876 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7fb4bb59e640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fb4bc15eca0 con 0x7fb4bc0c5a00 2024-04-25T12:21:56.876 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7fb4b3fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4bc0cc150 0x7fb4bc153ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:56.876 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7fb4b3fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4bc0cc150 0x7fb4bc153ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:59386/0 (socket says 172.21.15.86:59386) 2024-04-25T12:21:56.876 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7fb4b3fff640 1 -- 172.21.15.86:0/363093668 learned_addr learned my addr 172.21.15.86:0/363093668 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:56.876 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7fb4ba59c640 1 --2- 172.21.15.86:0/363093668 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb4bc0c5a00 0x7fb4bc15c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:56.876 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7f4089d9b640 1 --2- 172.21.15.86:0/905537120 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f408c0cc500 0x7f408c1414d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.877 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7f4089d9b640 1 -- 172.21.15.86:0/905537120 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f408c1503a0 msgr2=0x7f408c1f8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:56.877 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7f4089d9b640 1 --2- 172.21.15.86:0/905537120 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f408c1503a0 0x7f408c1f8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.877 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7f4089d9b640 1 -- 172.21.15.86:0/905537120 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f408c15bb20 con 0x7f408c0cc8e0 2024-04-25T12:21:56.877 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7f408a59c640 1 --2- 172.21.15.86:0/905537120 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f408c0cc500 0x7f408c1414d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:21:56.877 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7f4089d9b640 1 --2- 172.21.15.86:0/905537120 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f408c0cc8e0 0x7f408c141a10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f40840020f0 tx=0x7f408400a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:56.877 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7f407affd640 1 -- 172.21.15.86:0/905537120 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4084018070 con 0x7f408c0cc8e0 2024-04-25T12:21:56.877 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7f407affd640 1 -- 172.21.15.86:0/905537120 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4084007310 con 0x7f408c0cc8e0 2024-04-25T12:21:56.877 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7f407affd640 1 -- 172.21.15.86:0/905537120 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4084007700 con 0x7f408c0cc8e0 2024-04-25T12:21:56.877 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7f408b59e640 1 -- 172.21.15.86:0/905537120 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f408c15bdc0 con 0x7f408c0cc8e0 2024-04-25T12:21:56.877 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7f408b59e640 1 -- 172.21.15.86:0/905537120 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f408c1e2480 con 0x7f408c0cc8e0 2024-04-25T12:21:56.878 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7f27c71d1640 1 -- 172.21.15.86:0/2413793892 shutdown_connections 2024-04-25T12:21:56.878 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7f27c71d1640 1 -- 172.21.15.86:0/2413793892 wait complete. 2024-04-25T12:21:56.878 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7f96bad9d640 1 --2- 172.21.15.86:0/3007317641 >> [v2:172.21.15.134:6816/1277404274,v1:172.21.15.134:6817/1277404274] conn(0x7f969c071a80 0x7f969c073ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:56.878 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7f96ba59c640 1 --2- 172.21.15.86:0/3007317641 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f969c068380 0x7f969c06a840 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f96ac0094a0 tx=0x7f96ac009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:56.878 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7f96bad9d640 1 --2- 172.21.15.86:0/3007317641 >> [v2:172.21.15.134:6816/1277404274,v1:172.21.15.134:6817/1277404274] conn(0x7f969c071a80 0x7f969c073ec0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:56.878 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7f408b59e640 1 -- 172.21.15.86:0/905537120 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f408c1e1f50 con 0x7f408c0cc8e0 2024-04-25T12:21:56.879 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7f27c71d1640 1 Processor -- start 2024-04-25T12:21:56.879 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7fc98f59e640 1 -- 172.21.15.86:0/2729288220 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc9900c5530 con 0x7fc9900ca970 2024-04-25T12:21:56.879 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7fc97effd640 1 -- 172.21.15.86:0/2729288220 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc9800bc070 con 0x7fc9900ca970 2024-04-25T12:21:56.879 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7fc97effd640 1 --2- 172.21.15.86:0/2729288220 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fc970068380 0x7fc97006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.879 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7fc97effd640 1 -- 172.21.15.86:0/2729288220 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fc9801209a0 con 0x7fc9900ca970 2024-04-25T12:21:56.880 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7fc97effd640 1 --2- 172.21.15.86:0/2729288220 >> [v2:172.21.15.86:6808/467966038,v1:172.21.15.86:6809/467966038] conn(0x7fc970071a80 0x7fc970073ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.880 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7fc97effd640 1 -- 172.21.15.86:0/2729288220 --> [v2:172.21.15.86:6808/467966038,v1:172.21.15.86:6809/467966038] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc980001d40 con 0x7fc970071a80 2024-04-25T12:21:56.880 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7fc98ed9d640 1 --2- 172.21.15.86:0/2729288220 >> [v2:172.21.15.86:6808/467966038,v1:172.21.15.86:6809/467966038] conn(0x7fc970071a80 0x7fc970073ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:56.880 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7f27c71d1640 1 -- start start 2024-04-25T12:21:56.880 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7fc97effd640 1 -- 172.21.15.86:0/2729288220 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc9800ec740 con 0x7fc9900ca970 2024-04-25T12:21:56.880 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.826+0000 7fc98ed9d640 1 --2- 172.21.15.86:0/2729288220 >> [v2:172.21.15.86:6808/467966038,v1:172.21.15.86:6809/467966038] conn(0x7fc970071a80 0x7fc970073ec0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:56.881 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7f96aaffd640 1 -- 172.21.15.86:0/3007317641 <== osd.7 v2:172.21.15.134:6816/1277404274 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f96b0027ec0 con 0x7f969c071a80 2024-04-25T12:21:56.881 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.826+0000 7fc97effd640 1 -- 172.21.15.86:0/2729288220 <== osd.1 v2:172.21.15.86:6808/467966038 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc980001d40 con 0x7fc970071a80 2024-04-25T12:21:56.881 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.826+0000 7fb4bad9d640 1 --2- 172.21.15.86:0/363093668 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb4bc154f30 0x7fb4bc14a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:56.881 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.826+0000 7fb4b3fff640 1 -- 172.21.15.86:0/363093668 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb4bc0c5a00 msgr2=0x7fb4bc15c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:56.882 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.826+0000 7f407affd640 1 -- 172.21.15.86:0/905537120 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f40840078a0 con 0x7f408c0cc8e0 2024-04-25T12:21:56.882 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.826+0000 7fc98dd9b640 1 --2- 172.21.15.86:0/2729288220 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fc970068380 0x7fc97006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:56.882 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.826+0000 7f407affd640 1 --2- 172.21.15.86:0/905537120 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f406c068380 0x7f406c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.883 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.826+0000 7fb4b3fff640 1 --2- 172.21.15.86:0/363093668 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb4bc0c5a00 0x7fb4bc15c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.883 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.826+0000 7fb4b3fff640 1 -- 172.21.15.86:0/363093668 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb4bc154f30 msgr2=0x7fb4bc14a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:56.883 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.826+0000 7fb4b3fff640 1 --2- 172.21.15.86:0/363093668 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb4bc154f30 0x7fb4bc14a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.883 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.826+0000 7fb4b3fff640 1 -- 172.21.15.86:0/363093668 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4bc15d580 con 0x7fb4bc0cc150 2024-04-25T12:21:56.883 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.826+0000 7f407affd640 1 -- 172.21.15.86:0/905537120 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f4084087590 con 0x7f408c0cc8e0 2024-04-25T12:21:56.883 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.826+0000 7ff02cff9640 1 -- 172.21.15.86:0/1883770888 <== osd.0 v2:172.21.15.86:6800/2812764579 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff024012e50 con 0x7ff014071b00 2024-04-25T12:21:56.884 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.826+0000 7f407affd640 1 --2- 172.21.15.86:0/905537120 >> [v2:172.21.15.134:6800/1872913602,v1:172.21.15.134:6802/1872913602] conn(0x7f406c0719f0 0x7f406c073e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.884 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.826+0000 7f407affd640 1 -- 172.21.15.86:0/905537120 --> [v2:172.21.15.134:6800/1872913602,v1:172.21.15.134:6802/1872913602] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f406c074500 con 0x7f406c0719f0 2024-04-25T12:21:56.884 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.826+0000 7f407affd640 1 -- 172.21.15.86:0/905537120 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4084087a20 con 0x7f408c0cc8e0 2024-04-25T12:21:56.884 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.826+0000 7fb4b3fff640 1 --2- 172.21.15.86:0/363093668 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4bc0cc150 0x7fb4bc153ac0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac0b3040 tx=0x7fb4ac01bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:56.885 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.826+0000 7fb4b2ffd640 1 -- 172.21.15.86:0/363093668 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4ac0b5070 con 0x7fb4bc0cc150 2024-04-25T12:21:56.885 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.826+0000 7fb4b2ffd640 1 -- 172.21.15.86:0/363093668 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4ac0b0a50 con 0x7fb4bc0cc150 2024-04-25T12:21:56.885 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.826+0000 7fb4b2ffd640 1 -- 172.21.15.86:0/363093668 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4ac0b0e20 con 0x7fb4bc0cc150 2024-04-25T12:21:56.885 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.826+0000 7f408a59c640 1 --2- 172.21.15.86:0/905537120 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f406c068380 0x7f406c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:56.886 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.826+0000 7f27c71d1640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27c00c89c0 0x7f27c0168800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.886 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.826+0000 7f27c71d1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27c00c92b0 0x7f27c01ff760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.886 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.826+0000 7f27c71d1640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f27c00c9690 0x7f27c0160720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.886 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.826+0000 7f27c71d1640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f27c0165580 con 0x7f27c00c89c0 2024-04-25T12:21:56.886 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.826+0000 7f27c71d1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f27c016bdf0 con 0x7f27c00c92b0 2024-04-25T12:21:56.886 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.826+0000 7f27c71d1640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f27c0165700 con 0x7f27c00c9690 2024-04-25T12:21:56.886 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.826+0000 7f27c69d0640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f27c00c9690 0x7f27c0160720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:56.886 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.826+0000 7f27c69d0640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f27c00c9690 0x7f27c0160720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.86:42998/0 (socket says 172.21.15.86:42998) 2024-04-25T12:21:56.886 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.826+0000 7f27c69d0640 1 -- 172.21.15.86:0/419909456 learned_addr learned my addr 172.21.15.86:0/419909456 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:56.886 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.826+0000 7f27c61cf640 1 --2- 172.21.15.86:0/419909456 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27c00c89c0 0x7f27c0168800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:56.886 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.826+0000 7f27c59ce640 1 --2- 172.21.15.86:0/419909456 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27c00c92b0 0x7f27c01ff760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:56.886 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.826+0000 7f27c69d0640 1 -- 172.21.15.86:0/419909456 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27c00c92b0 msgr2=0x7f27c01ff760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:56.887 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.826+0000 7f27c69d0640 1 --2- 172.21.15.86:0/419909456 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27c00c92b0 0x7f27c01ff760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.887 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.826+0000 7f27c69d0640 1 -- 172.21.15.86:0/419909456 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27c00c89c0 msgr2=0x7f27c0168800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:56.887 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.826+0000 7f27c69d0640 1 --2- 172.21.15.86:0/419909456 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27c00c89c0 0x7f27c0168800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.887 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.826+0000 7f27c69d0640 1 -- 172.21.15.86:0/419909456 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27c01ffca0 con 0x7f27c00c9690 2024-04-25T12:21:56.887 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.826+0000 7fb4ba59c640 1 --2- 172.21.15.86:0/363093668 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb4bc0c5a00 0x7fb4bc15c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T12:21:56.887 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.830+0000 7fc98dd9b640 1 --2- 172.21.15.86:0/2729288220 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fc970068380 0x7fc97006a840 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc9900ce560 tx=0x7fc984007a60 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:56.888 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.830+0000 7fb4bb59e640 1 -- 172.21.15.86:0/363093668 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4bc152760 con 0x7fb4bc0cc150 2024-04-25T12:21:56.888 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.830+0000 7fb4bb59e640 1 -- 172.21.15.86:0/363093668 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4bc152d00 con 0x7fb4bc0cc150 2024-04-25T12:21:56.888 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.830+0000 7fb4bb59e640 1 -- 172.21.15.86:0/363093668 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb4bc0c7f70 con 0x7fb4bc0cc150 2024-04-25T12:21:56.888 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7f5313fff640 1 -- 172.21.15.86:0/222886130 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f531c018020 con 0x7f532c157430 2024-04-25T12:21:56.888 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7f5313fff640 1 --2- 172.21.15.86:0/222886130 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f53180683b0 0x7f531806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.888 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7f5313fff640 1 -- 172.21.15.86:0/222886130 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f531c086d60 con 0x7f532c157430 2024-04-25T12:21:56.888 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7f5313fff640 1 --2- 172.21.15.86:0/222886130 >> [v2:172.21.15.134:6824/2841082767,v1:172.21.15.134:6825/2841082767] conn(0x7f5318071a30 0x7f5318073e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.888 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7f5313fff640 1 -- 172.21.15.86:0/222886130 --> [v2:172.21.15.134:6824/2841082767,v1:172.21.15.134:6825/2841082767] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f531c018ec0 con 0x7f5318071a30 2024-04-25T12:21:56.889 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7f5313fff640 1 -- 172.21.15.86:0/222886130 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f531c0871c0 con 0x7f532c157430 2024-04-25T12:21:56.889 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.822+0000 7f532affd640 1 --2- 172.21.15.86:0/222886130 >> [v2:172.21.15.134:6824/2841082767,v1:172.21.15.134:6825/2841082767] conn(0x7f5318071a30 0x7f5318073e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:56.889 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.826+0000 7f532affd640 1 --2- 172.21.15.86:0/222886130 >> [v2:172.21.15.134:6824/2841082767,v1:172.21.15.134:6825/2841082767] conn(0x7f5318071a30 0x7f5318073e70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:56.889 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.826+0000 7f5313fff640 1 -- 172.21.15.86:0/222886130 <== osd.6 v2:172.21.15.134:6824/2841082767 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f531c018ec0 con 0x7f5318071a30 2024-04-25T12:21:56.889 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.830+0000 7f532b7fe640 1 --2- 172.21.15.86:0/222886130 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f53180683b0 0x7f531806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:56.889 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.830+0000 7f532b7fe640 1 --2- 172.21.15.86:0/222886130 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f53180683b0 0x7f531806a870 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f53240b1000 tx=0x7f5324004ac0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:56.889 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.834+0000 7f408ad9d640 1 --2- 172.21.15.86:0/905537120 >> [v2:172.21.15.134:6800/1872913602,v1:172.21.15.134:6802/1872913602] conn(0x7f406c0719f0 0x7f406c073e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:56.890 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.834+0000 7fb4b2ffd640 1 -- 172.21.15.86:0/363093668 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb4ac0c2060 con 0x7fb4bc0cc150 2024-04-25T12:21:56.890 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.834+0000 7fb4b2ffd640 1 --2- 172.21.15.86:0/363093668 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fb49c068380 0x7fb49c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.890 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.834+0000 7fb4b2ffd640 1 -- 172.21.15.86:0/363093668 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fb4ac124390 con 0x7fb4bc0cc150 2024-04-25T12:21:56.890 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.834+0000 7fb4ba59c640 1 --2- 172.21.15.86:0/363093668 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fb49c068380 0x7fb49c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:56.890 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.834+0000 7fb4b2ffd640 1 --2- 172.21.15.86:0/363093668 >> [v2:172.21.15.86:6816/3279762843,v1:172.21.15.86:6817/3279762843] conn(0x7fb49c071a80 0x7fb49c073ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.890 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.834+0000 7fb4b2ffd640 1 -- 172.21.15.86:0/363093668 --> [v2:172.21.15.86:6816/3279762843,v1:172.21.15.86:6817/3279762843] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb49c074590 con 0x7fb49c071a80 2024-04-25T12:21:56.890 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.834+0000 7fb4b2ffd640 1 -- 172.21.15.86:0/363093668 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb4ac124780 con 0x7fb4bc0cc150 2024-04-25T12:21:56.890 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.834+0000 7fb4bad9d640 1 --2- 172.21.15.86:0/363093668 >> [v2:172.21.15.86:6816/3279762843,v1:172.21.15.86:6817/3279762843] conn(0x7fb49c071a80 0x7fb49c073ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:56.890 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.834+0000 7f408a59c640 1 --2- 172.21.15.86:0/905537120 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f406c068380 0x7f406c06a840 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4080009b50 tx=0x7f4080008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:56.891 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.834+0000 7f408ad9d640 1 --2- 172.21.15.86:0/905537120 >> [v2:172.21.15.134:6800/1872913602,v1:172.21.15.134:6802/1872913602] conn(0x7f406c0719f0 0x7f406c073e30 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:56.891 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.834+0000 7f27c69d0640 1 --2- 172.21.15.86:0/419909456 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f27c00c9690 0x7f27c0160720 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f27b801ecd0 tx=0x7f27b801d3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:56.891 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.834+0000 7f27b6ffd640 1 -- 172.21.15.86:0/419909456 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b80074f0 con 0x7f27c00c9690 2024-04-25T12:21:56.891 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.834+0000 7f27b6ffd640 1 -- 172.21.15.86:0/419909456 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27b80b0e40 con 0x7f27c00c9690 2024-04-25T12:21:56.891 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.834+0000 7f27c71d1640 1 -- 172.21.15.86:0/419909456 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27c0167030 con 0x7f27c00c9690 2024-04-25T12:21:56.891 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.834+0000 7f27b6ffd640 1 -- 172.21.15.86:0/419909456 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b80c3610 con 0x7f27c00c9690 2024-04-25T12:21:56.891 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.834+0000 7f27c71d1640 1 -- 172.21.15.86:0/419909456 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f27c01672d0 con 0x7f27c00c9690 2024-04-25T12:21:56.891 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.838+0000 7f27c71d1640 1 -- 172.21.15.86:0/419909456 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f27c0076360 con 0x7f27c00c9690 2024-04-25T12:21:56.892 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.838+0000 7fb4bad9d640 1 --2- 172.21.15.86:0/363093668 >> [v2:172.21.15.86:6816/3279762843,v1:172.21.15.86:6817/3279762843] conn(0x7fb49c071a80 0x7fb49c073ec0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:56.892 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.838+0000 7f407affd640 1 -- 172.21.15.86:0/905537120 <== osd.4 v2:172.21.15.134:6800/1872913602 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f406c074500 con 0x7f406c0719f0 2024-04-25T12:21:56.892 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.838+0000 7fb4b2ffd640 1 -- 172.21.15.86:0/363093668 <== osd.2 v2:172.21.15.86:6816/3279762843 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb49c074590 con 0x7fb49c071a80 2024-04-25T12:21:56.892 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.838+0000 7fb4ba59c640 1 --2- 172.21.15.86:0/363093668 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fb49c068380 0x7fb49c06a840 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb4a4006fd0 tx=0x7fb4a4009060 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:56.893 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.838+0000 7f27b6ffd640 1 -- 172.21.15.86:0/419909456 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f27b80b93f0 con 0x7f27c00c9690 2024-04-25T12:21:56.893 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.838+0000 7f27b6ffd640 1 --2- 172.21.15.86:0/419909456 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f27a4070b90 0x7f27a4073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.893 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.838+0000 7f27b6ffd640 1 -- 172.21.15.86:0/419909456 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f27b8125340 con 0x7f27c00c9690 2024-04-25T12:21:56.893 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.838+0000 7f27b6ffd640 1 --2- 172.21.15.86:0/419909456 >> [v2:172.21.15.134:6801/2261413981,v1:172.21.15.134:6803/2261413981] conn(0x7f27a407a300 0x7f27a407c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:56.893 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.838+0000 7f27b6ffd640 1 -- 172.21.15.86:0/419909456 --> [v2:172.21.15.134:6801/2261413981,v1:172.21.15.134:6803/2261413981] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f27b800cff0 con 0x7f27a407a300 2024-04-25T12:21:56.893 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.838+0000 7f27b6ffd640 1 -- 172.21.15.86:0/419909456 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f27b8125730 con 0x7f27c00c9690 2024-04-25T12:21:56.894 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.838+0000 7f27c61cf640 1 --2- 172.21.15.86:0/419909456 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f27a4070b90 0x7f27a4073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:56.894 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.838+0000 7f27c59ce640 1 --2- 172.21.15.86:0/419909456 >> [v2:172.21.15.134:6801/2261413981,v1:172.21.15.134:6803/2261413981] conn(0x7f27a407a300 0x7f27a407c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:56.894 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.838+0000 7f27c59ce640 1 --2- 172.21.15.86:0/419909456 >> [v2:172.21.15.134:6801/2261413981,v1:172.21.15.134:6803/2261413981] conn(0x7f27a407a300 0x7f27a407c740 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:56.894 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.838+0000 7f27c61cf640 1 --2- 172.21.15.86:0/419909456 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f27a4070b90 0x7f27a4073050 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f27b0009b60 tx=0x7f27b0009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:56.894 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.842+0000 7f96bb59e640 1 -- 172.21.15.86:0/3007317641 --> [v2:172.21.15.134:6816/1277404274,v1:172.21.15.134:6817/1277404274] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f96b40d53f0 con 0x7f969c071a80 2024-04-25T12:21:56.894 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.842+0000 7f27b6ffd640 1 -- 172.21.15.86:0/419909456 <== osd.5 v2:172.21.15.134:6801/2261413981 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f27b800cff0 con 0x7f27a407a300 2024-04-25T12:21:56.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.842+0000 7f96aaffd640 1 -- 172.21.15.86:0/3007317641 <== osd.7 v2:172.21.15.134:6816/1277404274 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f96b40d53f0 con 0x7f969c071a80 2024-04-25T12:21:56.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.850+0000 7f96bb59e640 1 -- 172.21.15.86:0/3007317641 >> [v2:172.21.15.134:6816/1277404274,v1:172.21.15.134:6817/1277404274] conn(0x7f969c071a80 msgr2=0x7f969c073ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:56.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.850+0000 7f96bb59e640 1 --2- 172.21.15.86:0/3007317641 >> [v2:172.21.15.134:6816/1277404274,v1:172.21.15.134:6817/1277404274] conn(0x7f969c071a80 0x7f969c073ec0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.854+0000 7f96bb59e640 1 -- 172.21.15.86:0/3007317641 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f969c068380 msgr2=0x7f969c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:56.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.854+0000 7f96bb59e640 1 --2- 172.21.15.86:0/3007317641 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f969c068380 0x7f969c06a840 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f96ac0094a0 tx=0x7f96ac009240 comp rx=0 tx=0).stop 2024-04-25T12:21:56.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.854+0000 7f96bb59e640 1 -- 172.21.15.86:0/3007317641 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96b40d5be0 msgr2=0x7f96b40d1ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:56.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.854+0000 7f96bb59e640 1 --2- 172.21.15.86:0/3007317641 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96b40d5be0 0x7f96b40d1ab0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f96b001d430 tx=0x7f96b001d8f0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.854+0000 7f96bad9d640 1 -- 172.21.15.86:0/3007317641 reap_dead start 2024-04-25T12:21:56.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.854+0000 7f96bb59e640 1 -- 172.21.15.86:0/3007317641 shutdown_connections 2024-04-25T12:21:56.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.854+0000 7f96bb59e640 1 -- 172.21.15.86:0/3007317641 >> 172.21.15.86:0/3007317641 conn(0x7f96b4050190 msgr2=0x7f96b4033090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:56.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.854+0000 7f96bb59e640 1 -- 172.21.15.86:0/3007317641 shutdown_connections 2024-04-25T12:21:56.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.854+0000 7f96bb59e640 1 -- 172.21.15.86:0/3007317641 wait complete. 2024-04-25T12:21:56.897 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.854+0000 7ff036916640 1 -- 172.21.15.86:0/1883770888 --> [v2:172.21.15.86:6800/2812764579,v1:172.21.15.86:6801/2812764579] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff0280053a0 con 0x7ff014071b00 2024-04-25T12:21:56.897 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.854+0000 7fadb3171640 1 -- 172.21.15.86:0/3377260739 --> [v2:172.21.15.86:6818/2861354413,v1:172.21.15.86:6821/2861354413] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fada40d64d0 con 0x7fad90071bc0 2024-04-25T12:21:56.897 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.854+0000 7fada2ffd640 1 -- 172.21.15.86:0/3377260739 <== osd.3 v2:172.21.15.86:6818/2861354413 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fadac12b400 con 0x7fad90071bc0 2024-04-25T12:21:56.897 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.854+0000 7ff02cff9640 1 -- 172.21.15.86:0/1883770888 <== osd.0 v2:172.21.15.86:6800/2812764579 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff0280053a0 con 0x7ff014071b00 2024-04-25T12:21:56.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.854+0000 7ff01a7fc640 1 -- 172.21.15.86:0/1883770888 >> [v2:172.21.15.86:6800/2812764579,v1:172.21.15.86:6801/2812764579] conn(0x7ff014071b00 msgr2=0x7ff014073f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:56.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.854+0000 7ff01a7fc640 1 --2- 172.21.15.86:0/1883770888 >> [v2:172.21.15.86:6800/2812764579,v1:172.21.15.86:6801/2812764579] conn(0x7ff014071b00 0x7ff014073f40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.854+0000 7ff01a7fc640 1 -- 172.21.15.86:0/1883770888 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7ff014068380 msgr2=0x7ff01406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:56.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.854+0000 7ff01a7fc640 1 --2- 172.21.15.86:0/1883770888 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7ff014068380 0x7ff01406a840 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff01c009a50 tx=0x7ff01c008040 comp rx=0 tx=0).stop 2024-04-25T12:21:56.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.854+0000 7ff01a7fc640 1 -- 172.21.15.86:0/1883770888 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0280347a0 msgr2=0x7ff0280c3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:56.899 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.854+0000 7ff01a7fc640 1 --2- 172.21.15.86:0/1883770888 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0280347a0 0x7ff0280c3b20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff02400ba90 tx=0x7ff02400bf50 comp rx=0 tx=0).stop 2024-04-25T12:21:56.899 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.854+0000 7ff034eb3640 1 -- 172.21.15.86:0/1883770888 reap_dead start 2024-04-25T12:21:56.899 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.854+0000 7ff01a7fc640 1 -- 172.21.15.86:0/1883770888 shutdown_connections 2024-04-25T12:21:56.899 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.854+0000 7ff01a7fc640 1 -- 172.21.15.86:0/1883770888 >> 172.21.15.86:0/1883770888 conn(0x7ff028050190 msgr2=0x7ff028045e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:56.899 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.854+0000 7ff01a7fc640 1 -- 172.21.15.86:0/1883770888 shutdown_connections 2024-04-25T12:21:56.899 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.854+0000 7ff01a7fc640 1 -- 172.21.15.86:0/1883770888 wait complete. 2024-04-25T12:21:56.899 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.854+0000 7f5330ccd640 1 -- 172.21.15.86:0/222886130 --> [v2:172.21.15.134:6824/2841082767,v1:172.21.15.134:6825/2841082767] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f532c154840 con 0x7f5318071a30 2024-04-25T12:21:56.900 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.858+0000 7fada0ff9640 1 -- 172.21.15.86:0/3377260739 >> [v2:172.21.15.86:6818/2861354413,v1:172.21.15.86:6821/2861354413] conn(0x7fad90071bc0 msgr2=0x7fad90074000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:56.900 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.858+0000 7fada0ff9640 1 --2- 172.21.15.86:0/3377260739 >> [v2:172.21.15.86:6818/2861354413,v1:172.21.15.86:6821/2861354413] conn(0x7fad90071bc0 0x7fad90074000 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.900 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.858+0000 7fada0ff9640 1 -- 172.21.15.86:0/3377260739 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fad90068450 msgr2=0x7fad9006a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:56.900 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.858+0000 7fada0ff9640 1 --2- 172.21.15.86:0/3377260739 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fad90068450 0x7fad9006a910 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fad9c006aa0 tx=0x7fad9c006a30 comp rx=0 tx=0).stop 2024-04-25T12:21:56.900 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.858+0000 7fada0ff9640 1 -- 172.21.15.86:0/3377260739 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fada4046880 msgr2=0x7fada40359f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:56.900 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.858+0000 7fada0ff9640 1 --2- 172.21.15.86:0/3377260739 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fada4046880 0x7fada40359f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fada800b410 tx=0x7fada800b8d0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.900 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.858+0000 7fadb2970640 1 -- 172.21.15.86:0/3377260739 reap_dead start 2024-04-25T12:21:56.900 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.858+0000 7fada0ff9640 1 -- 172.21.15.86:0/3377260739 shutdown_connections 2024-04-25T12:21:56.900 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.858+0000 7fada0ff9640 1 -- 172.21.15.86:0/3377260739 >> 172.21.15.86:0/3377260739 conn(0x7fada404dd40 msgr2=0x7fada40d3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:56.900 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.858+0000 7fada0ff9640 1 -- 172.21.15.86:0/3377260739 shutdown_connections 2024-04-25T12:21:56.900 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.858+0000 7fada0ff9640 1 -- 172.21.15.86:0/3377260739 wait complete. 2024-04-25T12:21:56.901 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.858+0000 7f5313fff640 1 -- 172.21.15.86:0/222886130 <== osd.6 v2:172.21.15.134:6824/2841082767 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f532c154840 con 0x7f5318071a30 2024-04-25T12:21:56.902 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.858+0000 7f5330ccd640 1 -- 172.21.15.86:0/222886130 >> [v2:172.21.15.134:6824/2841082767,v1:172.21.15.134:6825/2841082767] conn(0x7f5318071a30 msgr2=0x7f5318073e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:56.902 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.858+0000 7f5330ccd640 1 --2- 172.21.15.86:0/222886130 >> [v2:172.21.15.134:6824/2841082767,v1:172.21.15.134:6825/2841082767] conn(0x7f5318071a30 0x7f5318073e70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.902 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.858+0000 7f5330ccd640 1 -- 172.21.15.86:0/222886130 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f53180683b0 msgr2=0x7f531806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:56.902 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.858+0000 7f5330ccd640 1 --2- 172.21.15.86:0/222886130 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f53180683b0 0x7f531806a870 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f53240b1000 tx=0x7f5324004ac0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.902 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.858+0000 7f5330ccd640 1 -- 172.21.15.86:0/222886130 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f532c157430 msgr2=0x7f532c1531f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:56.902 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.858+0000 7f5330ccd640 1 --2- 172.21.15.86:0/222886130 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f532c157430 0x7f532c1531f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f531c00b440 tx=0x7f531c00b900 comp rx=0 tx=0).stop 2024-04-25T12:21:56.902 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.858+0000 7f532bfff640 1 -- 172.21.15.86:0/222886130 reap_dead start 2024-04-25T12:21:56.902 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.858+0000 7f5330ccd640 1 -- 172.21.15.86:0/222886130 shutdown_connections 2024-04-25T12:21:56.903 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.858+0000 7f5330ccd640 1 -- 172.21.15.86:0/222886130 >> 172.21.15.86:0/222886130 conn(0x7f532c06eb20 msgr2=0x7f532c0c7b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:56.903 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.858+0000 7f408b59e640 1 -- 172.21.15.86:0/905537120 --> [v2:172.21.15.134:6800/1872913602,v1:172.21.15.134:6802/1872913602] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f408c076360 con 0x7f406c0719f0 2024-04-25T12:21:56.903 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.858+0000 7f407affd640 1 -- 172.21.15.86:0/905537120 <== osd.4 v2:172.21.15.134:6800/1872913602 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f408c076360 con 0x7f406c0719f0 2024-04-25T12:21:56.903 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.862+0000 7fc98f59e640 1 -- 172.21.15.86:0/2729288220 --> [v2:172.21.15.86:6808/467966038,v1:172.21.15.86:6809/467966038] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc990076360 con 0x7fc970071a80 2024-04-25T12:21:56.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.862+0000 7f4078ff9640 1 -- 172.21.15.86:0/905537120 >> [v2:172.21.15.134:6800/1872913602,v1:172.21.15.134:6802/1872913602] conn(0x7f406c0719f0 msgr2=0x7f406c073e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:56.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.862+0000 7f4078ff9640 1 --2- 172.21.15.86:0/905537120 >> [v2:172.21.15.134:6800/1872913602,v1:172.21.15.134:6802/1872913602] conn(0x7f406c0719f0 0x7f406c073e30 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.862+0000 7f4078ff9640 1 -- 172.21.15.86:0/905537120 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f406c068380 msgr2=0x7f406c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:56.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.862+0000 7f4078ff9640 1 --2- 172.21.15.86:0/905537120 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f406c068380 0x7f406c06a840 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4080009b50 tx=0x7f4080008040 comp rx=0 tx=0).stop 2024-04-25T12:21:56.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.862+0000 7f4078ff9640 1 -- 172.21.15.86:0/905537120 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f408c0cc8e0 msgr2=0x7f408c141a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:56.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.862+0000 7f4078ff9640 1 --2- 172.21.15.86:0/905537120 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f408c0cc8e0 0x7f408c141a10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f40840020f0 tx=0x7f408400a430 comp rx=0 tx=0).stop 2024-04-25T12:21:56.905 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.862+0000 7f408ad9d640 1 -- 172.21.15.86:0/905537120 reap_dead start 2024-04-25T12:21:56.905 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.862+0000 7f4078ff9640 1 -- 172.21.15.86:0/905537120 shutdown_connections 2024-04-25T12:21:56.905 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.862+0000 7f4078ff9640 1 -- 172.21.15.86:0/905537120 >> 172.21.15.86:0/905537120 conn(0x7f408c06f940 msgr2=0x7f408c06d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:56.905 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.862+0000 7f4078ff9640 1 -- 172.21.15.86:0/905537120 shutdown_connections 2024-04-25T12:21:56.905 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.862+0000 7f5330ccd640 1 -- 172.21.15.86:0/222886130 shutdown_connections 2024-04-25T12:21:56.905 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.862+0000 7f5330ccd640 1 -- 172.21.15.86:0/222886130 wait complete. 2024-04-25T12:21:56.906 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.862+0000 7fc97effd640 1 -- 172.21.15.86:0/2729288220 <== osd.1 v2:172.21.15.86:6808/467966038 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc990076360 con 0x7fc970071a80 2024-04-25T12:21:56.906 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.862+0000 7f4078ff9640 1 -- 172.21.15.86:0/905537120 wait complete. 2024-04-25T12:21:56.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.862+0000 7fc98f59e640 1 -- 172.21.15.86:0/2729288220 >> [v2:172.21.15.86:6808/467966038,v1:172.21.15.86:6809/467966038] conn(0x7fc970071a80 msgr2=0x7fc970073ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:56.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.862+0000 7fc98f59e640 1 --2- 172.21.15.86:0/2729288220 >> [v2:172.21.15.86:6808/467966038,v1:172.21.15.86:6809/467966038] conn(0x7fc970071a80 0x7fc970073ec0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.862+0000 7fc98f59e640 1 -- 172.21.15.86:0/2729288220 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fc970068380 msgr2=0x7fc97006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:56.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.862+0000 7fc98f59e640 1 --2- 172.21.15.86:0/2729288220 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fc970068380 0x7fc97006a840 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc9900ce560 tx=0x7fc984007a60 comp rx=0 tx=0).stop 2024-04-25T12:21:56.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.862+0000 7fc98f59e640 1 -- 172.21.15.86:0/2729288220 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9900ca970 msgr2=0x7fc9901604d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:56.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.862+0000 7fc98f59e640 1 --2- 172.21.15.86:0/2729288220 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9900ca970 0x7fc9901604d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc98001aaa0 tx=0x7fc980019190 comp rx=0 tx=0).stop 2024-04-25T12:21:56.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.862+0000 7fc98ed9d640 1 -- 172.21.15.86:0/2729288220 reap_dead start 2024-04-25T12:21:56.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.862+0000 7fc98f59e640 1 -- 172.21.15.86:0/2729288220 shutdown_connections 2024-04-25T12:21:56.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.862+0000 7fc98f59e640 1 -- 172.21.15.86:0/2729288220 >> 172.21.15.86:0/2729288220 conn(0x7fc9900cb0e0 msgr2=0x7fc9900cef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:56.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.862+0000 7fc98f59e640 1 -- 172.21.15.86:0/2729288220 shutdown_connections 2024-04-25T12:21:56.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.866+0000 7fc98f59e640 1 -- 172.21.15.86:0/2729288220 wait complete. 2024-04-25T12:21:56.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.866+0000 7fb4bb59e640 1 -- 172.21.15.86:0/363093668 --> [v2:172.21.15.86:6816/3279762843,v1:172.21.15.86:6817/3279762843] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb4bc076360 con 0x7fb49c071a80 2024-04-25T12:21:56.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.866+0000 7f27c71d1640 1 -- 172.21.15.86:0/419909456 --> [v2:172.21.15.134:6801/2261413981,v1:172.21.15.134:6803/2261413981] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f27c008ddc0 con 0x7f27a407a300 2024-04-25T12:21:56.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.866+0000 7fb4b2ffd640 1 -- 172.21.15.86:0/363093668 <== osd.2 v2:172.21.15.86:6816/3279762843 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb4bc076360 con 0x7fb49c071a80 2024-04-25T12:21:56.909 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.866+0000 7f27b6ffd640 1 -- 172.21.15.86:0/419909456 <== osd.5 v2:172.21.15.134:6801/2261413981 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f27c008ddc0 con 0x7f27a407a300 2024-04-25T12:21:56.909 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.866+0000 7f27c71d1640 1 -- 172.21.15.86:0/419909456 >> [v2:172.21.15.134:6801/2261413981,v1:172.21.15.134:6803/2261413981] conn(0x7f27a407a300 msgr2=0x7f27a407c740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:56.909 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.866+0000 7f27c71d1640 1 --2- 172.21.15.86:0/419909456 >> [v2:172.21.15.134:6801/2261413981,v1:172.21.15.134:6803/2261413981] conn(0x7f27a407a300 0x7f27a407c740 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.866+0000 7f27c71d1640 1 -- 172.21.15.86:0/419909456 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f27a4070b90 msgr2=0x7f27a4073050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:56.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.866+0000 7f27c71d1640 1 --2- 172.21.15.86:0/419909456 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f27a4070b90 0x7f27a4073050 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f27b0009b60 tx=0x7f27b0009190 comp rx=0 tx=0).stop 2024-04-25T12:21:56.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.866+0000 7f27c71d1640 1 -- 172.21.15.86:0/419909456 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f27c00c9690 msgr2=0x7f27c0160720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:56.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.866+0000 7f27c71d1640 1 --2- 172.21.15.86:0/419909456 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f27c00c9690 0x7f27c0160720 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f27b801ecd0 tx=0x7f27b801d3c0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.870+0000 7fb4bb59e640 1 -- 172.21.15.86:0/363093668 >> [v2:172.21.15.86:6816/3279762843,v1:172.21.15.86:6817/3279762843] conn(0x7fb49c071a80 msgr2=0x7fb49c073ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:56.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.870+0000 7fb4bb59e640 1 --2- 172.21.15.86:0/363093668 >> [v2:172.21.15.86:6816/3279762843,v1:172.21.15.86:6817/3279762843] conn(0x7fb49c071a80 0x7fb49c073ec0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.870+0000 7fb4bb59e640 1 -- 172.21.15.86:0/363093668 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fb49c068380 msgr2=0x7fb49c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:56.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.870+0000 7fb4bb59e640 1 --2- 172.21.15.86:0/363093668 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fb49c068380 0x7fb49c06a840 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb4a4006fd0 tx=0x7fb4a4009060 comp rx=0 tx=0).stop 2024-04-25T12:21:56.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.870+0000 7fb4bb59e640 1 -- 172.21.15.86:0/363093668 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4bc0cc150 msgr2=0x7fb4bc153ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:56.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.870+0000 7fb4bb59e640 1 --2- 172.21.15.86:0/363093668 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4bc0cc150 0x7fb4bc153ac0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac0b3040 tx=0x7fb4ac01bad0 comp rx=0 tx=0).stop 2024-04-25T12:21:56.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.870+0000 7fb4bad9d640 1 -- 172.21.15.86:0/363093668 reap_dead start 2024-04-25T12:21:56.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.870+0000 7fb4bb59e640 1 -- 172.21.15.86:0/363093668 shutdown_connections 2024-04-25T12:21:56.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.870+0000 7fb4bb59e640 1 -- 172.21.15.86:0/363093668 >> 172.21.15.86:0/363093668 conn(0x7fb4bc0cd540 msgr2=0x7fb4bc0678a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:56.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.870+0000 7fb4bb59e640 1 -- 172.21.15.86:0/363093668 shutdown_connections 2024-04-25T12:21:56.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.870+0000 7f27c69d0640 1 -- 172.21.15.86:0/419909456 reap_dead start 2024-04-25T12:21:56.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.870+0000 7f27c71d1640 1 -- 172.21.15.86:0/419909456 shutdown_connections 2024-04-25T12:21:56.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.870+0000 7f27c71d1640 1 -- 172.21.15.86:0/419909456 >> 172.21.15.86:0/419909456 conn(0x7f27c006eb20 msgr2=0x7f27c0163f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:56.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.870+0000 7f27c71d1640 1 -- 172.21.15.86:0/419909456 shutdown_connections 2024-04-25T12:21:56.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.870+0000 7fb4bb59e640 1 -- 172.21.15.86:0/363093668 wait complete. 2024-04-25T12:21:56.913 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:56.870+0000 7f27c71d1640 1 -- 172.21.15.86:0/419909456 wait complete. 2024-04-25T12:21:56.913 INFO:teuthology.orchestra.run.smithi086.stdout:55834574862 2024-04-25T12:21:56.914 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T12:21:56.915 INFO:teuthology.orchestra.run.smithi086.stdout:55834574861 2024-04-25T12:21:56.915 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-25T12:21:56.916 INFO:teuthology.orchestra.run.smithi086.stdout:55834574863 2024-04-25T12:21:56.916 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T12:21:56.917 INFO:teuthology.orchestra.run.smithi086.stdout:55834574862 2024-04-25T12:21:56.917 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-25T12:21:56.918 INFO:teuthology.orchestra.run.smithi086.stdout:55834574860 2024-04-25T12:21:56.918 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-25T12:21:56.919 INFO:teuthology.orchestra.run.smithi086.stdout:55834574861 2024-04-25T12:21:56.919 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T12:21:56.920 INFO:teuthology.orchestra.run.smithi086.stdout:55834574862 2024-04-25T12:21:56.920 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T12:21:56.921 INFO:teuthology.orchestra.run.smithi086.stdout:55834574862 2024-04-25T12:21:56.921 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-25T12:21:57.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.118+0000 7f36a1470640 1 Processor -- start 2024-04-25T12:21:57.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.122+0000 7f36a1470640 1 -- start start 2024-04-25T12:21:57.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.122+0000 7fb8df59e640 1 Processor -- start 2024-04-25T12:21:57.128 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.122+0000 7fb8df59e640 1 -- start start 2024-04-25T12:21:57.128 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.122+0000 7f36a1470640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f36940dd5e0 0x7f36940e71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:57.128 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.122+0000 7f36a1470640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f369404b3c0 0x7f3694006230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:57.129 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.122+0000 7f36a1470640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3694007130 con 0x7f3694006770 2024-04-25T12:21:57.129 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.122+0000 7f36a1470640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f3694006c00 con 0x7f36940dd5e0 2024-04-25T12:21:57.129 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.122+0000 7f36a1470640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f3694007d40 con 0x7f369404b3c0 2024-04-25T12:21:57.129 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.122+0000 7fb8df59e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb8d804f020 0x7fb8d80e84c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:57.129 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.122+0000 7fb8df59e640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8d80e1060 con 0x7fb8d80d6ec0 2024-04-25T12:21:57.129 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.122+0000 7fb8de59c640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fb8d80d6ec0 0x7fb8d8047280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:40870/0 (socket says 172.21.15.86:40870) 2024-04-25T12:21:57.129 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.122+0000 7fb8de59c640 1 -- 172.21.15.86:0/1122916268 learned_addr learned my addr 172.21.15.86:0/1122916268 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-04-25T12:21:57.130 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.122+0000 7f369a7fc640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f369404b3c0 0x7f3694006230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:57.130 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.122+0000 7fb8df59e640 1 -- 172.21.15.86:0/1122916268 --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8d80d72a0 con 0x7fb8d80dd5d0 2024-04-25T12:21:57.130 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.122+0000 7fb8ded9d640 1 --2- 172.21.15.86:0/1122916268 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb8d804f020 0x7fb8d80e84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:57.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.122+0000 7f369affd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f36940dd5e0 0x7f36940e71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:57.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.122+0000 7f369a7fc640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f369404b3c0 0x7f3694006230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.86:43010/0 (socket says 172.21.15.86:43010) 2024-04-25T12:21:57.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.122+0000 7f369a7fc640 1 -- 172.21.15.86:0/2218626992 learned_addr learned my addr 172.21.15.86:0/2218626992 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:57.132 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.122+0000 7fb8df59e640 1 -- 172.21.15.86:0/1122916268 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fb8d8047990 con 0x7fb8d804f020 2024-04-25T12:21:57.132 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.122+0000 7fb8dd59a640 1 -- 172.21.15.86:0/1122916268 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 477489801 0 0) 0x7fb8d80e1060 con 0x7fb8d80d6ec0 2024-04-25T12:21:57.133 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.122+0000 7fb8dd59a640 1 -- 172.21.15.86:0/1122916268 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8c8003530 con 0x7fb8d80d6ec0 2024-04-25T12:21:57.133 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.122+0000 7fb8dd59a640 1 -- 172.21.15.86:0/1122916268 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2516770527 0 0) 0x7fb8c8003530 con 0x7fb8d80d6ec0 2024-04-25T12:21:57.133 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.122+0000 7fb8dd59a640 1 -- 172.21.15.86:0/1122916268 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb8d804f020 msgr2=0x7fb8d80e84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:57.133 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.122+0000 7fb8dd59a640 1 --2- 172.21.15.86:0/1122916268 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb8d804f020 0x7fb8d80e84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.133 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.122+0000 7fb8dd59a640 1 -- 172.21.15.86:0/1122916268 >> v1:172.21.15.134:6789/0 conn(0x7fb8d80dd5d0 legacy=0x7fb8d804e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:57.133 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.122+0000 7fb8dd59a640 1 -- 172.21.15.86:0/1122916268 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8d804d540 con 0x7fb8d80d6ec0 2024-04-25T12:21:57.133 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.122+0000 7fb8dd59a640 1 -- 172.21.15.86:0/1122916268 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1387950573 0 0) 0x7fb8d00016a0 con 0x7fb8d80d6ec0 2024-04-25T12:21:57.133 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.122+0000 7fb8dd59a640 1 -- 172.21.15.86:0/1122916268 >> v1:172.21.15.86:6789/0 conn(0x7fb8d80d6ec0 legacy=0x7fb8d8047280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:57.133 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.122+0000 7fb8dd59a640 1 --2- 172.21.15.86:0/1122916268 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb8c80039f0 0x7fb8c8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:57.133 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.122+0000 7fb8dd59a640 1 --2- 172.21.15.86:0/1122916268 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8c8004810 0x7fb8c8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:57.133 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.122+0000 7fb8dd59a640 1 --2- 172.21.15.86:0/1122916268 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8c8005240 0x7fb8c800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:57.133 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.122+0000 7fb8dd59a640 1 -- 172.21.15.86:0/1122916268 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d8047990 con 0x7fb8c8005240 2024-04-25T12:21:57.133 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.122+0000 7fb8dd59a640 1 -- 172.21.15.86:0/1122916268 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c800c150 con 0x7fb8c8004810 2024-04-25T12:21:57.133 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.122+0000 7fb8dd59a640 1 -- 172.21.15.86:0/1122916268 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fb8c800c350 con 0x7fb8c80039f0 2024-04-25T12:21:57.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.122+0000 7fb8ded9d640 1 --2- 172.21.15.86:0/1122916268 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8c8005240 0x7fb8c800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:57.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.122+0000 7fb8ddd9b640 1 --2- 172.21.15.86:0/1122916268 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8c8004810 0x7fb8c8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:57.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.122+0000 7fb8de59c640 1 --2- 172.21.15.86:0/1122916268 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb8c80039f0 0x7fb8c8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:57.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.122+0000 7fb8ded9d640 1 -- 172.21.15.86:0/1122916268 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb8c80039f0 msgr2=0x7fb8c8003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:57.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.122+0000 7fb8ded9d640 1 --2- 172.21.15.86:0/1122916268 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb8c80039f0 0x7fb8c8003e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.122+0000 7fb8ded9d640 1 -- 172.21.15.86:0/1122916268 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8c8004810 msgr2=0x7fb8c8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:57.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.122+0000 7fb8ded9d640 1 --2- 172.21.15.86:0/1122916268 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8c8004810 0x7fb8c8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.122+0000 7fb8ded9d640 1 -- 172.21.15.86:0/1122916268 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8d804d540 con 0x7fb8c8005240 2024-04-25T12:21:57.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.122+0000 7f6145489640 1 Processor -- start 2024-04-25T12:21:57.135 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.122+0000 7f2fab1f7640 1 Processor -- start 2024-04-25T12:21:57.135 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.122+0000 7f6145489640 1 -- start start 2024-04-25T12:21:57.135 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.122+0000 7f2fab1f7640 1 -- start start 2024-04-25T12:21:57.136 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.122+0000 7f369affd640 1 -- 172.21.15.86:0/2218626992 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f369404b3c0 msgr2=0x7f3694006230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:57.136 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.122+0000 7f369affd640 1 --2- 172.21.15.86:0/2218626992 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f369404b3c0 0x7f3694006230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.136 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.122+0000 7f369affd640 1 -- 172.21.15.86:0/2218626992 >> v1:172.21.15.134:6789/0 conn(0x7f3694006770 legacy=0x7f3694046360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:57.136 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.122+0000 7f369affd640 1 -- 172.21.15.86:0/2218626992 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3694007410 con 0x7f36940dd5e0 2024-04-25T12:21:57.136 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.126+0000 7f6145489640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f613804a950 0x7f61380dca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:57.137 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.126+0000 7f2fab1f7640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2f9c0d5c30 0x7f2f9c04c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:57.137 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.126+0000 7f6145489640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61380365a0 0x7f6138034440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:57.137 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.126+0000 7f2fab1f7640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2f9c04d840 0x7f2f9c046340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:57.138 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.126+0000 7f2fab1f7640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2f9c046880 0x7f2f9c0df020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:57.138 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.126+0000 7f2fab1f7640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f2f9c04c9f0 con 0x7f2f9c046880 2024-04-25T12:21:57.138 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.126+0000 7f6145489640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61380dd100 con 0x7f6138034980 2024-04-25T12:21:57.138 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.126+0000 7f2fab1f7640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f2f9c046cf0 con 0x7f2f9c0d5c30 2024-04-25T12:21:57.139 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.126+0000 7f2fab1f7640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f2f9c008760 con 0x7f2f9c04d840 2024-04-25T12:21:57.139 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.126+0000 7f6145489640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f61380dd9a0 con 0x7f613804a950 2024-04-25T12:21:57.139 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.126+0000 7f6145489640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f6138007300 con 0x7f61380365a0 2024-04-25T12:21:57.139 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.126+0000 7f2fa8f93640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2f9c0d5c30 0x7f2f9c04c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:57.140 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.126+0000 7f613f7fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61380365a0 0x7f6138034440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:57.140 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.126+0000 7f2fa8f93640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2f9c0d5c30 0x7f2f9c04c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.86:55270/0 (socket says 172.21.15.86:55270) 2024-04-25T12:21:57.140 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.126+0000 7f613f7fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61380365a0 0x7f6138034440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.86:43044/0 (socket says 172.21.15.86:43044) 2024-04-25T12:21:57.141 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.126+0000 7f613f7fe640 1 -- 172.21.15.86:0/2495312620 learned_addr learned my addr 172.21.15.86:0/2495312620 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:57.141 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.126+0000 7f2fa8f93640 1 -- 172.21.15.86:0/241109256 learned_addr learned my addr 172.21.15.86:0/241109256 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:57.141 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.122+0000 7f86e7f0c640 1 Processor -- start 2024-04-25T12:21:57.142 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.122+0000 7f86e7f0c640 1 -- start start 2024-04-25T12:21:57.142 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.126+0000 7f86e7f0c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f86d8045480 0x7f86d80fd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:57.142 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.126+0000 7f86e7f0c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f86d8046c80 0x7f86d8005ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:57.142 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.126+0000 7f86e7f0c640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86d8045be0 con 0x7f86d80f6bf0 2024-04-25T12:21:57.142 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.126+0000 7f86e7f0c640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f86d8050ea0 con 0x7f86d8046c80 2024-04-25T12:21:57.142 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.126+0000 7f86e7f0c640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f86d80467f0 con 0x7f86d8045480 2024-04-25T12:21:57.142 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.126+0000 7f2fa8f93640 1 -- 172.21.15.86:0/241109256 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2f9c04d840 msgr2=0x7f2f9c046340 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T12:21:57.143 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.126+0000 7f86e64a9640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f86d8046c80 0x7f86d8005ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:57.143 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.126+0000 7f2fa8f93640 1 --2- 172.21.15.86:0/241109256 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2f9c04d840 0x7f2f9c046340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.143 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.126+0000 7f2fa8f93640 1 -- 172.21.15.86:0/241109256 >> v2:172.21.15.86:3300/0 conn(0x7f2f9c046880 msgr2=0x7f2f9c0df020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:57.143 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.126+0000 7f2fa8f93640 1 --2- 172.21.15.86:0/241109256 >> v2:172.21.15.86:3300/0 conn(0x7f2f9c046880 0x7f2f9c0df020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.143 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.126+0000 7f2fa8f93640 1 -- 172.21.15.86:0/241109256 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f9c008a40 con 0x7f2f9c0d5c30 2024-04-25T12:21:57.143 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.126+0000 7f86e64a9640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f86d8046c80 0x7f86d8005ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.86:55286/0 (socket says 172.21.15.86:55286) 2024-04-25T12:21:57.144 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.126+0000 7f86e64a9640 1 -- 172.21.15.86:0/1339500337 learned_addr learned my addr 172.21.15.86:0/1339500337 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:57.144 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.126+0000 7f86e54a7640 1 --2- 172.21.15.86:0/1339500337 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f86d8045480 0x7f86d80fd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:57.144 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.126+0000 7f369affd640 1 --2- 172.21.15.86:0/2218626992 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36940dd5e0 0x7f36940e71a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f368c0097c0 tx=0x7f368c01c4e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf7dbf40d33af11d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:57.144 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.126+0000 7f3699ffb640 1 -- 172.21.15.86:0/2218626992 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f368c0b0070 con 0x7f36940dd5e0 2024-04-25T12:21:57.144 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.126+0000 7f3699ffb640 1 -- 172.21.15.86:0/2218626992 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f368c0ab600 con 0x7f36940dd5e0 2024-04-25T12:21:57.144 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.126+0000 7f3699ffb640 1 -- 172.21.15.86:0/2218626992 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f368c0ab9d0 con 0x7f36940dd5e0 2024-04-25T12:21:57.145 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.126+0000 7fb8ded9d640 1 --2- 172.21.15.86:0/1122916268 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8c8005240 0x7fb8c800b9d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb8e002db60 tx=0x7fb8e0098c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71986ef156d76313 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:57.145 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.126+0000 7f36a1470640 1 -- 172.21.15.86:0/2218626992 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36940dd5e0 msgr2=0x7f36940e71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:57.145 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.126+0000 7f36a1470640 1 --2- 172.21.15.86:0/2218626992 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36940dd5e0 0x7f36940e71a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f368c0097c0 tx=0x7f368c01c4e0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.145 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.126+0000 7f36a1470640 1 -- 172.21.15.86:0/2218626992 shutdown_connections 2024-04-25T12:21:57.145 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.126+0000 7f36a1470640 1 --2- 172.21.15.86:0/2218626992 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f369404b3c0 0x7f3694006230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.146 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.126+0000 7f36a1470640 1 --2- 172.21.15.86:0/2218626992 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36940dd5e0 0x7f36940e71a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.146 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.126+0000 7f36a1470640 1 -- 172.21.15.86:0/2218626992 >> 172.21.15.86:0/2218626992 conn(0x7f369404d4c0 msgr2=0x7f369404d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:57.146 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.126+0000 7f36a1470640 1 -- 172.21.15.86:0/2218626992 shutdown_connections 2024-04-25T12:21:57.146 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.126+0000 7fb8dd59a640 1 -- 172.21.15.86:0/1122916268 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e0127070 con 0x7fb8c8005240 2024-04-25T12:21:57.146 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.126+0000 7fb8dd59a640 1 -- 172.21.15.86:0/1122916268 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8e0121a80 con 0x7fb8c8005240 2024-04-25T12:21:57.146 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.126+0000 7fb8dd59a640 1 -- 172.21.15.86:0/1122916268 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e0050260 con 0x7fb8c8005240 2024-04-25T12:21:57.146 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.126+0000 7fb8df59e640 1 -- 172.21.15.86:0/1122916268 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8c8005240 msgr2=0x7fb8c800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:57.146 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.126+0000 7fb8df59e640 1 --2- 172.21.15.86:0/1122916268 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8c8005240 0x7fb8c800b9d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb8e002db60 tx=0x7fb8e0098c40 comp rx=0 tx=0).stop 2024-04-25T12:21:57.147 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.126+0000 7fb8ded9d640 1 -- 172.21.15.86:0/1122916268 reap_dead start 2024-04-25T12:21:57.147 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7fb8df59e640 1 -- 172.21.15.86:0/1122916268 shutdown_connections 2024-04-25T12:21:57.147 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7fb8df59e640 1 -- 172.21.15.86:0/1122916268 >> 172.21.15.86:0/1122916268 conn(0x7fb8d800e0d0 msgr2=0x7fb8d800e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:57.147 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.126+0000 7f86e64a9640 1 -- 172.21.15.86:0/1339500337 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f86d8045480 msgr2=0x7f86d80fd3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:57.147 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.126+0000 7f86e64a9640 1 --2- 172.21.15.86:0/1339500337 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f86d8045480 0x7f86d80fd3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.147 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.126+0000 7f86e64a9640 1 -- 172.21.15.86:0/1339500337 >> v1:172.21.15.86:6789/0 conn(0x7f86d80f6bf0 legacy=0x7f86d804b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:57.147 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.126+0000 7f86e64a9640 1 -- 172.21.15.86:0/1339500337 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86d8045ec0 con 0x7f86d8046c80 2024-04-25T12:21:57.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7fb8df59e640 1 -- 172.21.15.86:0/1122916268 shutdown_connections 2024-04-25T12:21:57.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.126+0000 7f613f7fe640 1 -- 172.21.15.86:0/2495312620 >> v2:172.21.15.86:3300/0 conn(0x7f613804a950 msgr2=0x7f61380dca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:57.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.126+0000 7f613f7fe640 1 --2- 172.21.15.86:0/2495312620 >> v2:172.21.15.86:3300/0 conn(0x7f613804a950 0x7f61380dca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.126+0000 7f613f7fe640 1 -- 172.21.15.86:0/2495312620 >> v1:172.21.15.86:6789/0 conn(0x7f6138034980 legacy=0x7f6138007790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:57.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.126+0000 7f613f7fe640 1 -- 172.21.15.86:0/2495312620 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61380dd3e0 con 0x7f61380365a0 2024-04-25T12:21:57.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.126+0000 7f36a1470640 1 -- 172.21.15.86:0/2218626992 wait complete. 2024-04-25T12:21:57.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7f86e64a9640 1 --2- 172.21.15.86:0/1339500337 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86d8046c80 0x7f86d8005ed0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f86e00512e0 tx=0x7f86e008a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb12973ef6c8b879 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:57.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7f613f7fe640 1 --2- 172.21.15.86:0/2495312620 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61380365a0 0x7f6138034440 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f612c009870 tx=0x7f612c01c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6075cfa7ab52681b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:57.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7f36a1470640 1 Processor -- start 2024-04-25T12:21:57.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7f36a1470640 1 -- start start 2024-04-25T12:21:57.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7f613effd640 1 -- 172.21.15.86:0/2495312620 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f612c0ab5f0 con 0x7f61380365a0 2024-04-25T12:21:57.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7f613effd640 1 -- 172.21.15.86:0/2495312620 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f612c0b0070 con 0x7f61380365a0 2024-04-25T12:21:57.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7f613effd640 1 -- 172.21.15.86:0/2495312620 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f612c0ab9b0 con 0x7f61380365a0 2024-04-25T12:21:57.151 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7f36a1470640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f369404b3c0 0x7f36940df4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:57.151 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7f36a1470640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36940dd5e0 0x7f369417d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:57.151 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7f36a1470640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f369404a1b0 0x7f3694048020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:57.151 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7f36a1470640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3694046bf0 con 0x7f369404b3c0 2024-04-25T12:21:57.151 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7f6145489640 1 -- 172.21.15.86:0/2495312620 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61380365a0 msgr2=0x7f6138034440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:57.151 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7f6145489640 1 --2- 172.21.15.86:0/2495312620 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61380365a0 0x7f6138034440 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f612c009870 tx=0x7f612c01c520 comp rx=0 tx=0).stop 2024-04-25T12:21:57.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7f36a1470640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3694046a70 con 0x7f36940dd5e0 2024-04-25T12:21:57.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7f36a1470640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f36940f02d0 con 0x7f369404a1b0 2024-04-25T12:21:57.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7f369affd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f369404b3c0 0x7f36940df4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:57.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7f369affd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f369404b3c0 0x7f36940df4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:59428/0 (socket says 172.21.15.86:59428) 2024-04-25T12:21:57.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7f369affd640 1 -- 172.21.15.86:0/3456475360 learned_addr learned my addr 172.21.15.86:0/3456475360 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:57.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7fb8df59e640 1 -- 172.21.15.86:0/1122916268 wait complete. 2024-04-25T12:21:57.153 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7fb8df59e640 1 Processor -- start 2024-04-25T12:21:57.153 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7f86e4ca6640 1 -- 172.21.15.86:0/1339500337 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e0121070 con 0x7f86d8046c80 2024-04-25T12:21:57.153 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7f2fa8f93640 1 --2- 172.21.15.86:0/241109256 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f9c0d5c30 0x7f2f9c04c4b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c00a440 tx=0x7f2fa0021400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b00b88fcca87dfb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:57.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7f2f9b7fe640 1 -- 172.21.15.86:0/241109256 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa00b6070 con 0x7f2f9c0d5c30 2024-04-25T12:21:57.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7f2f9b7fe640 1 -- 172.21.15.86:0/241109256 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fa00b1600 con 0x7f2f9c0d5c30 2024-04-25T12:21:57.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7f2f9b7fe640 1 -- 172.21.15.86:0/241109256 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa00b19d0 con 0x7f2f9c0d5c30 2024-04-25T12:21:57.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7f2fab1f7640 1 -- 172.21.15.86:0/241109256 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f9c0d5c30 msgr2=0x7f2f9c04c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:57.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7f2fab1f7640 1 --2- 172.21.15.86:0/241109256 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f9c0d5c30 0x7f2f9c04c4b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c00a440 tx=0x7f2fa0021400 comp rx=0 tx=0).stop 2024-04-25T12:21:57.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7f2fab1f7640 1 -- 172.21.15.86:0/241109256 shutdown_connections 2024-04-25T12:21:57.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7f2fab1f7640 1 --2- 172.21.15.86:0/241109256 >> v2:172.21.15.86:3300/0 conn(0x7f2f9c046880 0x7f2f9c0df020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7f2fab1f7640 1 --2- 172.21.15.86:0/241109256 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2f9c04d840 0x7f2f9c046340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7f2fab1f7640 1 --2- 172.21.15.86:0/241109256 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f9c0d5c30 0x7f2f9c04c4b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7f2fab1f7640 1 -- 172.21.15.86:0/241109256 >> 172.21.15.86:0/241109256 conn(0x7f2f9c04dd40 msgr2=0x7f2f9c04e150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:57.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7f2fab1f7640 1 -- 172.21.15.86:0/241109256 shutdown_connections 2024-04-25T12:21:57.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7f2fab1f7640 1 -- 172.21.15.86:0/241109256 wait complete. 2024-04-25T12:21:57.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7f369b7fe640 1 --2- 172.21.15.86:0/3456475360 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f369404a1b0 0x7f3694048020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:57.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7f369a7fc640 1 --2- 172.21.15.86:0/3456475360 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36940dd5e0 0x7f369417d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:57.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7f369affd640 1 -- 172.21.15.86:0/3456475360 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f369404a1b0 msgr2=0x7f3694048020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:57.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7f369affd640 1 --2- 172.21.15.86:0/3456475360 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f369404a1b0 0x7f3694048020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7f369affd640 1 -- 172.21.15.86:0/3456475360 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36940dd5e0 msgr2=0x7f369417d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:57.156 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7f369affd640 1 --2- 172.21.15.86:0/3456475360 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36940dd5e0 0x7f369417d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.156 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7f369affd640 1 -- 172.21.15.86:0/3456475360 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f369417c810 con 0x7f369404b3c0 2024-04-25T12:21:57.156 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7f369affd640 1 --2- 172.21.15.86:0/3456475360 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f369404b3c0 0x7f36940df4f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f368c0ae040 tx=0x7f368c019280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:57.156 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7f6145489640 1 -- 172.21.15.86:0/2495312620 shutdown_connections 2024-04-25T12:21:57.156 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7f6145489640 1 --2- 172.21.15.86:0/2495312620 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61380365a0 0x7f6138034440 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.156 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7f6145489640 1 --2- 172.21.15.86:0/2495312620 >> v2:172.21.15.86:3300/0 conn(0x7f613804a950 0x7f61380dca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.156 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7f6145489640 1 -- 172.21.15.86:0/2495312620 >> 172.21.15.86:0/2495312620 conn(0x7f613804d4c0 msgr2=0x7f613804d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:57.156 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7f6145489640 1 -- 172.21.15.86:0/2495312620 shutdown_connections 2024-04-25T12:21:57.157 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7f6145489640 1 -- 172.21.15.86:0/2495312620 wait complete. 2024-04-25T12:21:57.157 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7fb8df59e640 1 -- start start 2024-04-25T12:21:57.157 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7fb8df59e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8d8051430 0x7fb8d80dbb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:57.157 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7fb8df59e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb8d8051810 0x7fb8d80d9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:57.157 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7fb8df59e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8d8179920 0x7fb8d80da0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:57.157 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7fb8df59e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d80e0860 con 0x7fb8d8179920 2024-04-25T12:21:57.158 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7f36837fe640 1 -- 172.21.15.86:0/3456475360 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f368c0ba070 con 0x7f369404b3c0 2024-04-25T12:21:57.158 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7fb8df59e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d80e0580 con 0x7fb8d8051430 2024-04-25T12:21:57.158 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7fb8df59e640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fb8d80e0b40 con 0x7fb8d8051810 2024-04-25T12:21:57.159 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7f36837fe640 1 -- 172.21.15.86:0/3456475360 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f368c0b43f0 con 0x7f369404b3c0 2024-04-25T12:21:57.159 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7f36837fe640 1 -- 172.21.15.86:0/3456475360 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f368c0b0040 con 0x7f369404b3c0 2024-04-25T12:21:57.159 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7f36a1470640 1 -- 172.21.15.86:0/3456475360 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f369404a710 con 0x7f369404b3c0 2024-04-25T12:21:57.159 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7f2fab1f7640 1 Processor -- start 2024-04-25T12:21:57.159 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7f36a1470640 1 -- 172.21.15.86:0/3456475360 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f369404acd0 con 0x7f369404b3c0 2024-04-25T12:21:57.160 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7fb8de59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8d8051430 0x7fb8d80dbb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:57.160 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7fb8de59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8d8051430 0x7fb8d80dbb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.86:55308/0 (socket says 172.21.15.86:55308) 2024-04-25T12:21:57.160 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7fb8de59c640 1 -- 172.21.15.86:0/2902479359 learned_addr learned my addr 172.21.15.86:0/2902479359 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:57.160 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7fb8ddd9b640 1 --2- 172.21.15.86:0/2902479359 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb8d8051810 0x7fb8d80d9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:57.161 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7f86e4ca6640 1 -- 172.21.15.86:0/1339500337 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86e011c410 con 0x7f86d8046c80 2024-04-25T12:21:57.161 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7f86e4ca6640 1 -- 172.21.15.86:0/1339500337 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e011c880 con 0x7f86d8046c80 2024-04-25T12:21:57.161 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7f86e7f0c640 1 -- 172.21.15.86:0/1339500337 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86d8046c80 msgr2=0x7f86d8005ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:57.161 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7f86e7f0c640 1 --2- 172.21.15.86:0/1339500337 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86d8046c80 0x7f86d8005ed0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f86e00512e0 tx=0x7f86e008a5f0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.161 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7f86e7f0c640 1 -- 172.21.15.86:0/1339500337 shutdown_connections 2024-04-25T12:21:57.161 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7f86e7f0c640 1 --2- 172.21.15.86:0/1339500337 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86d8046c80 0x7f86d8005ed0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.161 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7f86e7f0c640 1 --2- 172.21.15.86:0/1339500337 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f86d8045480 0x7f86d80fd3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.161 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7f86e7f0c640 1 -- 172.21.15.86:0/1339500337 >> 172.21.15.86:0/1339500337 conn(0x7f86d80501c0 msgr2=0x7f86d80505d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:57.161 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7f86e7f0c640 1 -- 172.21.15.86:0/1339500337 shutdown_connections 2024-04-25T12:21:57.162 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7f86e7f0c640 1 -- 172.21.15.86:0/1339500337 wait complete. 2024-04-25T12:21:57.162 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7fb8ded9d640 1 --2- 172.21.15.86:0/2902479359 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8d8179920 0x7fb8d80da0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:57.162 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7f6145489640 1 Processor -- start 2024-04-25T12:21:57.163 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.130+0000 7f2fab1f7640 1 -- start start 2024-04-25T12:21:57.163 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7f2fab1f7640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2f9c046880 0x7f2f9c175060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:57.163 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7f2fab1f7640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f9c04d840 0x7f2f9c0d7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:57.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7f2fab1f7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f9c0d5c30 0x7f2f9c166260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:57.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7f2fab1f7640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f2f9c0092e0 con 0x7f2f9c04d840 2024-04-25T12:21:57.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7f2fab1f7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2f9c009000 con 0x7f2f9c0d5c30 2024-04-25T12:21:57.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7f2fab1f7640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f2f9c0d6010 con 0x7f2f9c046880 2024-04-25T12:21:57.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7f2fa8f93640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2f9c046880 0x7f2f9c175060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:57.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7f2fa8f93640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2f9c046880 0x7f2f9c175060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.86:43078/0 (socket says 172.21.15.86:43078) 2024-04-25T12:21:57.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7f2fa8f93640 1 -- 172.21.15.86:0/3238473049 learned_addr learned my addr 172.21.15.86:0/3238473049 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:57.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7f2f9bfff640 1 --2- 172.21.15.86:0/3238473049 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f9c04d840 0x7f2f9c0d7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:57.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7f2fa9794640 1 --2- 172.21.15.86:0/3238473049 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f9c0d5c30 0x7f2f9c166260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:57.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7f36a1470640 1 -- 172.21.15.86:0/3456475360 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3694005fb0 con 0x7f369404b3c0 2024-04-25T12:21:57.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7f86e7f0c640 1 Processor -- start 2024-04-25T12:21:57.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7f86e7f0c640 1 -- start start 2024-04-25T12:21:57.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7f6145489640 1 -- start start 2024-04-25T12:21:57.166 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7f2f9bfff640 1 -- 172.21.15.86:0/3238473049 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2f9c046880 msgr2=0x7f2f9c175060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:57.166 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7f2f9bfff640 1 --2- 172.21.15.86:0/3238473049 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2f9c046880 0x7f2f9c175060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.166 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7f2f9bfff640 1 -- 172.21.15.86:0/3238473049 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f9c0d5c30 msgr2=0x7f2f9c166260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:57.166 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7f2f9bfff640 1 --2- 172.21.15.86:0/3238473049 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f9c0d5c30 0x7f2f9c166260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.166 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7f2f9bfff640 1 -- 172.21.15.86:0/3238473049 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f9c0d93f0 con 0x7f2f9c04d840 2024-04-25T12:21:57.166 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7f6145489640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6138034980 0x7f61380ced40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:57.167 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7f6145489640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61380365a0 0x7f61380c6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:57.167 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7f6145489640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f613804a950 0x7f61380c6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:57.167 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7f6145489640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f61380e9ba0 con 0x7f61380365a0 2024-04-25T12:21:57.167 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7f6145489640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f613804e1f0 con 0x7f613804a950 2024-04-25T12:21:57.167 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7f6145489640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f61380e9d20 con 0x7f6138034980 2024-04-25T12:21:57.167 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7f86e7f0c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f86d8045480 0x7f86d81a3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:57.167 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7f86e7f0c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f86d8046c80 0x7f86d80fff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:57.167 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7f86e7f0c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86d80f6bf0 0x7f86d80f4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:57.168 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7f86e7f0c640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f86d80f6fd0 con 0x7f86d8045480 2024-04-25T12:21:57.168 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7f86e7f0c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f86d8046480 con 0x7f86d80f6bf0 2024-04-25T12:21:57.168 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7f86e7f0c640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f86d804b7e0 con 0x7f86d8046c80 2024-04-25T12:21:57.168 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7f36837fe640 1 -- 172.21.15.86:0/3456475360 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f368c0bd070 con 0x7f369404b3c0 2024-04-25T12:21:57.168 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7f36837fe640 1 --2- 172.21.15.86:0/3456475360 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f3684068540 0x7f368406aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:57.168 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7f36837fe640 1 -- 172.21.15.86:0/3456475360 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f368c120280 con 0x7f369404b3c0 2024-04-25T12:21:57.168 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7f369a7fc640 1 --2- 172.21.15.86:0/3456475360 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f3684068540 0x7f368406aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:57.169 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7f86e54a7640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f86d8046c80 0x7f86d80fff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:57.169 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7f613ffff640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6138034980 0x7f61380ced40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:57.169 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7f86e54a7640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f86d8046c80 0x7f86d80fff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.86:43090/0 (socket says 172.21.15.86:43090) 2024-04-25T12:21:57.169 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7f86e54a7640 1 -- 172.21.15.86:0/971574489 learned_addr learned my addr 172.21.15.86:0/971574489 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:57.170 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7f613ffff640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6138034980 0x7f61380ced40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.86:43096/0 (socket says 172.21.15.86:43096) 2024-04-25T12:21:57.170 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7f613ffff640 1 -- 172.21.15.86:0/4081881023 learned_addr learned my addr 172.21.15.86:0/4081881023 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:57.170 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7f86e64a9640 1 --2- 172.21.15.86:0/971574489 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86d80f6bf0 0x7f86d80f4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:57.170 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7f613f7fe640 1 --2- 172.21.15.86:0/4081881023 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61380365a0 0x7f61380c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:57.171 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7f6144c88640 1 --2- 172.21.15.86:0/4081881023 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f613804a950 0x7f61380c6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:57.171 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7f2f9bfff640 1 --2- 172.21.15.86:0/3238473049 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f9c04d840 0x7f2f9c0d7b20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2f9400b410 tx=0x7f2f9400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:57.171 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7f613f7fe640 1 -- 172.21.15.86:0/4081881023 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6138034980 msgr2=0x7f61380ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:57.171 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7f613f7fe640 1 --2- 172.21.15.86:0/4081881023 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6138034980 0x7f61380ced40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.171 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7f613f7fe640 1 -- 172.21.15.86:0/4081881023 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f613804a950 msgr2=0x7f61380c6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:57.171 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7f613f7fe640 1 --2- 172.21.15.86:0/4081881023 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f613804a950 0x7f61380c6850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.171 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7f613f7fe640 1 -- 172.21.15.86:0/4081881023 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f613804ddc0 con 0x7f61380365a0 2024-04-25T12:21:57.172 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7f86e54a7640 1 -- 172.21.15.86:0/971574489 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86d80f6bf0 msgr2=0x7f86d80f4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:57.172 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7f86e54a7640 1 --2- 172.21.15.86:0/971574489 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86d80f6bf0 0x7f86d80f4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.172 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7f86e54a7640 1 -- 172.21.15.86:0/971574489 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f86d8045480 msgr2=0x7f86d81a3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:57.172 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7f86e54a7640 1 --2- 172.21.15.86:0/971574489 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f86d8045480 0x7f86d81a3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.172 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7f86e54a7640 1 -- 172.21.15.86:0/971574489 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86d8100ac0 con 0x7f86d8046c80 2024-04-25T12:21:57.172 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7f613f7fe640 1 --2- 172.21.15.86:0/4081881023 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61380365a0 0x7f61380c6310 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f612c0ac000 tx=0x7f612c01ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:57.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7fb8de59c640 1 -- 172.21.15.86:0/2902479359 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb8d8051810 msgr2=0x7fb8d80d9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:57.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7fb8de59c640 1 --2- 172.21.15.86:0/2902479359 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb8d8051810 0x7fb8d80d9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7fb8de59c640 1 -- 172.21.15.86:0/2902479359 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8d8179920 msgr2=0x7fb8d80da0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:57.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7fb8de59c640 1 --2- 172.21.15.86:0/2902479359 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8d8179920 0x7fb8d80da0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7fb8de59c640 1 -- 172.21.15.86:0/2902479359 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8d80094e0 con 0x7fb8d8051430 2024-04-25T12:21:57.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7fb8de59c640 1 --2- 172.21.15.86:0/2902479359 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8d8051430 0x7fb8d80dbb30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb8d0010ce0 tx=0x7fb8d000e4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:57.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7fb8ceffd640 1 -- 172.21.15.86:0/2902479359 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8d0010e30 con 0x7fb8d8051430 2024-04-25T12:21:57.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.138+0000 7f86e54a7640 1 --2- 172.21.15.86:0/971574489 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f86d8046c80 0x7f86d80fff50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f86d000baa0 tx=0x7f86d000bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:57.174 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7fb8ceffd640 1 -- 172.21.15.86:0/2902479359 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8d0011040 con 0x7fb8d8051430 2024-04-25T12:21:57.174 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7fb8ceffd640 1 -- 172.21.15.86:0/2902479359 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8d0015400 con 0x7fb8d8051430 2024-04-25T12:21:57.174 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7fb8df59e640 1 -- 172.21.15.86:0/2902479359 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8d80cd620 con 0x7fb8d8051430 2024-04-25T12:21:57.174 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7fb8df59e640 1 -- 172.21.15.86:0/2902479359 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8d8178e40 con 0x7fb8d8051430 2024-04-25T12:21:57.174 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.134+0000 7fb8df59e640 1 -- 172.21.15.86:0/2902479359 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8d80057f0 con 0x7fb8d8051430 2024-04-25T12:21:57.175 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.138+0000 7f369a7fc640 1 --2- 172.21.15.86:0/3456475360 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f3684068540 0x7f368406aa00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f36940e3b20 tx=0x7f3690009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:57.175 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.138+0000 7f151a35b640 1 Processor -- start 2024-04-25T12:21:57.175 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.138+0000 7f86d67fc640 1 -- 172.21.15.86:0/971574489 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d001b070 con 0x7f86d8046c80 2024-04-25T12:21:57.175 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.138+0000 7f86e7f0c640 1 -- 172.21.15.86:0/971574489 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86d81007e0 con 0x7f86d8046c80 2024-04-25T12:21:57.176 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.138+0000 7f39c2d70640 1 Processor -- start 2024-04-25T12:21:57.176 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.138+0000 7f86e7f0c640 1 -- 172.21.15.86:0/971574489 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f86d80fdee0 con 0x7f86d8046c80 2024-04-25T12:21:57.176 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.138+0000 7f86d67fc640 1 -- 172.21.15.86:0/971574489 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86d000f920 con 0x7f86d8046c80 2024-04-25T12:21:57.176 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.138+0000 7f39c2d70640 1 -- start start 2024-04-25T12:21:57.177 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.138+0000 7f151a35b640 1 -- start start 2024-04-25T12:21:57.177 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.138+0000 7f86d67fc640 1 -- 172.21.15.86:0/971574489 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d000fcd0 con 0x7f86d8046c80 2024-04-25T12:21:57.177 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.138+0000 7f39c2d70640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39b40dd4c0 0x7f39b4005ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:57.177 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.138+0000 7f39c2d70640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39b40063e0 con 0x7f39b4045940 2024-04-25T12:21:57.178 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.138+0000 7f39c2d70640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39b40dd8a0 con 0x7f39b404c6a0 2024-04-25T12:21:57.178 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.138+0000 7f39c2d70640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f39b4006670 con 0x7f39b40dd4c0 2024-04-25T12:21:57.178 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.138+0000 7f86e7f0c640 1 -- 172.21.15.86:0/971574489 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86c80052a0 con 0x7f86d8046c80 2024-04-25T12:21:57.178 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.138+0000 7f39bbfff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f39b404c6a0 0x7f39b4045230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.86:59426/0 (socket says 172.21.15.86:59426) 2024-04-25T12:21:57.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.138+0000 7f39bbfff640 1 -- 172.21.15.86:0/2606268233 learned_addr learned my addr 172.21.15.86:0/2606268233 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-04-25T12:21:57.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.138+0000 7fb8ceffd640 1 -- 172.21.15.86:0/2902479359 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb8d001d020 con 0x7fb8d8051430 2024-04-25T12:21:57.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.138+0000 7fb8ceffd640 1 --2- 172.21.15.86:0/2902479359 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fb8c0068480 0x7fb8c006a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:57.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.138+0000 7fb8ceffd640 1 -- 172.21.15.86:0/2902479359 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fb8d008a8a0 con 0x7fb8d8051430 2024-04-25T12:21:57.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.138+0000 7fb8ddd9b640 1 --2- 172.21.15.86:0/2902479359 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fb8c0068480 0x7fb8c006a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:57.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.138+0000 7fb8ddd9b640 1 --2- 172.21.15.86:0/2902479359 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fb8c0068480 0x7fb8c006a940 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb8d80d5940 tx=0x7fb8d4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:57.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.138+0000 7f39c0b0c640 1 --2- 172.21.15.86:0/2606268233 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39b40dd4c0 0x7f39b4005ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:57.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.138+0000 7f39c0b0c640 1 -- 172.21.15.86:0/2606268233 >> v1:172.21.15.134:6789/0 conn(0x7f39b404c6a0 legacy=0x7f39b4045230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:57.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.138+0000 7f39c0b0c640 1 -- 172.21.15.86:0/2606268233 >> v1:172.21.15.86:6789/0 conn(0x7f39b4045940 legacy=0x7f39b40e3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:57.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.138+0000 7f39c0b0c640 1 -- 172.21.15.86:0/2606268233 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39b4006950 con 0x7f39b40dd4c0 2024-04-25T12:21:57.181 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.138+0000 7f86d67fc640 1 -- 172.21.15.86:0/971574489 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f86d001e070 con 0x7f86d8046c80 2024-04-25T12:21:57.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.138+0000 7f1519359640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f1514151520 0x7f15140c3470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:40908/0 (socket says 172.21.15.86:40908) 2024-04-25T12:21:57.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.138+0000 7f1519359640 1 -- 172.21.15.86:0/3621578211 learned_addr learned my addr 172.21.15.86:0/3621578211 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-04-25T12:21:57.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.138+0000 7f151a35b640 1 --2- 172.21.15.86:0/3621578211 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f15140ca210 0x7f1514157260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:57.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.138+0000 7f151a35b640 1 -- 172.21.15.86:0/3621578211 --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1514157910 con 0x7f1514151520 2024-04-25T12:21:57.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.138+0000 7f151a35b640 1 -- 172.21.15.86:0/3621578211 --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1514157bf0 con 0x7f15140c2680 2024-04-25T12:21:57.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.138+0000 7f151a35b640 1 -- 172.21.15.86:0/3621578211 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f1514072980 con 0x7f15140ca210 2024-04-25T12:21:57.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.138+0000 7f1519b5a640 1 --2- 172.21.15.86:0/3621578211 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f15140ca210 0x7f1514157260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:57.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.138+0000 7f86d67fc640 1 --2- 172.21.15.86:0/971574489 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f86c4068450 0x7f86c406a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:57.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.142+0000 7f86e5ca8640 1 --2- 172.21.15.86:0/971574489 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f86c4068450 0x7f86c406a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:57.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.142+0000 7f1519b5a640 1 -- 172.21.15.86:0/3621578211 >> v1:172.21.15.134:6789/0 conn(0x7f15140c2680 legacy=0x7f151406c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:57.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.142+0000 7f1519b5a640 1 -- 172.21.15.86:0/3621578211 >> v1:172.21.15.86:6789/0 conn(0x7f1514151520 legacy=0x7f15140c3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:57.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.142+0000 7f1519b5a640 1 -- 172.21.15.86:0/3621578211 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1514157ed0 con 0x7f15140ca210 2024-04-25T12:21:57.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.142+0000 7f86e5ca8640 1 --2- 172.21.15.86:0/971574489 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f86c4068450 0x7f86c406a910 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f86dc007fd0 tx=0x7f86dc0079a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:57.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.142+0000 7f23b795e640 1 Processor -- start 2024-04-25T12:21:57.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.142+0000 7f23b795e640 1 -- start start 2024-04-25T12:21:57.185 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.142+0000 7f86d67fc640 1 -- 172.21.15.86:0/971574489 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f86d00867b0 con 0x7f86d8046c80 2024-04-25T12:21:57.185 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.142+0000 7f39c0b0c640 1 --2- 172.21.15.86:0/2606268233 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39b40dd4c0 0x7f39b4005ea0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f39bc069360 tx=0x7f39bc09b390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0a10bb6778e889f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:57.185 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.142+0000 7f23b795e640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f23a80d6be0 0x7f23a80343e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:57.186 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.142+0000 7f23b795e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f23a80dd6a0 0x7f23a80e09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:57.186 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.142+0000 7f23b56fa640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f23a80d6be0 0x7f23a80343e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:57.186 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.142+0000 7f1519b5a640 1 --2- 172.21.15.86:0/3621578211 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f15140ca210 0x7f1514157260 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f150c00aed0 tx=0x7f150c01daf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a426039566d4fda2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:57.187 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.142+0000 7f23b56fa640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f23a80d6be0 0x7f23a80343e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:59462/0 (socket says 172.21.15.86:59462) 2024-04-25T12:21:57.187 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.142+0000 7f23b56fa640 1 -- 172.21.15.86:0/312055620 learned_addr learned my addr 172.21.15.86:0/312055620 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:57.187 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.142+0000 7f23b795e640 1 -- 172.21.15.86:0/312055620 --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23a8034a70 con 0x7f23a804c560 2024-04-25T12:21:57.187 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.142+0000 7f23b795e640 1 -- 172.21.15.86:0/312055620 --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f23a80dd210 con 0x7f23a80d6be0 2024-04-25T12:21:57.187 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.142+0000 7f23b795e640 1 -- 172.21.15.86:0/312055620 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f23a8034d30 con 0x7f23a80dd6a0 2024-04-25T12:21:57.187 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.142+0000 7f23b4ef9640 1 --2- 172.21.15.86:0/312055620 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f23a80dd6a0 0x7f23a80e09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:57.188 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.142+0000 7f36837fe640 1 -- 172.21.15.86:0/3456475360 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f368c0c4020 con 0x7f369404b3c0 2024-04-25T12:21:57.188 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.142+0000 7f2f997fa640 1 -- 172.21.15.86:0/3238473049 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f94015020 con 0x7f2f9c04d840 2024-04-25T12:21:57.188 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.142+0000 7f2f997fa640 1 -- 172.21.15.86:0/3238473049 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f94011850 con 0x7f2f9c04d840 2024-04-25T12:21:57.188 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.142+0000 7f2fab1f7640 1 -- 172.21.15.86:0/3238473049 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f9c050240 con 0x7f2f9c04d840 2024-04-25T12:21:57.188 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.142+0000 7f2f997fa640 1 -- 172.21.15.86:0/3238473049 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f94011c40 con 0x7f2f9c04d840 2024-04-25T12:21:57.188 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.142+0000 7f2fab1f7640 1 -- 172.21.15.86:0/3238473049 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f9c0507f0 con 0x7f2f9c04d840 2024-04-25T12:21:57.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.142+0000 7f613cff9640 1 -- 172.21.15.86:0/4081881023 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f612c0be5f0 con 0x7f61380365a0 2024-04-25T12:21:57.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.142+0000 7f613cff9640 1 -- 172.21.15.86:0/4081881023 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f612c0be7b0 con 0x7f61380365a0 2024-04-25T12:21:57.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.142+0000 7f6145489640 1 -- 172.21.15.86:0/4081881023 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6138007ba0 con 0x7f61380365a0 2024-04-25T12:21:57.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.142+0000 7f613cff9640 1 -- 172.21.15.86:0/4081881023 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f612c0beba0 con 0x7f61380365a0 2024-04-25T12:21:57.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.142+0000 7f6145489640 1 -- 172.21.15.86:0/4081881023 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f613817c5e0 con 0x7f61380365a0 2024-04-25T12:21:57.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.142+0000 7f23b4ef9640 1 -- 172.21.15.86:0/312055620 >> v2:172.21.15.86:3300/0 conn(0x7f23a80d6be0 msgr2=0x7f23a80343e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:57.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.142+0000 7f23b4ef9640 1 --2- 172.21.15.86:0/312055620 >> v2:172.21.15.86:3300/0 conn(0x7f23a80d6be0 0x7f23a80343e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.142+0000 7f23b4ef9640 1 -- 172.21.15.86:0/312055620 >> v1:172.21.15.86:6789/0 conn(0x7f23a804c560 legacy=0x7f23a8004750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:57.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.142+0000 7f23b4ef9640 1 -- 172.21.15.86:0/312055620 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23a80dcbc0 con 0x7f23a80dd6a0 2024-04-25T12:21:57.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.146+0000 7f2fab1f7640 1 -- 172.21.15.86:0/3238473049 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f9c0057f0 con 0x7f2f9c04d840 2024-04-25T12:21:57.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.146+0000 7f613cff9640 1 -- 172.21.15.86:0/4081881023 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f612c0b43f0 con 0x7f61380365a0 2024-04-25T12:21:57.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.146+0000 7f613cff9640 1 --2- 172.21.15.86:0/4081881023 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f6124068380 0x7f612406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:57.191 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.146+0000 7f613cff9640 1 -- 172.21.15.86:0/4081881023 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f612c120fa0 con 0x7f61380365a0 2024-04-25T12:21:57.191 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.146+0000 7f2f997fa640 1 -- 172.21.15.86:0/3238473049 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2f94018020 con 0x7f2f9c04d840 2024-04-25T12:21:57.191 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.146+0000 7f613ffff640 1 --2- 172.21.15.86:0/4081881023 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f6124068380 0x7f612406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:57.192 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.146+0000 7f2f997fa640 1 --2- 172.21.15.86:0/3238473049 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f2f90068400 0x7f2f9006a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:57.192 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.146+0000 7f2f997fa640 1 -- 172.21.15.86:0/3238473049 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f2f940865f0 con 0x7f2f9c04d840 2024-04-25T12:21:57.192 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.146+0000 7f613ffff640 1 --2- 172.21.15.86:0/4081881023 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f6124068380 0x7f612406a840 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f61340099b0 tx=0x7f6134009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:57.192 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.146+0000 7f23b4ef9640 1 --2- 172.21.15.86:0/312055620 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f23a80dd6a0 0x7f23a80e09b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f23a00097c0 tx=0x7f23a0024cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91d28d83654993a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:57.193 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.146+0000 7f2fa8f93640 1 --2- 172.21.15.86:0/3238473049 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f2f90068400 0x7f2f9006a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:57.193 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.146+0000 7f6145489640 1 -- 172.21.15.86:0/4081881023 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61380057f0 con 0x7f61380365a0 2024-04-25T12:21:57.193 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.146+0000 7f2fa8f93640 1 --2- 172.21.15.86:0/3238473049 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f2f90068400 0x7f2f9006a8c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2fa001fab0 tx=0x7f2fa00ac000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:57.193 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.150+0000 7fb8ceffd640 1 -- 172.21.15.86:0/2902479359 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb8d005a420 con 0x7fb8d8051430 2024-04-25T12:21:57.194 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.150+0000 7f2f997fa640 1 -- 172.21.15.86:0/3238473049 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2f9401f070 con 0x7f2f9c04d840 2024-04-25T12:21:57.194 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.154+0000 7f150bfff640 1 -- 172.21.15.86:0/3621578211 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f150c0a6820 con 0x7f15140ca210 2024-04-25T12:21:57.194 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.154+0000 7f23a7fff640 1 -- 172.21.15.86:0/312055620 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a00ba070 con 0x7f23a80dd6a0 2024-04-25T12:21:57.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.154+0000 7f150bfff640 1 -- 172.21.15.86:0/3621578211 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f150c0a69c0 con 0x7f15140ca210 2024-04-25T12:21:57.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.154+0000 7f150bfff640 1 -- 172.21.15.86:0/3621578211 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f150c0a6dd0 con 0x7f15140ca210 2024-04-25T12:21:57.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.154+0000 7f23a7fff640 1 -- 172.21.15.86:0/312055620 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23a00ad870 con 0x7f23a80dd6a0 2024-04-25T12:21:57.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.154+0000 7f23a7fff640 1 -- 172.21.15.86:0/312055620 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a00adc40 con 0x7f23a80dd6a0 2024-04-25T12:21:57.196 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.154+0000 7f86d67fc640 1 -- 172.21.15.86:0/971574489 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f86d0025020 con 0x7f86d8046c80 2024-04-25T12:21:57.196 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.154+0000 7f39bb7fe640 1 -- 172.21.15.86:0/2606268233 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39bc130070 con 0x7f39b40dd4c0 2024-04-25T12:21:57.196 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.154+0000 7f39bb7fe640 1 -- 172.21.15.86:0/2606268233 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39bc12b640 con 0x7f39b40dd4c0 2024-04-25T12:21:57.196 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.154+0000 7f39bb7fe640 1 -- 172.21.15.86:0/2606268233 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39bc12bab0 con 0x7f39b40dd4c0 2024-04-25T12:21:57.197 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.154+0000 7f23b795e640 1 -- 172.21.15.86:0/312055620 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f23a80dd6a0 msgr2=0x7f23a80e09b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:57.197 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.154+0000 7f23b795e640 1 --2- 172.21.15.86:0/312055620 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f23a80dd6a0 0x7f23a80e09b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f23a00097c0 tx=0x7f23a0024cb0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.197 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.154+0000 7f39c2d70640 1 -- 172.21.15.86:0/2606268233 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39b40dd4c0 msgr2=0x7f39b4005ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:57.197 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.154+0000 7f39c2d70640 1 --2- 172.21.15.86:0/2606268233 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39b40dd4c0 0x7f39b4005ea0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f39bc069360 tx=0x7f39bc09b390 comp rx=0 tx=0).stop 2024-04-25T12:21:57.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.154+0000 7f39c2d70640 1 -- 172.21.15.86:0/2606268233 shutdown_connections 2024-04-25T12:21:57.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.154+0000 7f39c2d70640 1 --2- 172.21.15.86:0/2606268233 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39b40dd4c0 0x7f39b4005ea0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.154+0000 7f39c2d70640 1 -- 172.21.15.86:0/2606268233 >> 172.21.15.86:0/2606268233 conn(0x7f39b4050190 msgr2=0x7f39b40505a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:57.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.154+0000 7f39c2d70640 1 -- 172.21.15.86:0/2606268233 shutdown_connections 2024-04-25T12:21:57.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.154+0000 7f39c2d70640 1 -- 172.21.15.86:0/2606268233 wait complete. 2024-04-25T12:21:57.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.158+0000 7f23b795e640 1 -- 172.21.15.86:0/312055620 shutdown_connections 2024-04-25T12:21:57.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.158+0000 7f23b795e640 1 --2- 172.21.15.86:0/312055620 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f23a80dd6a0 0x7f23a80e09b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.158+0000 7f23b795e640 1 --2- 172.21.15.86:0/312055620 >> v2:172.21.15.86:3300/0 conn(0x7f23a80d6be0 0x7f23a80343e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.199 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.158+0000 7f23b795e640 1 -- 172.21.15.86:0/312055620 >> 172.21.15.86:0/312055620 conn(0x7f23a80512b0 msgr2=0x7f23a80516c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:57.199 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.158+0000 7f23b795e640 1 -- 172.21.15.86:0/312055620 shutdown_connections 2024-04-25T12:21:57.199 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.158+0000 7f39c2d70640 1 Processor -- start 2024-04-25T12:21:57.199 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.154+0000 7f151a35b640 1 -- 172.21.15.86:0/3621578211 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f15140ca210 msgr2=0x7f1514157260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:57.199 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.158+0000 7f23b795e640 1 -- 172.21.15.86:0/312055620 wait complete. 2024-04-25T12:21:57.200 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.158+0000 7f39c2d70640 1 -- start start 2024-04-25T12:21:57.200 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.158+0000 7f23b795e640 1 Processor -- start 2024-04-25T12:21:57.200 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.158+0000 7f23b795e640 1 -- start start 2024-04-25T12:21:57.201 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.158+0000 7f39c2d70640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39b4045940 0x7f39b40d8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:57.201 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.158+0000 7f39c2d70640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f39b404c6a0 0x7f39b404ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:57.201 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.158+0000 7f39c2d70640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39b40dd4c0 0x7f39b417a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:57.201 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.158+0000 7f39c2d70640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f39b40071f0 con 0x7f39b40dd4c0 2024-04-25T12:21:57.201 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.158+0000 7f39c2d70640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f39b4006f10 con 0x7f39b404c6a0 2024-04-25T12:21:57.201 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.158+0000 7f39c2d70640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f39b40074d0 con 0x7f39b4045940 2024-04-25T12:21:57.202 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.158+0000 7f151a35b640 1 --2- 172.21.15.86:0/3621578211 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f15140ca210 0x7f1514157260 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f150c00aed0 tx=0x7f150c01daf0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.202 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.158+0000 7f151a35b640 1 -- 172.21.15.86:0/3621578211 shutdown_connections 2024-04-25T12:21:57.202 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.158+0000 7f151a35b640 1 --2- 172.21.15.86:0/3621578211 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f15140ca210 0x7f1514157260 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.202 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.158+0000 7f151a35b640 1 -- 172.21.15.86:0/3621578211 >> 172.21.15.86:0/3621578211 conn(0x7f15140c96f0 msgr2=0x7f15140c9b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:57.202 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.158+0000 7f39bbfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f39b404c6a0 0x7f39b404ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:57.203 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.158+0000 7f151a35b640 1 -- 172.21.15.86:0/3621578211 shutdown_connections 2024-04-25T12:21:57.203 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.158+0000 7f39c130d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39b40dd4c0 0x7f39b417a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:57.203 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.158+0000 7f39c130d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39b40dd4c0 0x7f39b417a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:59472/0 (socket says 172.21.15.86:59472) 2024-04-25T12:21:57.203 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.158+0000 7f39c130d640 1 -- 172.21.15.86:0/44620518 learned_addr learned my addr 172.21.15.86:0/44620518 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:57.203 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.158+0000 7f39c0b0c640 1 --2- 172.21.15.86:0/44620518 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39b4045940 0x7f39b40d8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:57.203 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.162+0000 7f39c130d640 1 -- 172.21.15.86:0/44620518 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39b4045940 msgr2=0x7f39b40d8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:57.203 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.162+0000 7f39c130d640 1 --2- 172.21.15.86:0/44620518 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39b4045940 0x7f39b40d8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.204 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.162+0000 7f39c130d640 1 -- 172.21.15.86:0/44620518 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f39b404c6a0 msgr2=0x7f39b404ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:57.204 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.162+0000 7f39c130d640 1 --2- 172.21.15.86:0/44620518 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f39b404c6a0 0x7f39b404ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.204 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.162+0000 7f39c130d640 1 -- 172.21.15.86:0/44620518 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39b40d93f0 con 0x7f39b40dd4c0 2024-04-25T12:21:57.204 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.162+0000 7f39c130d640 1 --2- 172.21.15.86:0/44620518 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39b40dd4c0 0x7f39b417a7d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f39a800c3c0 tx=0x7f39a800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:57.204 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.158+0000 7f151a35b640 1 -- 172.21.15.86:0/3621578211 wait complete. 2024-04-25T12:21:57.204 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.162+0000 7f151a35b640 1 Processor -- start 2024-04-25T12:21:57.204 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.158+0000 7f23b795e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f23a804c560 0x7f23a80ca8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:57.204 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.158+0000 7f23b795e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23a80d6be0 0x7f23a80d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:57.205 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.158+0000 7f23b795e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23a80dd6a0 0x7f23a80d0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:57.205 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.158+0000 7f23b795e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f23a804da80 con 0x7f23a80d6be0 2024-04-25T12:21:57.205 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.162+0000 7f23b795e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f23a804d900 con 0x7f23a80dd6a0 2024-04-25T12:21:57.205 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.162+0000 7f23b795e640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f23a8004e60 con 0x7f23a804c560 2024-04-25T12:21:57.205 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.162+0000 7f23b56fa640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f23a804c560 0x7f23a80ca8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:57.205 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.162+0000 7f23b56fa640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f23a804c560 0x7f23a80ca8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.86:43124/0 (socket says 172.21.15.86:43124) 2024-04-25T12:21:57.205 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.162+0000 7f23b56fa640 1 -- 172.21.15.86:0/3204953892 learned_addr learned my addr 172.21.15.86:0/3204953892 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:57.205 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.162+0000 7f23b5efb640 1 --2- 172.21.15.86:0/3204953892 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23a80dd6a0 0x7f23a80d0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:57.205 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.162+0000 7f23b4ef9640 1 --2- 172.21.15.86:0/3204953892 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23a80d6be0 0x7f23a80d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:57.205 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.162+0000 7f23b5efb640 1 -- 172.21.15.86:0/3204953892 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f23a804c560 msgr2=0x7f23a80ca8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:57.205 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.162+0000 7f23b5efb640 1 --2- 172.21.15.86:0/3204953892 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f23a804c560 0x7f23a80ca8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.205 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.162+0000 7f23b5efb640 1 -- 172.21.15.86:0/3204953892 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23a80d6be0 msgr2=0x7f23a80d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:57.205 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.162+0000 7f23b5efb640 1 --2- 172.21.15.86:0/3204953892 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23a80d6be0 0x7f23a80d1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.205 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.162+0000 7f23b5efb640 1 -- 172.21.15.86:0/3204953892 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23a80dbf50 con 0x7f23a80dd6a0 2024-04-25T12:21:57.206 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.162+0000 7f23b4ef9640 1 --2- 172.21.15.86:0/3204953892 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23a80d6be0 0x7f23a80d1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:21:57.206 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.162+0000 7f23b5efb640 1 --2- 172.21.15.86:0/3204953892 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23a80dd6a0 0x7f23a80d0750 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f23b0065520 tx=0x7f23b006aa60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:57.206 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.162+0000 7f613cff9640 1 -- 172.21.15.86:0/4081881023 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f612c0c4060 con 0x7f61380365a0 2024-04-25T12:21:57.206 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.162+0000 7f151a35b640 1 -- start start 2024-04-25T12:21:57.206 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.162+0000 7f151a35b640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f15140c2680 0x7f15140c5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:57.207 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.162+0000 7f151a35b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15140ca210 0x7f1514148250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:57.207 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.162+0000 7f151a35b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1514151520 0x7f15140c5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:57.207 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.162+0000 7f151a35b640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f15140c3b80 con 0x7f15140ca210 2024-04-25T12:21:57.207 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.162+0000 7f151a35b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f15140c2fe0 con 0x7f1514151520 2024-04-25T12:21:57.207 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.162+0000 7f151a35b640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f15140c3d00 con 0x7f15140c2680 2024-04-25T12:21:57.207 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.162+0000 7f39b97fa640 1 -- 172.21.15.86:0/44620518 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a80052d0 con 0x7f39b40dd4c0 2024-04-25T12:21:57.208 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.162+0000 7f1518b58640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15140ca210 0x7f1514148250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:57.208 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.162+0000 7f1518b58640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15140ca210 0x7f1514148250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:59490/0 (socket says 172.21.15.86:59490) 2024-04-25T12:21:57.208 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.162+0000 7f1518b58640 1 -- 172.21.15.86:0/1525467299 learned_addr learned my addr 172.21.15.86:0/1525467299 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:57.208 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.162+0000 7f39b97fa640 1 -- 172.21.15.86:0/44620518 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39a8005470 con 0x7f39b40dd4c0 2024-04-25T12:21:57.208 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.162+0000 7f39c2d70640 1 -- 172.21.15.86:0/44620518 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39b417cc10 con 0x7f39b40dd4c0 2024-04-25T12:21:57.208 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.162+0000 7f39b97fa640 1 -- 172.21.15.86:0/44620518 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a8007260 con 0x7f39b40dd4c0 2024-04-25T12:21:57.209 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.162+0000 7f1519b5a640 1 --2- 172.21.15.86:0/1525467299 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1514151520 0x7f15140c5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:57.209 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.162+0000 7f1519359640 1 --2- 172.21.15.86:0/1525467299 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f15140c2680 0x7f15140c5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:57.209 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.162+0000 7f1518b58640 1 -- 172.21.15.86:0/1525467299 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f15140c2680 msgr2=0x7f15140c5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:57.209 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.162+0000 7f1518b58640 1 --2- 172.21.15.86:0/1525467299 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f15140c2680 0x7f15140c5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.209 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.162+0000 7f1518b58640 1 -- 172.21.15.86:0/1525467299 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1514151520 msgr2=0x7f15140c5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:57.209 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.162+0000 7f1518b58640 1 --2- 172.21.15.86:0/1525467299 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1514151520 0x7f15140c5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.210 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.162+0000 7f1518b58640 1 -- 172.21.15.86:0/1525467299 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15142009f0 con 0x7f15140ca210 2024-04-25T12:21:57.210 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.162+0000 7f1518b58640 1 --2- 172.21.15.86:0/1525467299 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15140ca210 0x7f1514148250 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f150400c390 tx=0x7f150400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:57.210 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.162+0000 7f39c2d70640 1 -- 172.21.15.86:0/44620518 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39b4179fd0 con 0x7f39b40dd4c0 2024-04-25T12:21:57.210 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.166+0000 7f39c2d70640 1 -- 172.21.15.86:0/44620518 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39b40053a0 con 0x7f39b40dd4c0 2024-04-25T12:21:57.210 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.166+0000 7f39b97fa640 1 -- 172.21.15.86:0/44620518 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f39a8007400 con 0x7f39b40dd4c0 2024-04-25T12:21:57.211 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.166+0000 7f1509ffb640 1 -- 172.21.15.86:0/1525467299 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1504017070 con 0x7f15140ca210 2024-04-25T12:21:57.211 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.166+0000 7f1509ffb640 1 -- 172.21.15.86:0/1525467299 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15040052d0 con 0x7f15140ca210 2024-04-25T12:21:57.211 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.166+0000 7f1509ffb640 1 -- 172.21.15.86:0/1525467299 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1504003820 con 0x7f15140ca210 2024-04-25T12:21:57.211 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.166+0000 7f151a35b640 1 -- 172.21.15.86:0/1525467299 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15141fb040 con 0x7f15140ca210 2024-04-25T12:21:57.211 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.166+0000 7f151a35b640 1 -- 172.21.15.86:0/1525467299 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1514200c60 con 0x7f15140ca210 2024-04-25T12:21:57.212 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.166+0000 7f39b97fa640 1 --2- 172.21.15.86:0/44620518 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f39a00683d0 0x7f39a006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:57.212 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.166+0000 7f151a35b640 1 -- 172.21.15.86:0/1525467299 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1514076360 con 0x7f15140ca210 2024-04-25T12:21:57.212 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.166+0000 7f39c0b0c640 1 --2- 172.21.15.86:0/44620518 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f39a00683d0 0x7f39a006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:57.212 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.166+0000 7f39b97fa640 1 -- 172.21.15.86:0/44620518 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f39a80865c0 con 0x7f39b40dd4c0 2024-04-25T12:21:57.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.170+0000 7f39c0b0c640 1 --2- 172.21.15.86:0/44620518 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f39a00683d0 0x7f39a006a890 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f39b400ddb0 tx=0x7f39bc06f040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:57.214 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.170+0000 7f23a5ffb640 1 -- 172.21.15.86:0/3204953892 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b00743c0 con 0x7f23a80dd6a0 2024-04-25T12:21:57.214 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.170+0000 7f23a5ffb640 1 -- 172.21.15.86:0/3204953892 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23b0074560 con 0x7f23a80dd6a0 2024-04-25T12:21:57.214 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.170+0000 7f23b795e640 1 -- 172.21.15.86:0/3204953892 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23a80dc1f0 con 0x7f23a80dd6a0 2024-04-25T12:21:57.214 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.170+0000 7f23a5ffb640 1 -- 172.21.15.86:0/3204953892 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b00695c0 con 0x7f23a80dd6a0 2024-04-25T12:21:57.214 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.170+0000 7f23b795e640 1 -- 172.21.15.86:0/3204953892 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23a80c75d0 con 0x7f23a80dd6a0 2024-04-25T12:21:57.214 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.170+0000 7f23b795e640 1 -- 172.21.15.86:0/3204953892 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23a80064e0 con 0x7f23a80dd6a0 2024-04-25T12:21:57.215 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.170+0000 7f23a5ffb640 1 -- 172.21.15.86:0/3204953892 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f23b0069b50 con 0x7f23a80dd6a0 2024-04-25T12:21:57.215 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.170+0000 7f23a5ffb640 1 --2- 172.21.15.86:0/3204953892 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f23940683d0 0x7f239406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:57.215 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.170+0000 7f23a5ffb640 1 -- 172.21.15.86:0/3204953892 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f23b0102890 con 0x7f23a80dd6a0 2024-04-25T12:21:57.215 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.170+0000 7f23b56fa640 1 --2- 172.21.15.86:0/3204953892 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f23940683d0 0x7f239406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:57.215 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.174+0000 7f23b56fa640 1 --2- 172.21.15.86:0/3204953892 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f23940683d0 0x7f239406a890 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f23ac00f8f0 tx=0x7f23ac011040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:57.215 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.174+0000 7f39b97fa640 1 -- 172.21.15.86:0/44620518 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f39a80561d0 con 0x7f39b40dd4c0 2024-04-25T12:21:57.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.178+0000 7f1509ffb640 1 -- 172.21.15.86:0/1525467299 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f150401a070 con 0x7f15140ca210 2024-04-25T12:21:57.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.178+0000 7f1509ffb640 1 --2- 172.21.15.86:0/1525467299 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f1500068480 0x7f150006a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:57.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.178+0000 7f1519359640 1 --2- 172.21.15.86:0/1525467299 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f1500068480 0x7f150006a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:57.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.178+0000 7f1519359640 1 --2- 172.21.15.86:0/1525467299 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f1500068480 0x7f150006a940 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1510005890 tx=0x7f1510009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:57.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.178+0000 7f1509ffb640 1 -- 172.21.15.86:0/1525467299 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f1504054130 con 0x7f15140ca210 2024-04-25T12:21:57.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.182+0000 7f23a5ffb640 1 -- 172.21.15.86:0/3204953892 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f23b0091030 con 0x7f23a80dd6a0 2024-04-25T12:21:57.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.186+0000 7f1509ffb640 1 -- 172.21.15.86:0/1525467299 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1504021020 con 0x7f15140ca210 2024-04-25T12:21:57.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.462+0000 7f36a1470640 1 -- 172.21.15.86:0/3456475360 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f3694006de0 con 0x7f369404b3c0 2024-04-25T12:21:57.470 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.462+0000 7f36837fe640 1 -- 172.21.15.86:0/3456475360 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f368c0160d0 con 0x7f369404b3c0 2024-04-25T12:21:57.470 INFO:teuthology.orchestra.run.smithi086.stdout:55834574860 2024-04-25T12:21:57.474 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.466+0000 7f36817fa640 1 -- 172.21.15.86:0/3456475360 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f3684068540 msgr2=0x7f368406aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:57.474 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.466+0000 7f36817fa640 1 --2- 172.21.15.86:0/3456475360 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f3684068540 0x7f368406aa00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f36940e3b20 tx=0x7f3690009240 comp rx=0 tx=0).stop 2024-04-25T12:21:57.474 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.466+0000 7f36817fa640 1 -- 172.21.15.86:0/3456475360 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f369404b3c0 msgr2=0x7f36940df4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:57.474 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.466+0000 7f36817fa640 1 --2- 172.21.15.86:0/3456475360 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f369404b3c0 0x7f36940df4f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f368c0ae040 tx=0x7f368c019280 comp rx=0 tx=0).stop 2024-04-25T12:21:57.474 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.466+0000 7f36817fa640 1 -- 172.21.15.86:0/3456475360 shutdown_connections 2024-04-25T12:21:57.475 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.466+0000 7f36817fa640 1 --2- 172.21.15.86:0/3456475360 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f369404a1b0 0x7f3694048020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.475 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.466+0000 7f36817fa640 1 --2- 172.21.15.86:0/3456475360 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36940dd5e0 0x7f369417d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.475 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.466+0000 7f36817fa640 1 --2- 172.21.15.86:0/3456475360 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f3684068540 0x7f368406aa00 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.475 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.466+0000 7f36817fa640 1 --2- 172.21.15.86:0/3456475360 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f369404b3c0 0x7f36940df4f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.475 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.466+0000 7f36817fa640 1 -- 172.21.15.86:0/3456475360 >> 172.21.15.86:0/3456475360 conn(0x7f369404d4c0 msgr2=0x7f36940db280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:57.475 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.466+0000 7f36817fa640 1 -- 172.21.15.86:0/3456475360 shutdown_connections 2024-04-25T12:21:57.475 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.466+0000 7f36817fa640 1 -- 172.21.15.86:0/3456475360 wait complete. 2024-04-25T12:21:57.482 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.474+0000 7fb8df59e640 1 -- 172.21.15.86:0/2902479359 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fb8d804f700 con 0x7fb8d8051430 2024-04-25T12:21:57.483 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.478+0000 7fb8ceffd640 1 -- 172.21.15.86:0/2902479359 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb8d005e720 con 0x7fb8d8051430 2024-04-25T12:21:57.484 INFO:teuthology.orchestra.run.smithi086.stdout:55834574861 2024-04-25T12:21:57.485 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.478+0000 7f2fab1f7640 1 -- 172.21.15.86:0/3238473049 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f2f9c04c6a0 con 0x7f2f9c04d840 2024-04-25T12:21:57.485 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.478+0000 7f86e7f0c640 1 -- 172.21.15.86:0/971574489 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f86c8005860 con 0x7f86d8046c80 2024-04-25T12:21:57.485 INFO:teuthology.orchestra.run.smithi086.stdout:55834574860 2024-04-25T12:21:57.486 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.478+0000 7f2f997fa640 1 -- 172.21.15.86:0/3238473049 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2f940567c0 con 0x7f2f9c04d840 2024-04-25T12:21:57.486 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.478+0000 7f86d67fc640 1 -- 172.21.15.86:0/971574489 <== mon.2 v2:172.21.15.134:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f86d0056330 con 0x7f86d8046c80 2024-04-25T12:21:57.486 INFO:teuthology.orchestra.run.smithi086.stdout:55834574859 2024-04-25T12:21:57.487 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.478+0000 7fb8df59e640 1 -- 172.21.15.86:0/2902479359 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fb8c0068480 msgr2=0x7fb8c006a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:57.487 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.478+0000 7fb8df59e640 1 --2- 172.21.15.86:0/2902479359 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fb8c0068480 0x7fb8c006a940 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb8d80d5940 tx=0x7fb8d4009040 comp rx=0 tx=0).stop 2024-04-25T12:21:57.487 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.478+0000 7fb8df59e640 1 -- 172.21.15.86:0/2902479359 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8d8051430 msgr2=0x7fb8d80dbb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:57.487 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.478+0000 7fb8df59e640 1 --2- 172.21.15.86:0/2902479359 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8d8051430 0x7fb8d80dbb30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb8d0010ce0 tx=0x7fb8d000e4d0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.487 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.478+0000 7fb8df59e640 1 -- 172.21.15.86:0/2902479359 shutdown_connections 2024-04-25T12:21:57.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.478+0000 7fb8df59e640 1 --2- 172.21.15.86:0/2902479359 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fb8c0068480 0x7fb8c006a940 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.478+0000 7fb8df59e640 1 --2- 172.21.15.86:0/2902479359 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8d8179920 0x7fb8d80da0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.478+0000 7fb8df59e640 1 --2- 172.21.15.86:0/2902479359 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb8d8051810 0x7fb8d80d9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.478+0000 7fb8df59e640 1 --2- 172.21.15.86:0/2902479359 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8d8051430 0x7fb8d80dbb30 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.478+0000 7fb8df59e640 1 -- 172.21.15.86:0/2902479359 >> 172.21.15.86:0/2902479359 conn(0x7fb8d800e0d0 msgr2=0x7fb8d80d4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:57.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.482+0000 7fb8df59e640 1 -- 172.21.15.86:0/2902479359 shutdown_connections 2024-04-25T12:21:57.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.482+0000 7fb8df59e640 1 -- 172.21.15.86:0/2902479359 wait complete. 2024-04-25T12:21:57.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.482+0000 7f2fab1f7640 1 -- 172.21.15.86:0/3238473049 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f2f90068400 msgr2=0x7f2f9006a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:57.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.482+0000 7f2fab1f7640 1 --2- 172.21.15.86:0/3238473049 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f2f90068400 0x7f2f9006a8c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2fa001fab0 tx=0x7f2fa00ac000 comp rx=0 tx=0).stop 2024-04-25T12:21:57.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.482+0000 7f2fab1f7640 1 -- 172.21.15.86:0/3238473049 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f9c04d840 msgr2=0x7f2f9c0d7b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:57.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.482+0000 7f2fab1f7640 1 --2- 172.21.15.86:0/3238473049 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f9c04d840 0x7f2f9c0d7b20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2f9400b410 tx=0x7f2f9400b8d0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.482+0000 7f2fab1f7640 1 -- 172.21.15.86:0/3238473049 shutdown_connections 2024-04-25T12:21:57.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.482+0000 7f2fab1f7640 1 --2- 172.21.15.86:0/3238473049 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f9c0d5c30 0x7f2f9c166260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.482+0000 7f2fab1f7640 1 --2- 172.21.15.86:0/3238473049 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f2f90068400 0x7f2f9006a8c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.482+0000 7f2fab1f7640 1 --2- 172.21.15.86:0/3238473049 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f9c04d840 0x7f2f9c0d7b20 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.482+0000 7f2fab1f7640 1 --2- 172.21.15.86:0/3238473049 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2f9c046880 0x7f2f9c175060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.482+0000 7f2fab1f7640 1 -- 172.21.15.86:0/3238473049 >> 172.21.15.86:0/3238473049 conn(0x7f2f9c04dd40 msgr2=0x7f2f9c0d0950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:57.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.482+0000 7f2fab1f7640 1 -- 172.21.15.86:0/3238473049 shutdown_connections 2024-04-25T12:21:57.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.482+0000 7f2fab1f7640 1 -- 172.21.15.86:0/3238473049 wait complete. 2024-04-25T12:21:57.491 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.482+0000 7f86e7f0c640 1 -- 172.21.15.86:0/971574489 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f86c4068450 msgr2=0x7f86c406a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:57.491 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.482+0000 7f86e7f0c640 1 --2- 172.21.15.86:0/971574489 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f86c4068450 0x7f86c406a910 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f86dc007fd0 tx=0x7f86dc0079a0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.491 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.482+0000 7f86e7f0c640 1 -- 172.21.15.86:0/971574489 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f86d8046c80 msgr2=0x7f86d80fff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:57.491 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.482+0000 7f86e7f0c640 1 --2- 172.21.15.86:0/971574489 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f86d8046c80 0x7f86d80fff50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f86d000baa0 tx=0x7f86d000bf60 comp rx=0 tx=0).stop 2024-04-25T12:21:57.491 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.486+0000 7f86e7f0c640 1 -- 172.21.15.86:0/971574489 shutdown_connections 2024-04-25T12:21:57.491 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.486+0000 7f86e7f0c640 1 --2- 172.21.15.86:0/971574489 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86d80f6bf0 0x7f86d80f4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.491 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.486+0000 7f86e7f0c640 1 --2- 172.21.15.86:0/971574489 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f86d8046c80 0x7f86d80fff50 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.491 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.486+0000 7f86e7f0c640 1 --2- 172.21.15.86:0/971574489 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f86c4068450 0x7f86c406a910 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.491 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.486+0000 7f86e7f0c640 1 --2- 172.21.15.86:0/971574489 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f86d8045480 0x7f86d81a3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.491 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.486+0000 7f86e7f0c640 1 -- 172.21.15.86:0/971574489 >> 172.21.15.86:0/971574489 conn(0x7f86d80501c0 msgr2=0x7f86d804dfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:57.495 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.490+0000 7f86e7f0c640 1 -- 172.21.15.86:0/971574489 shutdown_connections 2024-04-25T12:21:57.495 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.490+0000 7f86e7f0c640 1 -- 172.21.15.86:0/971574489 wait complete. 2024-04-25T12:21:57.499 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574862 got 55834574860 for osd.0 2024-04-25T12:21:57.502 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.494+0000 7f6145489640 1 -- 172.21.15.86:0/4081881023 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f61380dadb0 con 0x7f61380365a0 2024-04-25T12:21:57.502 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.494+0000 7f613cff9640 1 -- 172.21.15.86:0/4081881023 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f612c016110 con 0x7f61380365a0 2024-04-25T12:21:57.502 INFO:teuthology.orchestra.run.smithi086.stdout:55834574860 2024-04-25T12:21:57.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.498+0000 7f6145489640 1 -- 172.21.15.86:0/4081881023 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f6124068380 msgr2=0x7f612406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:57.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.498+0000 7f6145489640 1 --2- 172.21.15.86:0/4081881023 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f6124068380 0x7f612406a840 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f61340099b0 tx=0x7f6134009190 comp rx=0 tx=0).stop 2024-04-25T12:21:57.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.498+0000 7f6145489640 1 -- 172.21.15.86:0/4081881023 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61380365a0 msgr2=0x7f61380c6310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:57.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.498+0000 7f6145489640 1 --2- 172.21.15.86:0/4081881023 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61380365a0 0x7f61380c6310 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f612c0ac000 tx=0x7f612c01ad60 comp rx=0 tx=0).stop 2024-04-25T12:21:57.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.498+0000 7f6145489640 1 -- 172.21.15.86:0/4081881023 shutdown_connections 2024-04-25T12:21:57.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.498+0000 7f6145489640 1 --2- 172.21.15.86:0/4081881023 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f613804a950 0x7f61380c6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.498+0000 7f6145489640 1 --2- 172.21.15.86:0/4081881023 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f6124068380 0x7f612406a840 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.498+0000 7f6145489640 1 --2- 172.21.15.86:0/4081881023 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61380365a0 0x7f61380c6310 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.498+0000 7f6145489640 1 --2- 172.21.15.86:0/4081881023 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6138034980 0x7f61380ced40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.498+0000 7f6145489640 1 -- 172.21.15.86:0/4081881023 >> 172.21.15.86:0/4081881023 conn(0x7f613804d4c0 msgr2=0x7f6138005a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:57.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.498+0000 7f6145489640 1 -- 172.21.15.86:0/4081881023 shutdown_connections 2024-04-25T12:21:57.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.498+0000 7f39c2d70640 1 -- 172.21.15.86:0/44620518 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f39b404bc70 con 0x7f39b40dd4c0 2024-04-25T12:21:57.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.498+0000 7f6145489640 1 -- 172.21.15.86:0/4081881023 wait complete. 2024-04-25T12:21:57.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.498+0000 7f39b97fa640 1 -- 172.21.15.86:0/44620518 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f39a805a4d0 con 0x7f39b40dd4c0 2024-04-25T12:21:57.508 INFO:teuthology.orchestra.run.smithi086.stdout:55834574859 2024-04-25T12:21:57.509 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.502+0000 7f39c2d70640 1 -- 172.21.15.86:0/44620518 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f39a00683d0 msgr2=0x7f39a006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:57.509 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.502+0000 7f39c2d70640 1 --2- 172.21.15.86:0/44620518 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f39a00683d0 0x7f39a006a890 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f39b400ddb0 tx=0x7f39bc06f040 comp rx=0 tx=0).stop 2024-04-25T12:21:57.509 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.502+0000 7f39c2d70640 1 -- 172.21.15.86:0/44620518 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39b40dd4c0 msgr2=0x7f39b417a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:57.509 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.502+0000 7f39c2d70640 1 --2- 172.21.15.86:0/44620518 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39b40dd4c0 0x7f39b417a7d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f39a800c3c0 tx=0x7f39a800c880 comp rx=0 tx=0).stop 2024-04-25T12:21:57.509 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.502+0000 7f39c2d70640 1 -- 172.21.15.86:0/44620518 shutdown_connections 2024-04-25T12:21:57.509 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.502+0000 7f39c2d70640 1 --2- 172.21.15.86:0/44620518 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f39a00683d0 0x7f39a006a890 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.510 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.502+0000 7f39c2d70640 1 --2- 172.21.15.86:0/44620518 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39b40dd4c0 0x7f39b417a7d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.510 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.502+0000 7f39c2d70640 1 --2- 172.21.15.86:0/44620518 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f39b404c6a0 0x7f39b404ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.510 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.502+0000 7f39c2d70640 1 --2- 172.21.15.86:0/44620518 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39b4045940 0x7f39b40d8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.510 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.502+0000 7f39c2d70640 1 -- 172.21.15.86:0/44620518 >> 172.21.15.86:0/44620518 conn(0x7f39b4050190 msgr2=0x7f39b404f840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:57.510 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.502+0000 7f39c2d70640 1 -- 172.21.15.86:0/44620518 shutdown_connections 2024-04-25T12:21:57.510 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.502+0000 7f39c2d70640 1 -- 172.21.15.86:0/44620518 wait complete. 2024-04-25T12:21:57.515 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574862 got 55834574860 for osd.2 2024-04-25T12:21:57.517 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.510+0000 7f151a35b640 1 -- 172.21.15.86:0/1525467299 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f15140b2ae0 con 0x7f15140ca210 2024-04-25T12:21:57.517 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.510+0000 7f1509ffb640 1 -- 172.21.15.86:0/1525467299 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1504005480 con 0x7f15140ca210 2024-04-25T12:21:57.518 INFO:teuthology.orchestra.run.smithi086.stdout:55834574860 2024-04-25T12:21:57.520 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574863 got 55834574861 for osd.3 2024-04-25T12:21:57.521 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.514+0000 7f151a35b640 1 -- 172.21.15.86:0/1525467299 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f1500068480 msgr2=0x7f150006a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:57.521 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.514+0000 7f151a35b640 1 --2- 172.21.15.86:0/1525467299 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f1500068480 0x7f150006a940 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1510005890 tx=0x7f1510009040 comp rx=0 tx=0).stop 2024-04-25T12:21:57.521 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.514+0000 7f151a35b640 1 -- 172.21.15.86:0/1525467299 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15140ca210 msgr2=0x7f1514148250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:57.521 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.514+0000 7f151a35b640 1 --2- 172.21.15.86:0/1525467299 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15140ca210 0x7f1514148250 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f150400c390 tx=0x7f150400c850 comp rx=0 tx=0).stop 2024-04-25T12:21:57.522 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.514+0000 7f151a35b640 1 -- 172.21.15.86:0/1525467299 shutdown_connections 2024-04-25T12:21:57.522 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.514+0000 7f151a35b640 1 --2- 172.21.15.86:0/1525467299 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1514151520 0x7f15140c5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.522 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.514+0000 7f151a35b640 1 --2- 172.21.15.86:0/1525467299 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f1500068480 0x7f150006a940 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.522 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.514+0000 7f151a35b640 1 --2- 172.21.15.86:0/1525467299 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15140ca210 0x7f1514148250 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.522 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.514+0000 7f151a35b640 1 --2- 172.21.15.86:0/1525467299 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f15140c2680 0x7f15140c5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.522 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.514+0000 7f151a35b640 1 -- 172.21.15.86:0/1525467299 >> 172.21.15.86:0/1525467299 conn(0x7f15140c96f0 msgr2=0x7f1514150470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:57.522 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.514+0000 7f151a35b640 1 -- 172.21.15.86:0/1525467299 shutdown_connections 2024-04-25T12:21:57.522 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.514+0000 7f151a35b640 1 -- 172.21.15.86:0/1525467299 wait complete. 2024-04-25T12:21:57.523 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.514+0000 7f23b795e640 1 -- 172.21.15.86:0/3204953892 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f23a80d2030 con 0x7f23a80dd6a0 2024-04-25T12:21:57.523 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.514+0000 7f23a5ffb640 1 -- 172.21.15.86:0/3204953892 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f23b00d2bf0 con 0x7f23a80dd6a0 2024-04-25T12:21:57.523 INFO:teuthology.orchestra.run.smithi086.stdout:55834574859 2024-04-25T12:21:57.524 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574859 for osd.4 2024-04-25T12:21:57.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.518+0000 7f23b795e640 1 -- 172.21.15.86:0/3204953892 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f23940683d0 msgr2=0x7f239406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:57.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.518+0000 7f23b795e640 1 --2- 172.21.15.86:0/3204953892 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f23940683d0 0x7f239406a890 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f23ac00f8f0 tx=0x7f23ac011040 comp rx=0 tx=0).stop 2024-04-25T12:21:57.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.518+0000 7f23b795e640 1 -- 172.21.15.86:0/3204953892 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23a80dd6a0 msgr2=0x7f23a80d0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:57.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.518+0000 7f23b795e640 1 --2- 172.21.15.86:0/3204953892 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23a80dd6a0 0x7f23a80d0750 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f23b0065520 tx=0x7f23b006aa60 comp rx=0 tx=0).stop 2024-04-25T12:21:57.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.518+0000 7f23b795e640 1 -- 172.21.15.86:0/3204953892 shutdown_connections 2024-04-25T12:21:57.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.518+0000 7f23b795e640 1 --2- 172.21.15.86:0/3204953892 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23a80dd6a0 0x7f23a80d0750 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.518+0000 7f23b795e640 1 --2- 172.21.15.86:0/3204953892 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f23940683d0 0x7f239406a890 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.518+0000 7f23b795e640 1 --2- 172.21.15.86:0/3204953892 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23a80d6be0 0x7f23a80d1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.518+0000 7f23b795e640 1 --2- 172.21.15.86:0/3204953892 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f23a804c560 0x7f23a80ca8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.518+0000 7f23b795e640 1 -- 172.21.15.86:0/3204953892 >> 172.21.15.86:0/3204953892 conn(0x7f23a80512b0 msgr2=0x7f23a8007e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:57.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.518+0000 7f23b795e640 1 -- 172.21.15.86:0/3204953892 shutdown_connections 2024-04-25T12:21:57.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:57.518+0000 7f23b795e640 1 -- 172.21.15.86:0/3204953892 wait complete. 2024-04-25T12:21:57.533 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574861 got 55834574859 for osd.7 2024-04-25T12:21:57.539 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574862 got 55834574860 for osd.5 2024-04-25T12:21:57.544 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574861 got 55834574859 for osd.1 2024-04-25T12:21:57.545 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574862 got 55834574860 for osd.6 2024-04-25T12:21:58.412 INFO:tasks.ceph.mds.f.smithi134.stderr:2024-04-25T12:21:58.406+0000 7f970442b640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-04-25T12:21:58.500 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T12:21:58.517 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T12:21:58.520 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T12:21:58.525 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-25T12:21:58.534 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-25T12:21:58.540 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-25T12:21:58.544 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T12:21:58.546 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-25T12:21:58.682 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.674+0000 7f61d27f9640 1 Processor -- start 2024-04-25T12:21:58.683 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.674+0000 7f61d27f9640 1 -- start start 2024-04-25T12:21:58.683 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.678+0000 7f61d27f9640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f61cc1512d0 0x7f61cc0c6f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:58.683 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.678+0000 7f61d27f9640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61cc157100 0x7f61cc072510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:58.684 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.678+0000 7f61d27f9640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61cc071a50 con 0x7f61cc072a50 2024-04-25T12:21:58.684 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.678+0000 7f61d27f9640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f61cc0c77e0 con 0x7f61cc1512d0 2024-04-25T12:21:58.684 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.678+0000 7f61d27f9640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f61cc0c7ac0 con 0x7f61cc157100 2024-04-25T12:21:58.684 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.678+0000 7f61cb7fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61cc157100 0x7f61cc072510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:58.684 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.678+0000 7f61cb7fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61cc157100 0x7f61cc072510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.86:43136/0 (socket says 172.21.15.86:43136) 2024-04-25T12:21:58.684 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.678+0000 7f61cb7fe640 1 -- 172.21.15.86:0/705150194 learned_addr learned my addr 172.21.15.86:0/705150194 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:58.684 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.678+0000 7f61cbfff640 1 --2- 172.21.15.86:0/705150194 >> v2:172.21.15.134:3300/0 conn(0x7f61cc1512d0 0x7f61cc0c6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:58.687 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.678+0000 7f61cb7fe640 1 -- 172.21.15.86:0/705150194 >> v2:172.21.15.134:3300/0 conn(0x7f61cc1512d0 msgr2=0x7f61cc0c6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:58.687 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.678+0000 7f61cb7fe640 1 --2- 172.21.15.86:0/705150194 >> v2:172.21.15.134:3300/0 conn(0x7f61cc1512d0 0x7f61cc0c6f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:58.687 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.678+0000 7f61cb7fe640 1 -- 172.21.15.86:0/705150194 >> v1:172.21.15.134:6789/0 conn(0x7f61cc072a50 legacy=0x7f61cc070f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:58.687 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.678+0000 7f61cb7fe640 1 -- 172.21.15.86:0/705150194 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61cc0c7da0 con 0x7f61cc157100 2024-04-25T12:21:58.687 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.682+0000 7f61cb7fe640 1 --2- 172.21.15.86:0/705150194 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61cc157100 0x7f61cc072510 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f61c400d3c0 tx=0x7f61c401ee00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=837f9f72517dbf61 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:58.688 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.682+0000 7f61caffd640 1 -- 172.21.15.86:0/705150194 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c40ad070 con 0x7f61cc157100 2024-04-25T12:21:58.688 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.682+0000 7f61caffd640 1 -- 172.21.15.86:0/705150194 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61c40b1400 con 0x7f61cc157100 2024-04-25T12:21:58.688 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.682+0000 7f61caffd640 1 -- 172.21.15.86:0/705150194 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c400be60 con 0x7f61cc157100 2024-04-25T12:21:58.689 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.682+0000 7f61d27f9640 1 -- 172.21.15.86:0/705150194 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61cc157100 msgr2=0x7f61cc072510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:58.689 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.682+0000 7f61d27f9640 1 --2- 172.21.15.86:0/705150194 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61cc157100 0x7f61cc072510 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f61c400d3c0 tx=0x7f61c401ee00 comp rx=0 tx=0).stop 2024-04-25T12:21:58.689 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.682+0000 7f61d27f9640 1 -- 172.21.15.86:0/705150194 shutdown_connections 2024-04-25T12:21:58.690 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.682+0000 7f61d27f9640 1 --2- 172.21.15.86:0/705150194 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61cc157100 0x7f61cc072510 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:58.690 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.682+0000 7f61d27f9640 1 --2- 172.21.15.86:0/705150194 >> v2:172.21.15.134:3300/0 conn(0x7f61cc1512d0 0x7f61cc0c6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:58.690 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.682+0000 7f61d27f9640 1 -- 172.21.15.86:0/705150194 >> 172.21.15.86:0/705150194 conn(0x7f61cc0c9050 msgr2=0x7f61cc0c9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:58.690 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.682+0000 7f61d27f9640 1 -- 172.21.15.86:0/705150194 shutdown_connections 2024-04-25T12:21:58.690 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.682+0000 7f61d27f9640 1 -- 172.21.15.86:0/705150194 wait complete. 2024-04-25T12:21:58.691 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.686+0000 7f61d27f9640 1 Processor -- start 2024-04-25T12:21:58.691 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.686+0000 7f61d27f9640 1 -- start start 2024-04-25T12:21:58.693 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.686+0000 7f61d27f9640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61cc072a50 0x7f61cc145ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:58.693 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.686+0000 7f61d27f9640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61cc1512d0 0x7f61cc143420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:58.693 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.686+0000 7f61d27f9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61cc157100 0x7f61cc143960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:58.693 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.686+0000 7f61d27f9640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f61cc06e710 con 0x7f61cc072a50 2024-04-25T12:21:58.693 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.686+0000 7f61d27f9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f61cc06e590 con 0x7f61cc157100 2024-04-25T12:21:58.693 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.686+0000 7f61d27f9640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f61cc0c8c30 con 0x7f61cc1512d0 2024-04-25T12:21:58.693 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.686+0000 7f61cb7fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61cc1512d0 0x7f61cc143420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:58.693 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.686+0000 7f61cbfff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61cc072a50 0x7f61cc145ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:58.693 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.686+0000 7f61cb7fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61cc1512d0 0x7f61cc143420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.86:43144/0 (socket says 172.21.15.86:43144) 2024-04-25T12:21:58.693 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.686+0000 7f61cb7fe640 1 -- 172.21.15.86:0/2050386631 learned_addr learned my addr 172.21.15.86:0/2050386631 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:58.693 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.686+0000 7f61cbfff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61cc072a50 0x7f61cc145ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:59492/0 (socket says 172.21.15.86:59492) 2024-04-25T12:21:58.693 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.686+0000 7f61d0d96640 1 --2- 172.21.15.86:0/2050386631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61cc157100 0x7f61cc143960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:58.694 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.686+0000 7f61cb7fe640 1 -- 172.21.15.86:0/2050386631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61cc157100 msgr2=0x7f61cc143960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:58.694 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.686+0000 7f61cb7fe640 1 --2- 172.21.15.86:0/2050386631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61cc157100 0x7f61cc143960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:58.694 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.686+0000 7f61cb7fe640 1 -- 172.21.15.86:0/2050386631 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61cc072a50 msgr2=0x7f61cc145ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:58.694 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.686+0000 7f61cb7fe640 1 --2- 172.21.15.86:0/2050386631 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61cc072a50 0x7f61cc145ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:58.694 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.686+0000 7f61cb7fe640 1 -- 172.21.15.86:0/2050386631 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61cc0c4020 con 0x7f61cc1512d0 2024-04-25T12:21:58.694 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.686+0000 7f61cb7fe640 1 --2- 172.21.15.86:0/2050386631 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61cc1512d0 0x7f61cc143420 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f61c401d4b0 tx=0x7f61c401bba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:58.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.698+0000 7f61c8ff9640 1 -- 172.21.15.86:0/2050386631 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c40c0070 con 0x7f61cc1512d0 2024-04-25T12:21:58.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.698+0000 7f61d27f9640 1 -- 172.21.15.86:0/2050386631 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61cc1f3490 con 0x7f61cc1512d0 2024-04-25T12:21:58.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.698+0000 7f61d27f9640 1 -- 172.21.15.86:0/2050386631 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f61cc1f3a50 con 0x7f61cc1512d0 2024-04-25T12:21:58.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.698+0000 7f61c8ff9640 1 -- 172.21.15.86:0/2050386631 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61c4007d30 con 0x7f61cc1512d0 2024-04-25T12:21:58.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.698+0000 7f61c8ff9640 1 -- 172.21.15.86:0/2050386631 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c40ad040 con 0x7f61cc1512d0 2024-04-25T12:21:58.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.698+0000 7f61d27f9640 1 -- 172.21.15.86:0/2050386631 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61ac0052a0 con 0x7f61cc1512d0 2024-04-25T12:21:58.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.698+0000 7f61c8ff9640 1 -- 172.21.15.86:0/2050386631 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f61c40c3070 con 0x7f61cc1512d0 2024-04-25T12:21:58.706 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.698+0000 7f61c8ff9640 1 --2- 172.21.15.86:0/2050386631 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f61b8068400 0x7f61b806a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:58.706 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.698+0000 7f61c8ff9640 1 -- 172.21.15.86:0/2050386631 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f61c4120c70 con 0x7f61cc1512d0 2024-04-25T12:21:58.706 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.698+0000 7f61cbfff640 1 --2- 172.21.15.86:0/2050386631 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f61b8068400 0x7f61b806a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:58.706 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.698+0000 7f61cbfff640 1 --2- 172.21.15.86:0/2050386631 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f61b8068400 0x7f61b806a8c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f61c0010c00 tx=0x7f61c0012040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:58.719 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.710+0000 7f61c8ff9640 1 -- 172.21.15.86:0/2050386631 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f61c4018a20 con 0x7f61cc1512d0 2024-04-25T12:21:58.724 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.714+0000 7faa961f3640 1 Processor -- start 2024-04-25T12:21:58.724 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.714+0000 7faa961f3640 1 -- start start 2024-04-25T12:21:58.724 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.714+0000 7faa961f3640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7faa9015f800 0x7faa9015fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:58.724 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.714+0000 7faa961f3640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faa90160120 0x7faa901593b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:58.724 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.714+0000 7faa961f3640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa900c4800 con 0x7faa900c6690 2024-04-25T12:21:58.724 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.714+0000 7faa961f3640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7faa900c4ac0 con 0x7faa9015f800 2024-04-25T12:21:58.724 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.714+0000 7faa961f3640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7faa900c4da0 con 0x7faa90160120 2024-04-25T12:21:58.724 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.718+0000 7faa8effd640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faa90160120 0x7faa901593b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:58.724 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.718+0000 7faa8f7fe640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7faa9015f800 0x7faa9015fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:58.724 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.718+0000 7faa8f7fe640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7faa9015f800 0x7faa9015fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:59502/0 (socket says 172.21.15.86:59502) 2024-04-25T12:21:58.724 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.718+0000 7faa8f7fe640 1 -- 172.21.15.86:0/324842657 learned_addr learned my addr 172.21.15.86:0/324842657 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:58.724 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.718+0000 7faa8f7fe640 1 -- 172.21.15.86:0/324842657 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faa90160120 msgr2=0x7faa901593b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:58.725 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.718+0000 7faa8f7fe640 1 --2- 172.21.15.86:0/324842657 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faa90160120 0x7faa901593b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:58.725 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.718+0000 7faa8f7fe640 1 -- 172.21.15.86:0/324842657 >> v1:172.21.15.134:6789/0 conn(0x7faa900c6690 legacy=0x7faa900c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:58.725 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.718+0000 7faa8f7fe640 1 -- 172.21.15.86:0/324842657 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa900c5080 con 0x7faa9015f800 2024-04-25T12:21:58.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.714+0000 7f1a45848640 1 Processor -- start 2024-04-25T12:21:58.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.714+0000 7f1a45848640 1 -- start start 2024-04-25T12:21:58.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.718+0000 7f1a45848640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1a4016b580 0x7f1a4016b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:58.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.718+0000 7f1a45848640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a4016c1d0 con 0x7f1a400c9b70 2024-04-25T12:21:58.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.718+0000 7f1a45848640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a4006f040 con 0x7f1a400c3250 2024-04-25T12:21:58.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.718+0000 7f1a45848640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f1a400c7180 con 0x7f1a4016b580 2024-04-25T12:21:58.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.718+0000 7f1a3e7fc640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f1a400c3250 0x7f1a40164f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.86:59464/0 (socket says 172.21.15.86:59464) 2024-04-25T12:21:58.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.718+0000 7f1a3e7fc640 1 -- 172.21.15.86:0/1311484377 learned_addr learned my addr 172.21.15.86:0/1311484377 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-04-25T12:21:58.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.718+0000 7f1a3effd640 1 --2- 172.21.15.86:0/1311484377 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1a4016b580 0x7f1a4016b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:58.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.718+0000 7f1a3dffb640 1 -- 172.21.15.86:0/1311484377 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2889013826 0 0) 0x7f1a4006f040 con 0x7f1a400c3250 2024-04-25T12:21:58.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.718+0000 7f1a3dffb640 1 -- 172.21.15.86:0/1311484377 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a28003430 con 0x7f1a400c3250 2024-04-25T12:21:58.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.718+0000 7f1a3effd640 1 -- 172.21.15.86:0/1311484377 >> v1:172.21.15.134:6789/0 conn(0x7f1a400c3250 legacy=0x7f1a40164f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:58.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.718+0000 7f1a3effd640 1 -- 172.21.15.86:0/1311484377 >> v1:172.21.15.86:6789/0 conn(0x7f1a400c9b70 legacy=0x7f1a400c7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:58.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.718+0000 7f1a3effd640 1 -- 172.21.15.86:0/1311484377 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a4006f320 con 0x7f1a4016b580 2024-04-25T12:21:58.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.718+0000 7faa8f7fe640 1 --2- 172.21.15.86:0/324842657 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faa9015f800 0x7faa9015fbe0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7faa78009870 tx=0x7faa7801c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5a366787eadff6d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:58.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.718+0000 7faa8e7fc640 1 -- 172.21.15.86:0/324842657 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa780a95f0 con 0x7faa9015f800 2024-04-25T12:21:58.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.718+0000 7faa8e7fc640 1 -- 172.21.15.86:0/324842657 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa780a9790 con 0x7faa9015f800 2024-04-25T12:21:58.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.718+0000 7faa8e7fc640 1 -- 172.21.15.86:0/324842657 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa780a9b60 con 0x7faa9015f800 2024-04-25T12:21:58.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.722+0000 7faa961f3640 1 -- 172.21.15.86:0/324842657 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faa9015f800 msgr2=0x7faa9015fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:58.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.722+0000 7faa961f3640 1 --2- 172.21.15.86:0/324842657 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faa9015f800 0x7faa9015fbe0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7faa78009870 tx=0x7faa7801c530 comp rx=0 tx=0).stop 2024-04-25T12:21:58.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.722+0000 7faa961f3640 1 -- 172.21.15.86:0/324842657 shutdown_connections 2024-04-25T12:21:58.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.722+0000 7faa961f3640 1 --2- 172.21.15.86:0/324842657 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faa90160120 0x7faa901593b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:58.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.722+0000 7faa961f3640 1 --2- 172.21.15.86:0/324842657 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faa9015f800 0x7faa9015fbe0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:58.729 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.722+0000 7faa961f3640 1 -- 172.21.15.86:0/324842657 >> 172.21.15.86:0/324842657 conn(0x7faa9006b9d0 msgr2=0x7faa9006bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:58.729 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.722+0000 7faa961f3640 1 -- 172.21.15.86:0/324842657 shutdown_connections 2024-04-25T12:21:58.729 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.722+0000 7faa961f3640 1 -- 172.21.15.86:0/324842657 wait complete. 2024-04-25T12:21:58.729 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.722+0000 7f1a3effd640 1 --2- 172.21.15.86:0/1311484377 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1a4016b580 0x7f1a4016b960 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1a300096f0 tx=0x7f1a3001c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1006494a5952a120 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:58.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.722+0000 7f1a3dffb640 1 -- 172.21.15.86:0/1311484377 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a300b0070 con 0x7f1a4016b580 2024-04-25T12:21:58.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.722+0000 7f1a3dffb640 1 -- 172.21.15.86:0/1311484377 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a300ab400 con 0x7f1a4016b580 2024-04-25T12:21:58.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.722+0000 7f1a3dffb640 1 -- 172.21.15.86:0/1311484377 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a300ab810 con 0x7f1a4016b580 2024-04-25T12:21:58.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.722+0000 7f1a45848640 1 -- 172.21.15.86:0/1311484377 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1a4016b580 msgr2=0x7f1a4016b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:58.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.722+0000 7f1a45848640 1 --2- 172.21.15.86:0/1311484377 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1a4016b580 0x7f1a4016b960 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1a300096f0 tx=0x7f1a3001c3a0 comp rx=0 tx=0).stop 2024-04-25T12:21:58.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.722+0000 7f1a45848640 1 -- 172.21.15.86:0/1311484377 shutdown_connections 2024-04-25T12:21:58.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.722+0000 7f1a45848640 1 --2- 172.21.15.86:0/1311484377 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1a4016b580 0x7f1a4016b960 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:58.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.722+0000 7f1a45848640 1 -- 172.21.15.86:0/1311484377 >> 172.21.15.86:0/1311484377 conn(0x7f1a400c9050 msgr2=0x7f1a400c9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:58.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.722+0000 7faa961f3640 1 Processor -- start 2024-04-25T12:21:58.731 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.722+0000 7faa961f3640 1 -- start start 2024-04-25T12:21:58.731 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.722+0000 7f1a45848640 1 -- 172.21.15.86:0/1311484377 shutdown_connections 2024-04-25T12:21:58.731 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.722+0000 7f1a45848640 1 -- 172.21.15.86:0/1311484377 wait complete. 2024-04-25T12:21:58.731 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.722+0000 7fe5d2970640 1 Processor -- start 2024-04-25T12:21:58.731 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.722+0000 7faa961f3640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faa900c6690 0x7faa901416d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:58.732 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.722+0000 7faa961f3640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faa90160120 0x7faa90155750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:58.732 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.722+0000 7fe5d2970640 1 -- start start 2024-04-25T12:21:58.733 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.722+0000 7faa8effd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faa90160120 0x7faa90155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:58.733 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.722+0000 7faa8effd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faa90160120 0x7faa90155750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:59514/0 (socket says 172.21.15.86:59514) 2024-04-25T12:21:58.733 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.722+0000 7faa8effd640 1 -- 172.21.15.86:0/2611207858 learned_addr learned my addr 172.21.15.86:0/2611207858 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:58.733 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.722+0000 7faa961f3640 1 --2- 172.21.15.86:0/2611207858 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faa90154920 0x7faa90140760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:58.733 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.722+0000 7faa961f3640 1 -- 172.21.15.86:0/2611207858 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7faa9006f700 con 0x7faa90160120 2024-04-25T12:21:58.733 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.722+0000 7faa961f3640 1 -- 172.21.15.86:0/2611207858 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7faa90159d00 con 0x7faa90154920 2024-04-25T12:21:58.733 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.722+0000 7faa961f3640 1 -- 172.21.15.86:0/2611207858 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7faa9015ef30 con 0x7faa900c6690 2024-04-25T12:21:58.733 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.726+0000 7faa8ffff640 1 --2- 172.21.15.86:0/2611207858 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faa90154920 0x7faa90140760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:58.733 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.726+0000 7f1a45848640 1 Processor -- start 2024-04-25T12:21:58.734 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.726+0000 7faa8f7fe640 1 --2- 172.21.15.86:0/2611207858 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faa900c6690 0x7faa901416d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:58.734 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.726+0000 7faa8effd640 1 -- 172.21.15.86:0/2611207858 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faa900c6690 msgr2=0x7faa901416d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:58.734 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.726+0000 7faa8effd640 1 --2- 172.21.15.86:0/2611207858 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faa900c6690 0x7faa901416d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:58.734 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.726+0000 7faa8effd640 1 -- 172.21.15.86:0/2611207858 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faa90154920 msgr2=0x7faa90140760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:58.734 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.726+0000 7faa8effd640 1 --2- 172.21.15.86:0/2611207858 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faa90154920 0x7faa90140760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:58.734 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.726+0000 7faa8effd640 1 -- 172.21.15.86:0/2611207858 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa90155c90 con 0x7faa90160120 2024-04-25T12:21:58.734 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.726+0000 7fe5d2970640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe5c40d8e70 0x7fe5c40decb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:58.735 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.726+0000 7fe5d2970640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5c404eab0 con 0x7fe5c40e2bd0 2024-04-25T12:21:58.735 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.726+0000 7fe5d2970640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5c40dfc50 con 0x7fe5c404ed10 2024-04-25T12:21:58.735 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.726+0000 7fe5d2970640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fe5c4038470 con 0x7fe5c40d8e70 2024-04-25T12:21:58.735 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.726+0000 7f1a45848640 1 -- start start 2024-04-25T12:21:58.735 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.726+0000 7faa8effd640 1 --2- 172.21.15.86:0/2611207858 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faa90160120 0x7faa90155750 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7faa8000e870 tx=0x7faa8000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:58.735 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.726+0000 7fe5d196e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe5c40d8e70 0x7fe5c40decb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:58.736 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.726+0000 7fe5d196e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe5c40d8e70 0x7fe5c40decb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.86:43190/0 (socket says 172.21.15.86:43190) 2024-04-25T12:21:58.736 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.726+0000 7fe5d196e640 1 -- 172.21.15.86:0/934438957 learned_addr learned my addr 172.21.15.86:0/934438957 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:58.736 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.726+0000 7faa87fff640 1 -- 172.21.15.86:0/2611207858 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa80017070 con 0x7faa90160120 2024-04-25T12:21:58.737 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.726+0000 7f91118ba640 1 Processor -- start 2024-04-25T12:21:58.737 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.726+0000 7fe5d096c640 1 -- 172.21.15.86:0/934438957 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3964037549 0 0) 0x7fe5c40dfc50 con 0x7fe5c404ed10 2024-04-25T12:21:58.737 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.726+0000 7fe5d096c640 1 -- 172.21.15.86:0/934438957 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe5b8003530 con 0x7fe5c404ed10 2024-04-25T12:21:58.737 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.726+0000 7fe5d096c640 1 -- 172.21.15.86:0/934438957 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3032520383 0 0) 0x7fe5c8001050 con 0x7fe5c40e2bd0 2024-04-25T12:21:58.737 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.726+0000 7fe5d096c640 1 -- 172.21.15.86:0/934438957 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe5c40dfc50 con 0x7fe5c40e2bd0 2024-04-25T12:21:58.737 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.726+0000 7fe5d196e640 1 -- 172.21.15.86:0/934438957 >> v1:172.21.15.134:6789/0 conn(0x7fe5c404ed10 legacy=0x7fe5c40e9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:58.737 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.726+0000 7f1a45848640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1a400c3250 0x7f1a40160cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:58.737 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.726+0000 7f1a45848640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a400c9b70 0x7f1a40204070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:58.738 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.726+0000 7f1a45848640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1a4016b580 0x7f1a4008b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:58.738 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.726+0000 7f1a45848640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1a401657c0 con 0x7f1a4016b580 2024-04-25T12:21:58.738 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.726+0000 7f1a45848640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1a40165640 con 0x7f1a400c9b70 2024-04-25T12:21:58.738 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.726+0000 7f1a45848640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f1a40175e80 con 0x7f1a400c3250 2024-04-25T12:21:58.738 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.726+0000 7f1a3f7fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1a4016b580 0x7f1a4008b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:58.738 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.726+0000 7f1a3f7fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1a4016b580 0x7f1a4008b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:59530/0 (socket says 172.21.15.86:59530) 2024-04-25T12:21:58.738 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.726+0000 7f1a3f7fe640 1 -- 172.21.15.86:0/2114774292 learned_addr learned my addr 172.21.15.86:0/2114774292 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:58.738 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.726+0000 7f1a3f7fe640 1 -- 172.21.15.86:0/2114774292 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1a400c3250 msgr2=0x7f1a40160cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:58.738 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.726+0000 7f1a3f7fe640 1 --2- 172.21.15.86:0/2114774292 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1a400c3250 0x7f1a40160cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:58.738 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.726+0000 7f1a3f7fe640 1 -- 172.21.15.86:0/2114774292 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a400c9b70 msgr2=0x7f1a40204070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:58.738 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.726+0000 7f1a3f7fe640 1 --2- 172.21.15.86:0/2114774292 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a400c9b70 0x7f1a40204070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:58.738 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.726+0000 7f1a3f7fe640 1 -- 172.21.15.86:0/2114774292 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a40168b60 con 0x7f1a4016b580 2024-04-25T12:21:58.738 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.726+0000 7f1a3f7fe640 1 --2- 172.21.15.86:0/2114774292 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1a4016b580 0x7f1a4008b7c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1a3400c390 tx=0x7f1a3400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:58.738 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.726+0000 7f1a27fff640 1 -- 172.21.15.86:0/2114774292 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a34011790 con 0x7f1a4016b580 2024-04-25T12:21:58.738 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.726+0000 7f1a27fff640 1 -- 172.21.15.86:0/2114774292 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a34017070 con 0x7f1a4016b580 2024-04-25T12:21:58.739 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.726+0000 7f1a27fff640 1 -- 172.21.15.86:0/2114774292 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a34011b70 con 0x7f1a4016b580 2024-04-25T12:21:58.739 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.726+0000 7f91118ba640 1 -- start start 2024-04-25T12:21:58.739 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.726+0000 7f91118ba640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f910c0c5aa0 0x7f910c0c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:58.739 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.726+0000 7f91118ba640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f910c15b580 con 0x7f910c0c39e0 2024-04-25T12:21:58.739 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.726+0000 7f91118ba640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f910c06c940 con 0x7f910c151490 2024-04-25T12:21:58.739 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.726+0000 7f91118ba640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f910c06c710 con 0x7f910c0c5aa0 2024-04-25T12:21:58.739 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.726+0000 7f910affd640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f910c151490 0x7f910c15a760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.86:59482/0 (socket says 172.21.15.86:59482) 2024-04-25T12:21:58.739 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.726+0000 7f910affd640 1 -- 172.21.15.86:0/1206760903 learned_addr learned my addr 172.21.15.86:0/1206760903 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-04-25T12:21:58.739 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.726+0000 7f910b7fe640 1 --2- 172.21.15.86:0/1206760903 >> v2:172.21.15.134:3300/0 conn(0x7f910c0c5aa0 0x7f910c0c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:58.739 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.726+0000 7f9109ffb640 1 -- 172.21.15.86:0/1206760903 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2532798568 0 0) 0x7f910c06c940 con 0x7f910c151490 2024-04-25T12:21:58.740 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.726+0000 7f9109ffb640 1 -- 172.21.15.86:0/1206760903 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f90f4003450 con 0x7f910c151490 2024-04-25T12:21:58.740 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.726+0000 7faa87fff640 1 -- 172.21.15.86:0/2611207858 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa8000c940 con 0x7faa90160120 2024-04-25T12:21:58.740 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.726+0000 7faa961f3640 1 -- 172.21.15.86:0/2611207858 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa90144960 con 0x7faa90160120 2024-04-25T12:21:58.740 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.726+0000 7faa961f3640 1 -- 172.21.15.86:0/2611207858 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa900ca660 con 0x7faa90160120 2024-04-25T12:21:58.740 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.726+0000 7faa961f3640 1 -- 172.21.15.86:0/2611207858 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa90075df0 con 0x7faa90160120 2024-04-25T12:21:58.740 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.726+0000 7f976b19a640 1 Processor -- start 2024-04-25T12:21:58.740 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.726+0000 7f976b19a640 1 -- start start 2024-04-25T12:21:58.741 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.726+0000 7f9109ffb640 1 -- 172.21.15.86:0/1206760903 <== mon.1 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2831924476 0 0) 0x7f90f4003450 con 0x7f910c151490 2024-04-25T12:21:58.741 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.726+0000 7f9109ffb640 1 -- 172.21.15.86:0/1206760903 >> v2:172.21.15.134:3300/0 conn(0x7f910c0c5aa0 msgr2=0x7f910c0c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:58.741 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.726+0000 7f9109ffb640 1 --2- 172.21.15.86:0/1206760903 >> v2:172.21.15.134:3300/0 conn(0x7f910c0c5aa0 0x7f910c0c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:58.741 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.726+0000 7f9109ffb640 1 -- 172.21.15.86:0/1206760903 >> v1:172.21.15.86:6789/0 conn(0x7f910c0c39e0 legacy=0x7f910c15ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:58.741 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.730+0000 7f9109ffb640 1 -- 172.21.15.86:0/1206760903 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f910c0c4ce0 con 0x7f910c151490 2024-04-25T12:21:58.741 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.730+0000 7f9109ffb640 1 -- 172.21.15.86:0/1206760903 <== mon.1 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1387950573 0 0) 0x7f9100004ce0 con 0x7f910c151490 2024-04-25T12:21:58.741 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.730+0000 7f9109ffb640 1 -- 172.21.15.86:0/1206760903 >> v1:172.21.15.134:6789/0 conn(0x7f910c151490 legacy=0x7f910c15a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:58.741 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.730+0000 7f9109ffb640 1 --2- 172.21.15.86:0/1206760903 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90f4003ab0 0x7f90f4003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:58.741 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.730+0000 7f9109ffb640 1 --2- 172.21.15.86:0/1206760903 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f90f4006650 0x7f90f4008ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:58.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.730+0000 7f9109ffb640 1 --2- 172.21.15.86:0/1206760903 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90f40092a0 0x7f90f4009750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:58.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.730+0000 7f9109ffb640 1 -- 172.21.15.86:0/1206760903 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f90f400a000 con 0x7f90f4003ab0 2024-04-25T12:21:58.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.730+0000 7f9109ffb640 1 -- 172.21.15.86:0/1206760903 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f90f400a1b0 con 0x7f90f40092a0 2024-04-25T12:21:58.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.730+0000 7f9109ffb640 1 -- 172.21.15.86:0/1206760903 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f90f400a3b0 con 0x7f90f4006650 2024-04-25T12:21:58.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.726+0000 7f1a45848640 1 -- 172.21.15.86:0/2114774292 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a40204ad0 con 0x7f1a4016b580 2024-04-25T12:21:58.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.726+0000 7f1a45848640 1 -- 172.21.15.86:0/2114774292 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a401630e0 con 0x7f1a4016b580 2024-04-25T12:21:58.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.730+0000 7f910a7fc640 1 --2- 172.21.15.86:0/1206760903 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f90f4006650 0x7f90f4008ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:58.743 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.730+0000 7f976b19a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f97641593e0 0x7f97640c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:58.743 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.730+0000 7f976b19a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f976406cdc0 0x7f9764073d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:58.743 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.730+0000 7f976b19a640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f976406d8e0 con 0x7f97640c36f0 2024-04-25T12:21:58.743 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.730+0000 7f976b19a640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f976406d320 con 0x7f97641593e0 2024-04-25T12:21:58.743 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.730+0000 7f976b19a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f976406d600 con 0x7f976406cdc0 2024-04-25T12:21:58.743 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.726+0000 7fe5d196e640 1 -- 172.21.15.86:0/934438957 >> v1:172.21.15.86:6789/0 conn(0x7fe5c40e2bd0 legacy=0x7fe5c404e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:58.743 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.726+0000 7fe5d196e640 1 -- 172.21.15.86:0/934438957 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5c40df3b0 con 0x7fe5c40d8e70 2024-04-25T12:21:58.744 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.730+0000 7f976a198640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f97641593e0 0x7f97640c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:58.744 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.730+0000 7f976a198640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f97641593e0 0x7f97640c87c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.86:55420/0 (socket says 172.21.15.86:55420) 2024-04-25T12:21:58.744 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.730+0000 7f976a198640 1 -- 172.21.15.86:0/4018644701 learned_addr learned my addr 172.21.15.86:0/4018644701 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:58.744 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.730+0000 7faa87fff640 1 -- 172.21.15.86:0/2611207858 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa8000ccf0 con 0x7faa90160120 2024-04-25T12:21:58.745 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.730+0000 7f9769997640 1 --2- 172.21.15.86:0/4018644701 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f976406cdc0 0x7f9764073d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:58.745 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.730+0000 7faa87fff640 1 -- 172.21.15.86:0/2611207858 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7faa8001a070 con 0x7faa90160120 2024-04-25T12:21:58.745 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.730+0000 7fe5d196e640 1 --2- 172.21.15.86:0/934438957 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe5c40d8e70 0x7fe5c40decb0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc009820 tx=0x7fe5bc01c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8bc44cfdda29ebd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:58.745 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.730+0000 7fe5d096c640 1 -- 172.21.15.86:0/934438957 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc0b0070 con 0x7fe5c40d8e70 2024-04-25T12:21:58.746 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.730+0000 7fe5d096c640 1 -- 172.21.15.86:0/934438957 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5bc0ab400 con 0x7fe5c40d8e70 2024-04-25T12:21:58.746 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.730+0000 7fe5d096c640 1 -- 172.21.15.86:0/934438957 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc050540 con 0x7fe5c40d8e70 2024-04-25T12:21:58.746 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.730+0000 7fe5d2970640 1 -- 172.21.15.86:0/934438957 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe5c40d8e70 msgr2=0x7fe5c40decb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:58.746 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.730+0000 7fe5d2970640 1 --2- 172.21.15.86:0/934438957 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe5c40d8e70 0x7fe5c40decb0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc009820 tx=0x7fe5bc01c3c0 comp rx=0 tx=0).stop 2024-04-25T12:21:58.746 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.730+0000 7fe5d2970640 1 -- 172.21.15.86:0/934438957 shutdown_connections 2024-04-25T12:21:58.746 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.730+0000 7fe5d2970640 1 --2- 172.21.15.86:0/934438957 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe5c40d8e70 0x7fe5c40decb0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:58.746 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.730+0000 7fe5d2970640 1 -- 172.21.15.86:0/934438957 >> 172.21.15.86:0/934438957 conn(0x7fe5c400e0d0 msgr2=0x7fe5c400e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:58.746 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.730+0000 7fe5d2970640 1 -- 172.21.15.86:0/934438957 shutdown_connections 2024-04-25T12:21:58.746 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.730+0000 7f910b7fe640 1 --2- 172.21.15.86:0/1206760903 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90f40092a0 0x7f90f4009750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:58.746 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.730+0000 7f910a7fc640 1 -- 172.21.15.86:0/1206760903 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90f40092a0 msgr2=0x7f90f4009750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:58.746 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.730+0000 7f910a7fc640 1 --2- 172.21.15.86:0/1206760903 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90f40092a0 0x7f90f4009750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:58.747 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.730+0000 7f910a7fc640 1 -- 172.21.15.86:0/1206760903 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90f4003ab0 msgr2=0x7f90f4003eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:58.747 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.730+0000 7f910a7fc640 1 --2- 172.21.15.86:0/1206760903 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90f4003ab0 0x7f90f4003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:58.747 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.730+0000 7f910a7fc640 1 -- 172.21.15.86:0/1206760903 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f910c0c4ce0 con 0x7f90f4006650 2024-04-25T12:21:58.747 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.730+0000 7f910b7fe640 1 -- 172.21.15.86:0/1206760903 reap_dead start 2024-04-25T12:21:58.747 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.730+0000 7faa87fff640 1 --2- 172.21.15.86:0/2611207858 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7faa70068480 0x7faa7006a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:58.747 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.730+0000 7faa87fff640 1 -- 172.21.15.86:0/2611207858 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7faa80086c50 con 0x7faa90160120 2024-04-25T12:21:58.748 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.730+0000 7fe5d2970640 1 -- 172.21.15.86:0/934438957 wait complete. 2024-04-25T12:21:58.748 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.734+0000 7fe5d2970640 1 Processor -- start 2024-04-25T12:21:58.748 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.730+0000 7f976a198640 1 -- 172.21.15.86:0/4018644701 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f976406cdc0 msgr2=0x7f9764073d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:58.748 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.730+0000 7f976a198640 1 --2- 172.21.15.86:0/4018644701 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f976406cdc0 0x7f9764073d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:58.748 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.730+0000 7f976a198640 1 -- 172.21.15.86:0/4018644701 >> v1:172.21.15.86:6789/0 conn(0x7f97640c36f0 legacy=0x7f976406baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:58.748 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.730+0000 7f976a198640 1 -- 172.21.15.86:0/4018644701 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97640c7ce0 con 0x7f97641593e0 2024-04-25T12:21:58.748 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.730+0000 7f1a45848640 1 -- 172.21.15.86:0/2114774292 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a200052a0 con 0x7f1a4016b580 2024-04-25T12:21:58.749 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.734+0000 7f1a27fff640 1 -- 172.21.15.86:0/2114774292 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1a34011d10 con 0x7f1a4016b580 2024-04-25T12:21:58.749 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.734+0000 7f55cda63640 1 Processor -- start 2024-04-25T12:21:58.749 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.734+0000 7faa8f7fe640 1 --2- 172.21.15.86:0/2611207858 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7faa70068480 0x7faa7006a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:58.749 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.734+0000 7f976a198640 1 --2- 172.21.15.86:0/4018644701 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97641593e0 0x7f97640c87c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9760009870 tx=0x7f976001ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5eb7734dc109a64d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:58.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.734+0000 7f9769196640 1 -- 172.21.15.86:0/4018644701 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97600b5070 con 0x7f97641593e0 2024-04-25T12:21:58.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.734+0000 7f9769196640 1 -- 172.21.15.86:0/4018644701 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97600a89d0 con 0x7f97641593e0 2024-04-25T12:21:58.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.734+0000 7f9769196640 1 -- 172.21.15.86:0/4018644701 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97600a8da0 con 0x7f97641593e0 2024-04-25T12:21:58.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.734+0000 7f1a27fff640 1 --2- 172.21.15.86:0/2114774292 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f1a2c068480 0x7f1a2c06a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:58.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.734+0000 7fe5d2970640 1 -- start start 2024-04-25T12:21:58.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.734+0000 7fe5d2970640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5c404ed10 0x7fe5c40d6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:58.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.734+0000 7fe5d2970640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe5c40d8e70 0x7fe5c40085b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:58.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.734+0000 7fe5d2970640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe5c40e2bd0 0x7fe5c40d3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:58.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.734+0000 7fe5d2970640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c40d9250 con 0x7fe5c40d8e70 2024-04-25T12:21:58.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.734+0000 7faa8f7fe640 1 --2- 172.21.15.86:0/2611207858 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7faa70068480 0x7faa7006a940 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7faa780ae000 tx=0x7faa780b3040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:58.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.734+0000 7fe5d2970640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c40e26b0 con 0x7fe5c404ed10 2024-04-25T12:21:58.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.734+0000 7fe5d2970640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fe5c40d93d0 con 0x7fe5c40e2bd0 2024-04-25T12:21:58.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.734+0000 7fe5d116d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe5c40d8e70 0x7fe5c40085b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:58.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.734+0000 7fe5d116d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe5c40d8e70 0x7fe5c40085b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:59554/0 (socket says 172.21.15.86:59554) 2024-04-25T12:21:58.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.734+0000 7fe5d116d640 1 -- 172.21.15.86:0/853730395 learned_addr learned my addr 172.21.15.86:0/853730395 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:58.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.734+0000 7f1a27fff640 1 -- 172.21.15.86:0/2114774292 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f1a34086ab0 con 0x7f1a4016b580 2024-04-25T12:21:58.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.734+0000 7f55cda63640 1 -- start start 2024-04-25T12:21:58.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.734+0000 7f1a3effd640 1 --2- 172.21.15.86:0/2114774292 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f1a2c068480 0x7f1a2c06a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:58.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.734+0000 7f910a7fc640 1 --2- 172.21.15.86:0/1206760903 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f90f4006650 0x7f90f4008ae0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9104001d50 tx=0x7f910401c660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7059ece47e39230a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:58.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.734+0000 7fe5d216f640 1 --2- 172.21.15.86:0/853730395 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe5c40e2bd0 0x7fe5c40d3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:58.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.734+0000 7fe5d116d640 1 -- 172.21.15.86:0/853730395 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe5c40e2bd0 msgr2=0x7fe5c40d3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:58.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.734+0000 7fe5d116d640 1 --2- 172.21.15.86:0/853730395 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe5c40e2bd0 0x7fe5c40d3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:58.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.734+0000 7fe5d116d640 1 -- 172.21.15.86:0/853730395 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5c404ed10 msgr2=0x7fe5c40d6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:58.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.734+0000 7fe5d116d640 1 --2- 172.21.15.86:0/853730395 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5c404ed10 0x7fe5c40d6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:58.754 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.734+0000 7fe5d116d640 1 -- 172.21.15.86:0/853730395 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5c4007d20 con 0x7fe5c40d8e70 2024-04-25T12:21:58.754 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.734+0000 7f1a3effd640 1 --2- 172.21.15.86:0/2114774292 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f1a2c068480 0x7f1a2c06a940 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1a40168ec0 tx=0x7f1a30004740 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:58.754 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.734+0000 7f9109ffb640 1 -- 172.21.15.86:0/1206760903 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9104001950 con 0x7f90f4006650 2024-04-25T12:21:58.754 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.734+0000 7f9109ffb640 1 -- 172.21.15.86:0/1206760903 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9104003ba0 con 0x7f90f4006650 2024-04-25T12:21:58.754 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.734+0000 7f9109ffb640 1 -- 172.21.15.86:0/1206760903 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9104005070 con 0x7f90f4006650 2024-04-25T12:21:58.755 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.734+0000 7fe5d116d640 1 --2- 172.21.15.86:0/853730395 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe5c40d8e70 0x7fe5c40085b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe5c800c430 tx=0x7fe5c800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:58.755 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.734+0000 7f55cda63640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f55c806f700 0x7f55c80c5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:58.755 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.734+0000 7f976b19a640 1 -- 172.21.15.86:0/4018644701 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97641593e0 msgr2=0x7f97640c87c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:58.756 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.734+0000 7f976b19a640 1 --2- 172.21.15.86:0/4018644701 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97641593e0 0x7f97640c87c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9760009870 tx=0x7f976001ed30 comp rx=0 tx=0).stop 2024-04-25T12:21:58.756 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.734+0000 7f976b19a640 1 -- 172.21.15.86:0/4018644701 shutdown_connections 2024-04-25T12:21:58.756 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.734+0000 7f976b19a640 1 --2- 172.21.15.86:0/4018644701 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f976406cdc0 0x7f9764073d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:58.756 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.734+0000 7f976b19a640 1 --2- 172.21.15.86:0/4018644701 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97641593e0 0x7f97640c87c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:58.756 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.734+0000 7f976b19a640 1 -- 172.21.15.86:0/4018644701 >> 172.21.15.86:0/4018644701 conn(0x7f976406e0d0 msgr2=0x7f976406e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:58.757 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.734+0000 7f55cda63640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f55c8151490 0x7f55c80c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:58.757 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.734+0000 7f55c6ffd640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f55c80c39e0 0x7f55c815a760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:40964/0 (socket says 172.21.15.86:40964) 2024-04-25T12:21:58.757 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.734+0000 7f55c6ffd640 1 -- 172.21.15.86:0/2227801759 learned_addr learned my addr 172.21.15.86:0/2227801759 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-04-25T12:21:58.757 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.734+0000 7f55cda63640 1 -- 172.21.15.86:0/2227801759 --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55c806c940 con 0x7f55c80c39e0 2024-04-25T12:21:58.757 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.734+0000 7f55cda63640 1 -- 172.21.15.86:0/2227801759 --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f55c806c710 con 0x7f55c8151490 2024-04-25T12:21:58.757 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.734+0000 7f55cda63640 1 -- 172.21.15.86:0/2227801759 --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f55c80c5610 con 0x7f55c806f700 2024-04-25T12:21:58.757 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.734+0000 7f55c7fff640 1 --2- 172.21.15.86:0/2227801759 >> v2:172.21.15.86:3300/0 conn(0x7f55c8151490 0x7f55c80c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:58.757 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.734+0000 7f55c77fe640 1 --2- 172.21.15.86:0/2227801759 >> v2:172.21.15.134:3300/0 conn(0x7f55c806f700 0x7f55c80c5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:58.757 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.734+0000 7f55c7fff640 1 -- 172.21.15.86:0/2227801759 >> v2:172.21.15.134:3300/0 conn(0x7f55c806f700 msgr2=0x7f55c80c5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:58.757 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.734+0000 7f55c7fff640 1 --2- 172.21.15.86:0/2227801759 >> v2:172.21.15.134:3300/0 conn(0x7f55c806f700 0x7f55c80c5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:58.757 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.734+0000 7f55c7fff640 1 -- 172.21.15.86:0/2227801759 >> v1:172.21.15.86:6789/0 conn(0x7f55c80c39e0 legacy=0x7f55c815a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:58.757 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.734+0000 7f55c7fff640 1 -- 172.21.15.86:0/2227801759 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55c80c4ce0 con 0x7f55c8151490 2024-04-25T12:21:58.758 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.734+0000 7f91118ba640 1 -- 172.21.15.86:0/1206760903 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f90f4006650 msgr2=0x7f90f4008ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:58.758 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.734+0000 7f91118ba640 1 --2- 172.21.15.86:0/1206760903 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f90f4006650 0x7f90f4008ae0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9104001d50 tx=0x7f910401c660 comp rx=0 tx=0).stop 2024-04-25T12:21:58.758 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.734+0000 7f91118ba640 1 -- 172.21.15.86:0/1206760903 shutdown_connections 2024-04-25T12:21:58.758 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.734+0000 7f91118ba640 1 --2- 172.21.15.86:0/1206760903 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f90f4006650 0x7f90f4008ae0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:58.758 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.734+0000 7f91118ba640 1 -- 172.21.15.86:0/1206760903 >> 172.21.15.86:0/1206760903 conn(0x7f910c06b9d0 msgr2=0x7f910c06bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:58.758 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.734+0000 7f91118ba640 1 -- 172.21.15.86:0/1206760903 shutdown_connections 2024-04-25T12:21:58.759 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.734+0000 7f91118ba640 1 -- 172.21.15.86:0/1206760903 wait complete. 2024-04-25T12:21:58.759 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.738+0000 7f91118ba640 1 Processor -- start 2024-04-25T12:21:58.759 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.738+0000 7f91118ba640 1 -- start start 2024-04-25T12:21:58.759 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.738+0000 7f55c7fff640 1 --2- 172.21.15.86:0/2227801759 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f55c8151490 0x7f55c80c6ee0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f55c8070da0 tx=0x7f55bc01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c0741d370c8f219 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:58.760 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.738+0000 7f91118ba640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90f4006650 0x7f910c146e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:58.760 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.738+0000 7f91118ba640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f910c140120 0x7f910c1ef860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:58.760 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.738+0000 7f91118ba640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f910c1efda0 0x7f910c1456a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:58.760 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.738+0000 7f91118ba640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f910c151870 con 0x7f90f4006650 2024-04-25T12:21:58.760 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.738+0000 7f91118ba640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f910c0c72f0 con 0x7f910c140120 2024-04-25T12:21:58.760 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.738+0000 7f91118ba640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f910c0681d0 con 0x7f910c1efda0 2024-04-25T12:21:58.760 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.738+0000 7f910affd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90f4006650 0x7f910c146e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:58.760 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.738+0000 7f910affd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90f4006650 0x7f910c146e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:59564/0 (socket says 172.21.15.86:59564) 2024-04-25T12:21:58.760 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.738+0000 7f910affd640 1 -- 172.21.15.86:0/837630955 learned_addr learned my addr 172.21.15.86:0/837630955 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:58.760 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.738+0000 7f910a7fc640 1 --2- 172.21.15.86:0/837630955 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f910c140120 0x7f910c1ef860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:58.760 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.738+0000 7f910b7fe640 1 --2- 172.21.15.86:0/837630955 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f910c1efda0 0x7f910c1456a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:58.761 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.738+0000 7f910affd640 1 -- 172.21.15.86:0/837630955 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f910c1efda0 msgr2=0x7f910c1456a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:58.761 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.738+0000 7f910affd640 1 --2- 172.21.15.86:0/837630955 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f910c1efda0 0x7f910c1456a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:58.761 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.738+0000 7f910affd640 1 -- 172.21.15.86:0/837630955 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f910c140120 msgr2=0x7f910c1ef860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:58.761 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.738+0000 7f910affd640 1 --2- 172.21.15.86:0/837630955 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f910c140120 0x7f910c1ef860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:58.761 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.738+0000 7f910affd640 1 -- 172.21.15.86:0/837630955 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f910c149c50 con 0x7f90f4006650 2024-04-25T12:21:58.761 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.738+0000 7f910affd640 1 --2- 172.21.15.86:0/837630955 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90f4006650 0x7f910c146e00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f910000d860 tx=0x7f910000dd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:58.761 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.738+0000 7f976b19a640 1 -- 172.21.15.86:0/4018644701 shutdown_connections 2024-04-25T12:21:58.761 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.738+0000 7f976b19a640 1 -- 172.21.15.86:0/4018644701 wait complete. 2024-04-25T12:21:58.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.738+0000 7faa87fff640 1 -- 172.21.15.86:0/2611207858 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7faa80056860 con 0x7faa90160120 2024-04-25T12:21:58.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.742+0000 7f0b91c17640 1 Processor -- start 2024-04-25T12:21:58.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.742+0000 7f0b91c17640 1 -- start start 2024-04-25T12:21:58.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.742+0000 7f976b19a640 1 Processor -- start 2024-04-25T12:21:58.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.742+0000 7f0b91c17640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0b840d5c30 0x7f0b8404c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:58.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.742+0000 7f0b91c17640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0b84046a50 0x7f0b840df020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:58.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.742+0000 7f0b91c17640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b8404c9f0 con 0x7f0b8404d840 2024-04-25T12:21:58.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.742+0000 7f0b8bfff640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f0b8404d840 0x7f0b84046340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:40972/0 (socket says 172.21.15.86:40972) 2024-04-25T12:21:58.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.742+0000 7f0b8bfff640 1 -- 172.21.15.86:0/3534610830 learned_addr learned my addr 172.21.15.86:0/3534610830 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-04-25T12:21:58.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.742+0000 7f0b91c17640 1 -- 172.21.15.86:0/3534610830 --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f0b84008760 con 0x7f0b84046a50 2024-04-25T12:21:58.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.742+0000 7f0b91c17640 1 -- 172.21.15.86:0/3534610830 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f0b84008a40 con 0x7f0b840d5c30 2024-04-25T12:21:58.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.742+0000 7f976b19a640 1 -- start start 2024-04-25T12:21:58.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.742+0000 7f976b19a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f976406cdc0 0x7f97641539f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:58.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.742+0000 7f976b19a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f97640c36f0 0x7f976415e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:58.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.742+0000 7f976b19a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97641593e0 0x7f976415eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:58.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.742+0000 7f976b19a640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f97641597c0 con 0x7f976406cdc0 2024-04-25T12:21:58.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.742+0000 7f976b19a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f97640c82a0 con 0x7f97641593e0 2024-04-25T12:21:58.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.742+0000 7f976b19a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f9764159940 con 0x7f97640c36f0 2024-04-25T12:21:58.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.742+0000 7f0b91416640 1 --2- 172.21.15.86:0/3534610830 >> v2:172.21.15.134:3300/0 conn(0x7f0b84046a50 0x7f0b840df020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:58.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.742+0000 7f0b90c15640 1 --2- 172.21.15.86:0/3534610830 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0b840d5c30 0x7f0b8404c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:58.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.742+0000 7f976a198640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f976406cdc0 0x7f97641539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:58.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.742+0000 7f976a198640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f976406cdc0 0x7f97641539f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:59578/0 (socket says 172.21.15.86:59578) 2024-04-25T12:21:58.766 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.742+0000 7f976a198640 1 -- 172.21.15.86:0/3859523574 learned_addr learned my addr 172.21.15.86:0/3859523574 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:58.766 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.742+0000 7f0b91416640 1 -- 172.21.15.86:0/3534610830 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0b840d5c30 msgr2=0x7f0b8404c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:58.766 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.742+0000 7f9769997640 1 --2- 172.21.15.86:0/3859523574 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f97640c36f0 0x7f976415e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:58.767 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.742+0000 7f0b91416640 1 --2- 172.21.15.86:0/3534610830 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0b840d5c30 0x7f0b8404c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:58.767 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.742+0000 7f0b91416640 1 -- 172.21.15.86:0/3534610830 >> v1:172.21.15.86:6789/0 conn(0x7f0b8404d840 legacy=0x7f0b84046340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:58.767 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.742+0000 7f0b91416640 1 -- 172.21.15.86:0/3534610830 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b84008d20 con 0x7f0b84046a50 2024-04-25T12:21:58.767 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.742+0000 7f976a198640 1 -- 172.21.15.86:0/3859523574 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f97640c36f0 msgr2=0x7f976415e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:58.767 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.742+0000 7f976a198640 1 --2- 172.21.15.86:0/3859523574 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f97640c36f0 0x7f976415e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:58.767 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.742+0000 7f976a198640 1 -- 172.21.15.86:0/3859523574 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97641593e0 msgr2=0x7f976415eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:58.768 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.742+0000 7f976a198640 1 --2- 172.21.15.86:0/3859523574 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97641593e0 0x7f976415eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:58.768 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.742+0000 7f976a198640 1 -- 172.21.15.86:0/3859523574 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9764155e10 con 0x7f976406cdc0 2024-04-25T12:21:58.768 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.742+0000 7f9769997640 1 --2- 172.21.15.86:0/3859523574 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f97640c36f0 0x7f976415e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:21:58.768 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.742+0000 7f976a198640 1 --2- 172.21.15.86:0/3859523574 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f976406cdc0 0x7f97641539f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f97600b3040 tx=0x7f976001bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:58.770 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.742+0000 7f0b91416640 1 --2- 172.21.15.86:0/3534610830 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b84046a50 0x7f0b840df020 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c06ac00 tx=0x7f0b8c09b320 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7afb8f19c6f371e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:58.770 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.742+0000 7f0b8b7fe640 1 -- 172.21.15.86:0/3534610830 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b8c130070 con 0x7f0b84046a50 2024-04-25T12:21:58.770 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.746+0000 7f0b8b7fe640 1 -- 172.21.15.86:0/3534610830 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b8c12b640 con 0x7f0b84046a50 2024-04-25T12:21:58.770 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.746+0000 7f0b8b7fe640 1 -- 172.21.15.86:0/3534610830 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b8c12bab0 con 0x7f0b84046a50 2024-04-25T12:21:58.770 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.746+0000 7f0b91c17640 1 -- 172.21.15.86:0/3534610830 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b84046a50 msgr2=0x7f0b840df020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:58.770 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.746+0000 7f0b91c17640 1 --2- 172.21.15.86:0/3534610830 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b84046a50 0x7f0b840df020 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c06ac00 tx=0x7f0b8c09b320 comp rx=0 tx=0).stop 2024-04-25T12:21:58.770 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.746+0000 7f0b91c17640 1 -- 172.21.15.86:0/3534610830 shutdown_connections 2024-04-25T12:21:58.770 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.746+0000 7f0b91c17640 1 --2- 172.21.15.86:0/3534610830 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b84046a50 0x7f0b840df020 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:58.770 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.746+0000 7f0b91c17640 1 --2- 172.21.15.86:0/3534610830 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0b840d5c30 0x7f0b8404c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:58.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.746+0000 7f0b91c17640 1 -- 172.21.15.86:0/3534610830 >> 172.21.15.86:0/3534610830 conn(0x7f0b8404dd40 msgr2=0x7f0b8404e150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:58.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.746+0000 7f0b91c17640 1 -- 172.21.15.86:0/3534610830 shutdown_connections 2024-04-25T12:21:58.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.746+0000 7f0b91c17640 1 -- 172.21.15.86:0/3534610830 wait complete. 2024-04-25T12:21:58.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.746+0000 7f0b91c17640 1 Processor -- start 2024-04-25T12:21:58.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.746+0000 7f0b91c17640 1 -- start start 2024-04-25T12:21:58.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.746+0000 7f0b91c17640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b84046a50 0x7f0b84050820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:58.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.746+0000 7f0b91c17640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b8404d840 0x7f0b840488a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:58.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.746+0000 7f0b91c17640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0b840d5c30 0x7f0b840499d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:58.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.746+0000 7f0b91c17640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f0b840d6010 con 0x7f0b8404d840 2024-04-25T12:21:58.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.746+0000 7f0b91c17640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0b840092e0 con 0x7f0b84046a50 2024-04-25T12:21:58.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.746+0000 7f0b91c17640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f0b840d6190 con 0x7f0b840d5c30 2024-04-25T12:21:58.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.746+0000 7f0b8bfff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b8404d840 0x7f0b840488a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:58.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.746+0000 7f0b8bfff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b8404d840 0x7f0b840488a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:59584/0 (socket says 172.21.15.86:59584) 2024-04-25T12:21:58.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.746+0000 7f0b8bfff640 1 -- 172.21.15.86:0/4228266353 learned_addr learned my addr 172.21.15.86:0/4228266353 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:58.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.746+0000 7f0b91416640 1 --2- 172.21.15.86:0/4228266353 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0b840d5c30 0x7f0b840499d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:58.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.746+0000 7f0b8bfff640 1 -- 172.21.15.86:0/4228266353 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0b840d5c30 msgr2=0x7f0b840499d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:58.772 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.746+0000 7f0b8bfff640 1 --2- 172.21.15.86:0/4228266353 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0b840d5c30 0x7f0b840499d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:58.772 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.746+0000 7f0b8bfff640 1 -- 172.21.15.86:0/4228266353 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b84046a50 msgr2=0x7f0b84050820 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T12:21:58.772 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.746+0000 7f0b8bfff640 1 --2- 172.21.15.86:0/4228266353 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b84046a50 0x7f0b84050820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:58.772 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.746+0000 7f0b8bfff640 1 -- 172.21.15.86:0/4228266353 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b84049390 con 0x7f0b8404d840 2024-04-25T12:21:58.772 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.746+0000 7f0b91416640 1 --2- 172.21.15.86:0/4228266353 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0b840d5c30 0x7f0b840499d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:21:58.772 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.746+0000 7f0b8bfff640 1 --2- 172.21.15.86:0/4228266353 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b8404d840 0x7f0b840488a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0b7800c400 tx=0x7f0b7800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:58.772 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.750+0000 7fe5c27fc640 1 -- 172.21.15.86:0/853730395 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c8017070 con 0x7fe5c40d8e70 2024-04-25T12:21:58.772 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.750+0000 7fe5d2970640 1 -- 172.21.15.86:0/853730395 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5c40d4d90 con 0x7fe5c40d8e70 2024-04-25T12:21:58.772 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.750+0000 7fe5d2970640 1 -- 172.21.15.86:0/853730395 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5c40de950 con 0x7fe5c40d8e70 2024-04-25T12:21:58.772 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.750+0000 7fe5c27fc640 1 -- 172.21.15.86:0/853730395 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5c80052f0 con 0x7fe5c40d8e70 2024-04-25T12:21:58.773 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.750+0000 7fe5c27fc640 1 -- 172.21.15.86:0/853730395 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c8003840 con 0x7fe5c40d8e70 2024-04-25T12:21:58.773 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.750+0000 7f1a27fff640 1 -- 172.21.15.86:0/2114774292 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1a34056d10 con 0x7f1a4016b580 2024-04-25T12:21:58.773 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.750+0000 7f90f3fff640 1 -- 172.21.15.86:0/837630955 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f910000ba30 con 0x7f90f4006650 2024-04-25T12:21:58.773 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.750+0000 7f91118ba640 1 -- 172.21.15.86:0/837630955 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f910c159350 con 0x7f90f4006650 2024-04-25T12:21:58.773 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.750+0000 7f91118ba640 1 -- 172.21.15.86:0/837630955 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f910c1f3ac0 con 0x7f90f4006650 2024-04-25T12:21:58.773 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.750+0000 7f55c67fc640 1 -- 172.21.15.86:0/2227801759 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55bc0b0070 con 0x7f55c8151490 2024-04-25T12:21:58.774 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.750+0000 7f0b897fa640 1 -- 172.21.15.86:0/4228266353 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b78017070 con 0x7f0b8404d840 2024-04-25T12:21:58.774 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.750+0000 7f0b91c17640 1 -- 172.21.15.86:0/4228266353 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b8404f4c0 con 0x7f0b8404d840 2024-04-25T12:21:58.774 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.750+0000 7f0b91c17640 1 -- 172.21.15.86:0/4228266353 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b8404fa60 con 0x7f0b8404d840 2024-04-25T12:21:58.774 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.750+0000 7f975affd640 1 -- 172.21.15.86:0/3859523574 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97600c0070 con 0x7f976406cdc0 2024-04-25T12:21:58.774 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.750+0000 7f55c67fc640 1 -- 172.21.15.86:0/2227801759 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55bc0ab600 con 0x7f55c8151490 2024-04-25T12:21:58.775 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.750+0000 7f55c67fc640 1 -- 172.21.15.86:0/2227801759 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55bc0ab9d0 con 0x7f55c8151490 2024-04-25T12:21:58.775 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.750+0000 7f976b19a640 1 -- 172.21.15.86:0/3859523574 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97641560f0 con 0x7f976406cdc0 2024-04-25T12:21:58.775 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.750+0000 7f976b19a640 1 -- 172.21.15.86:0/3859523574 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97641566b0 con 0x7f976406cdc0 2024-04-25T12:21:58.775 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.750+0000 7f90f3fff640 1 -- 172.21.15.86:0/837630955 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f910000bbd0 con 0x7f90f4006650 2024-04-25T12:21:58.776 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.750+0000 7f55cda63640 1 -- 172.21.15.86:0/2227801759 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f55c8151490 msgr2=0x7f55c80c6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:58.776 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.750+0000 7f55cda63640 1 --2- 172.21.15.86:0/2227801759 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f55c8151490 0x7f55c80c6ee0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f55c8070da0 tx=0x7f55bc01c480 comp rx=0 tx=0).stop 2024-04-25T12:21:58.776 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.750+0000 7f55cda63640 1 -- 172.21.15.86:0/2227801759 shutdown_connections 2024-04-25T12:21:58.776 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.750+0000 7f55cda63640 1 --2- 172.21.15.86:0/2227801759 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f55c8151490 0x7f55c80c6ee0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:58.776 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.750+0000 7f55cda63640 1 --2- 172.21.15.86:0/2227801759 >> v2:172.21.15.134:3300/0 conn(0x7f55c806f700 0x7f55c80c5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:58.776 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.750+0000 7f55cda63640 1 -- 172.21.15.86:0/2227801759 >> 172.21.15.86:0/2227801759 conn(0x7f55c806b9d0 msgr2=0x7f55c806bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:58.776 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.750+0000 7f90f3fff640 1 -- 172.21.15.86:0/837630955 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9100014400 con 0x7f90f4006650 2024-04-25T12:21:58.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.754+0000 7f975affd640 1 -- 172.21.15.86:0/3859523574 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97600a89d0 con 0x7f976406cdc0 2024-04-25T12:21:58.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.754+0000 7f975affd640 1 -- 172.21.15.86:0/3859523574 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97600ca060 con 0x7f976406cdc0 2024-04-25T12:21:58.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.754+0000 7f0b897fa640 1 -- 172.21.15.86:0/4228266353 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b78005cf0 con 0x7f0b8404d840 2024-04-25T12:21:58.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.754+0000 7f0b897fa640 1 -- 172.21.15.86:0/4228266353 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b78021060 con 0x7f0b8404d840 2024-04-25T12:21:58.778 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.754+0000 7f976b19a640 1 -- 172.21.15.86:0/3859523574 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9764076440 con 0x7f976406cdc0 2024-04-25T12:21:58.778 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.754+0000 7fe5d2970640 1 -- 172.21.15.86:0/853730395 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5b40052a0 con 0x7fe5c40d8e70 2024-04-25T12:21:58.778 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.758+0000 7f55cda63640 1 -- 172.21.15.86:0/2227801759 shutdown_connections 2024-04-25T12:21:58.778 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.758+0000 7f55cda63640 1 -- 172.21.15.86:0/2227801759 wait complete. 2024-04-25T12:21:58.779 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.758+0000 7f0b76ffd640 1 -- 172.21.15.86:0/4228266353 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b6c0052a0 con 0x7f0b8404d840 2024-04-25T12:21:58.779 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.758+0000 7f90f3fff640 1 -- 172.21.15.86:0/837630955 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f910001b020 con 0x7f90f4006650 2024-04-25T12:21:58.779 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.758+0000 7f55cda63640 1 Processor -- start 2024-04-25T12:21:58.779 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.758+0000 7f90f3fff640 1 --2- 172.21.15.86:0/837630955 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f90f8068380 0x7f90f806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:58.780 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.758+0000 7f55cda63640 1 -- start start 2024-04-25T12:21:58.780 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.758+0000 7f910a7fc640 1 --2- 172.21.15.86:0/837630955 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f90f8068380 0x7f90f806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:58.780 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.758+0000 7f55cda63640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f55c806f700 0x7f55c8162080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:58.780 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.758+0000 7f55cda63640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f55c80c39e0 0x7f55c814cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:58.780 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.758+0000 7f55cda63640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55c8151490 0x7f55c814d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:58.780 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.758+0000 7f55cda63640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f55c806cc20 con 0x7f55c806f700 2024-04-25T12:21:58.780 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.758+0000 7f55cda63640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f55c80c7420 con 0x7f55c8151490 2024-04-25T12:21:58.781 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.758+0000 7f55cda63640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f55c80681d0 con 0x7f55c80c39e0 2024-04-25T12:21:58.781 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.758+0000 7f910a7fc640 1 --2- 172.21.15.86:0/837630955 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f90f8068380 0x7f90f806a840 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f91040ab000 tx=0x7f91040b0040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:58.781 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.758+0000 7f55c6ffd640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f55c80c39e0 0x7f55c814cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:58.782 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.758+0000 7f55c6ffd640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f55c80c39e0 0x7f55c814cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.86:43284/0 (socket says 172.21.15.86:43284) 2024-04-25T12:21:58.782 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.758+0000 7f55c6ffd640 1 -- 172.21.15.86:0/3498338477 learned_addr learned my addr 172.21.15.86:0/3498338477 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:58.782 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.758+0000 7f55c7fff640 1 --2- 172.21.15.86:0/3498338477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55c8151490 0x7f55c814d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:58.782 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.758+0000 7f55c7fff640 1 -- 172.21.15.86:0/3498338477 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f55c80c39e0 msgr2=0x7f55c814cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:58.782 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.758+0000 7f55c7fff640 1 --2- 172.21.15.86:0/3498338477 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f55c80c39e0 0x7f55c814cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:58.782 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.758+0000 7f55c7fff640 1 -- 172.21.15.86:0/3498338477 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f55c806f700 msgr2=0x7f55c8162080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:58.782 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.758+0000 7f55c7fff640 1 --2- 172.21.15.86:0/3498338477 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f55c806f700 0x7f55c8162080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:58.782 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.758+0000 7f55c7fff640 1 -- 172.21.15.86:0/3498338477 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55c81609d0 con 0x7f55c8151490 2024-04-25T12:21:58.782 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.758+0000 7f55c7fff640 1 --2- 172.21.15.86:0/3498338477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55c8151490 0x7f55c814d150 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f55bc0ab000 tx=0x7f55bc019220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:58.783 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.758+0000 7f0b897fa640 1 -- 172.21.15.86:0/4228266353 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0b7801a070 con 0x7f0b8404d840 2024-04-25T12:21:58.783 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.758+0000 7f0b897fa640 1 --2- 172.21.15.86:0/4228266353 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f0b70068380 0x7f0b7006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:58.783 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.762+0000 7f0b897fa640 1 -- 172.21.15.86:0/4228266353 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0b78086790 con 0x7f0b8404d840 2024-04-25T12:21:58.783 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.762+0000 7f0b90c15640 1 --2- 172.21.15.86:0/4228266353 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f0b70068380 0x7f0b7006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:58.783 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.762+0000 7f0b90c15640 1 --2- 172.21.15.86:0/4228266353 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f0b70068380 0x7f0b7006a840 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0b80009870 tx=0x7f0b80008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:58.784 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.762+0000 7f975affd640 1 -- 172.21.15.86:0/3859523574 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f97600c3070 con 0x7f976406cdc0 2024-04-25T12:21:58.784 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.762+0000 7f975affd640 1 --2- 172.21.15.86:0/3859523574 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f97480683b0 0x7f974806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:58.784 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.762+0000 7f975affd640 1 -- 172.21.15.86:0/3859523574 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f97601248b0 con 0x7f976406cdc0 2024-04-25T12:21:58.784 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.762+0000 7f9769997640 1 --2- 172.21.15.86:0/3859523574 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f97480683b0 0x7f974806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:58.784 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.762+0000 7f9769997640 1 --2- 172.21.15.86:0/3859523574 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f97480683b0 0x7f974806a870 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f976415fed0 tx=0x7f9754008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:58.784 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.762+0000 7fe5c27fc640 1 -- 172.21.15.86:0/853730395 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe5c801a070 con 0x7fe5c40d8e70 2024-04-25T12:21:58.784 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.762+0000 7f90f3fff640 1 -- 172.21.15.86:0/837630955 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f9100054670 con 0x7f90f4006650 2024-04-25T12:21:58.785 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.762+0000 7f91118ba640 1 -- 172.21.15.86:0/837630955 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90ec0052a0 con 0x7f90f4006650 2024-04-25T12:21:58.785 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.762+0000 7fe5c27fc640 1 --2- 172.21.15.86:0/853730395 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fe5b0068380 0x7fe5b006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:58.785 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.762+0000 7fe5d196e640 1 --2- 172.21.15.86:0/853730395 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fe5b0068380 0x7fe5b006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:58.785 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.762+0000 7fe5c27fc640 1 -- 172.21.15.86:0/853730395 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe5c8085f00 con 0x7fe5c40d8e70 2024-04-25T12:21:58.785 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.766+0000 7fe5d196e640 1 --2- 172.21.15.86:0/853730395 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fe5b0068380 0x7fe5b006a840 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc0ad000 tx=0x7fe5bc004740 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:58.786 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.766+0000 7f55affff640 1 -- 172.21.15.86:0/3498338477 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55bc0b0040 con 0x7f55c8151490 2024-04-25T12:21:58.786 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.766+0000 7f55affff640 1 -- 172.21.15.86:0/3498338477 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55bc0ba070 con 0x7f55c8151490 2024-04-25T12:21:58.786 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.766+0000 7f55cda63640 1 -- 172.21.15.86:0/3498338477 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55c8160cb0 con 0x7f55c8151490 2024-04-25T12:21:58.786 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.766+0000 7f55affff640 1 -- 172.21.15.86:0/3498338477 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55bc0b4650 con 0x7f55c8151490 2024-04-25T12:21:58.786 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.766+0000 7f55cda63640 1 -- 172.21.15.86:0/3498338477 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55c80718b0 con 0x7f55c8151490 2024-04-25T12:21:58.786 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.766+0000 7f55cda63640 1 -- 172.21.15.86:0/3498338477 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55c8075df0 con 0x7f55c8151490 2024-04-25T12:21:58.786 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.766+0000 7f975affd640 1 -- 172.21.15.86:0/3859523574 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9760018890 con 0x7f976406cdc0 2024-04-25T12:21:58.787 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.770+0000 7f55affff640 1 -- 172.21.15.86:0/3498338477 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f55bc0b47f0 con 0x7f55c8151490 2024-04-25T12:21:58.787 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.770+0000 7f55affff640 1 --2- 172.21.15.86:0/3498338477 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f55b4068480 0x7f55b406a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:58.787 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.770+0000 7f55affff640 1 -- 172.21.15.86:0/3498338477 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f55bc121330 con 0x7f55c8151490 2024-04-25T12:21:58.787 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.770+0000 7f55c77fe640 1 --2- 172.21.15.86:0/3498338477 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f55b4068480 0x7f55b406a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:58.787 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.770+0000 7f55c77fe640 1 --2- 172.21.15.86:0/3498338477 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f55b4068480 0x7f55b406a940 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f55c00070b0 tx=0x7f55c0007040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:58.788 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.774+0000 7f0b897fa640 1 -- 172.21.15.86:0/4228266353 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0b780563c0 con 0x7f0b8404d840 2024-04-25T12:21:58.788 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.774+0000 7f55affff640 1 -- 172.21.15.86:0/3498338477 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f55bc016070 con 0x7f55c8151490 2024-04-25T12:21:58.790 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.782+0000 7fe5c27fc640 1 -- 172.21.15.86:0/853730395 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe5c404eab0 con 0x7fe5c40d8e70 2024-04-25T12:21:58.799 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:58.794+0000 7f90f3fff640 1 -- 172.21.15.86:0/837630955 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9100056cd0 con 0x7f90f4006650 2024-04-25T12:21:59.033 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.026+0000 7f61d27f9640 1 -- 172.21.15.86:0/2050386631 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f61ac005860 con 0x7f61cc1512d0 2024-04-25T12:21:59.034 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.026+0000 7f61c8ff9640 1 -- 172.21.15.86:0/2050386631 <== mon.2 v2:172.21.15.134:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f61c40f0930 con 0x7f61cc1512d0 2024-04-25T12:21:59.034 INFO:teuthology.orchestra.run.smithi086.stdout:55834574862 2024-04-25T12:21:59.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.030+0000 7f61b27fc640 1 -- 172.21.15.86:0/2050386631 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f61b8068400 msgr2=0x7f61b806a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:59.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.030+0000 7f61b27fc640 1 --2- 172.21.15.86:0/2050386631 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f61b8068400 0x7f61b806a8c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f61c0010c00 tx=0x7f61c0012040 comp rx=0 tx=0).stop 2024-04-25T12:21:59.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.030+0000 7f61b27fc640 1 -- 172.21.15.86:0/2050386631 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61cc1512d0 msgr2=0x7f61cc143420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:59.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.030+0000 7f61b27fc640 1 --2- 172.21.15.86:0/2050386631 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61cc1512d0 0x7f61cc143420 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f61c401d4b0 tx=0x7f61c401bba0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.030+0000 7f61b27fc640 1 -- 172.21.15.86:0/2050386631 shutdown_connections 2024-04-25T12:21:59.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.030+0000 7f61b27fc640 1 --2- 172.21.15.86:0/2050386631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61cc157100 0x7f61cc143960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.030+0000 7f61b27fc640 1 --2- 172.21.15.86:0/2050386631 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61cc1512d0 0x7f61cc143420 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.030+0000 7f61b27fc640 1 --2- 172.21.15.86:0/2050386631 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f61b8068400 0x7f61b806a8c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.030+0000 7f61b27fc640 1 --2- 172.21.15.86:0/2050386631 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61cc072a50 0x7f61cc145ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.030+0000 7f61b27fc640 1 -- 172.21.15.86:0/2050386631 >> 172.21.15.86:0/2050386631 conn(0x7f61cc0c9050 msgr2=0x7f61cc070f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:59.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.030+0000 7f61b27fc640 1 -- 172.21.15.86:0/2050386631 shutdown_connections 2024-04-25T12:21:59.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.030+0000 7f61b27fc640 1 -- 172.21.15.86:0/2050386631 wait complete. 2024-04-25T12:21:59.059 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574862 got 55834574862 for osd.0 2024-04-25T12:21:59.059 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.050+0000 7faa961f3640 1 -- 172.21.15.86:0/2611207858 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7faa90149dc0 con 0x7faa90160120 2024-04-25T12:21:59.059 DEBUG:teuthology.parallel:result is None 2024-04-25T12:21:59.060 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.054+0000 7faa87fff640 1 -- 172.21.15.86:0/2611207858 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7faa8005ab60 con 0x7faa90160120 2024-04-25T12:21:59.060 INFO:teuthology.orchestra.run.smithi086.stdout:55834574861 2024-04-25T12:21:59.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.054+0000 7faa961f3640 1 -- 172.21.15.86:0/2611207858 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7faa70068480 msgr2=0x7faa7006a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:59.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.054+0000 7faa961f3640 1 --2- 172.21.15.86:0/2611207858 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7faa70068480 0x7faa7006a940 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7faa780ae000 tx=0x7faa780b3040 comp rx=0 tx=0).stop 2024-04-25T12:21:59.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.054+0000 7faa961f3640 1 -- 172.21.15.86:0/2611207858 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faa90160120 msgr2=0x7faa90155750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:59.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.054+0000 7faa961f3640 1 --2- 172.21.15.86:0/2611207858 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faa90160120 0x7faa90155750 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7faa8000e870 tx=0x7faa8000ec70 comp rx=0 tx=0).stop 2024-04-25T12:21:59.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.058+0000 7faa961f3640 1 -- 172.21.15.86:0/2611207858 shutdown_connections 2024-04-25T12:21:59.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.058+0000 7faa961f3640 1 --2- 172.21.15.86:0/2611207858 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faa90154920 0x7faa90140760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.058+0000 7faa961f3640 1 --2- 172.21.15.86:0/2611207858 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7faa70068480 0x7faa7006a940 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.058+0000 7faa961f3640 1 --2- 172.21.15.86:0/2611207858 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faa90160120 0x7faa90155750 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.058+0000 7faa961f3640 1 --2- 172.21.15.86:0/2611207858 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faa900c6690 0x7faa901416d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.063 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.058+0000 7faa961f3640 1 -- 172.21.15.86:0/2611207858 >> 172.21.15.86:0/2611207858 conn(0x7faa9006b9d0 msgr2=0x7faa900c8660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:59.064 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.058+0000 7faa961f3640 1 -- 172.21.15.86:0/2611207858 shutdown_connections 2024-04-25T12:21:59.064 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.058+0000 7faa961f3640 1 -- 172.21.15.86:0/2611207858 wait complete. 2024-04-25T12:21:59.070 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.062+0000 7f1a45848640 1 -- 172.21.15.86:0/2114774292 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f1a20005590 con 0x7f1a4016b580 2024-04-25T12:21:59.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.066+0000 7f1a27fff640 1 -- 172.21.15.86:0/2114774292 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1a34056610 con 0x7f1a4016b580 2024-04-25T12:21:59.071 INFO:teuthology.orchestra.run.smithi086.stdout:55834574863 2024-04-25T12:21:59.075 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.066+0000 7f1a45848640 1 -- 172.21.15.86:0/2114774292 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f1a2c068480 msgr2=0x7f1a2c06a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:59.075 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.066+0000 7f1a45848640 1 --2- 172.21.15.86:0/2114774292 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f1a2c068480 0x7f1a2c06a940 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1a40168ec0 tx=0x7f1a30004740 comp rx=0 tx=0).stop 2024-04-25T12:21:59.075 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.066+0000 7f1a45848640 1 -- 172.21.15.86:0/2114774292 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1a4016b580 msgr2=0x7f1a4008b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:59.075 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.066+0000 7f1a45848640 1 --2- 172.21.15.86:0/2114774292 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1a4016b580 0x7f1a4008b7c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1a3400c390 tx=0x7f1a3400c850 comp rx=0 tx=0).stop 2024-04-25T12:21:59.075 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.070+0000 7f1a45848640 1 -- 172.21.15.86:0/2114774292 shutdown_connections 2024-04-25T12:21:59.075 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.070+0000 7f1a45848640 1 --2- 172.21.15.86:0/2114774292 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f1a2c068480 0x7f1a2c06a940 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.076 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.070+0000 7f1a45848640 1 --2- 172.21.15.86:0/2114774292 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1a4016b580 0x7f1a4008b7c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.076 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.070+0000 7f1a45848640 1 --2- 172.21.15.86:0/2114774292 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a400c9b70 0x7f1a40204070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.076 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.070+0000 7f1a45848640 1 --2- 172.21.15.86:0/2114774292 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1a400c3250 0x7f1a40160cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.076 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.070+0000 7f1a45848640 1 -- 172.21.15.86:0/2114774292 >> 172.21.15.86:0/2114774292 conn(0x7f1a400c9050 msgr2=0x7f1a400c7610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:59.076 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.070+0000 7f1a45848640 1 -- 172.21.15.86:0/2114774292 shutdown_connections 2024-04-25T12:21:59.076 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.070+0000 7f1a45848640 1 -- 172.21.15.86:0/2114774292 wait complete. 2024-04-25T12:21:59.085 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574861 got 55834574861 for osd.1 2024-04-25T12:21:59.085 DEBUG:teuthology.parallel:result is None 2024-04-25T12:21:59.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.082+0000 7fe5d2970640 1 -- 172.21.15.86:0/853730395 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fe5b4005860 con 0x7fe5c40d8e70 2024-04-25T12:21:59.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.082+0000 7fe5c27fc640 1 -- 172.21.15.86:0/853730395 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe5c8055bc0 con 0x7fe5c40d8e70 2024-04-25T12:21:59.089 INFO:teuthology.orchestra.run.smithi086.stdout:55834574862 2024-04-25T12:21:59.091 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.086+0000 7fe5d2970640 1 -- 172.21.15.86:0/853730395 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fe5b0068380 msgr2=0x7fe5b006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:59.091 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.086+0000 7fe5d2970640 1 --2- 172.21.15.86:0/853730395 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fe5b0068380 0x7fe5b006a840 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc0ad000 tx=0x7fe5bc004740 comp rx=0 tx=0).stop 2024-04-25T12:21:59.091 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.086+0000 7fe5d2970640 1 -- 172.21.15.86:0/853730395 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe5c40d8e70 msgr2=0x7fe5c40085b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:59.092 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.086+0000 7fe5d2970640 1 --2- 172.21.15.86:0/853730395 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe5c40d8e70 0x7fe5c40085b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe5c800c430 tx=0x7fe5c800c8f0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.092 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.086+0000 7fe5d2970640 1 -- 172.21.15.86:0/853730395 shutdown_connections 2024-04-25T12:21:59.092 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.086+0000 7fe5d2970640 1 --2- 172.21.15.86:0/853730395 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe5c40e2bd0 0x7fe5c40d3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.092 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.086+0000 7fe5d2970640 1 --2- 172.21.15.86:0/853730395 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fe5b0068380 0x7fe5b006a840 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.092 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.086+0000 7fe5d2970640 1 --2- 172.21.15.86:0/853730395 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe5c40d8e70 0x7fe5c40085b0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.092 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.086+0000 7fe5d2970640 1 --2- 172.21.15.86:0/853730395 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5c404ed10 0x7fe5c40d6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.092 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.086+0000 7fe5d2970640 1 -- 172.21.15.86:0/853730395 >> 172.21.15.86:0/853730395 conn(0x7fe5c400e0d0 msgr2=0x7fe5c40e17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:59.092 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.086+0000 7fe5d2970640 1 -- 172.21.15.86:0/853730395 shutdown_connections 2024-04-25T12:21:59.092 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.086+0000 7fe5d2970640 1 -- 172.21.15.86:0/853730395 wait complete. 2024-04-25T12:21:59.096 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574863 got 55834574863 for osd.3 2024-04-25T12:21:59.096 DEBUG:teuthology.parallel:result is None 2024-04-25T12:21:59.102 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.094+0000 7f976b19a640 1 -- 172.21.15.86:0/3859523574 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f976406c650 con 0x7f976406cdc0 2024-04-25T12:21:59.103 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.094+0000 7f975affd640 1 -- 172.21.15.86:0/3859523574 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9760122e20 con 0x7f976406cdc0 2024-04-25T12:21:59.103 INFO:teuthology.orchestra.run.smithi086.stdout:55834574862 2024-04-25T12:21:59.105 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.098+0000 7f0b76ffd640 1 -- 172.21.15.86:0/4228266353 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f0b6c005860 con 0x7f0b8404d840 2024-04-25T12:21:59.105 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.098+0000 7f55cda63640 1 -- 172.21.15.86:0/3498338477 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f55c8161450 con 0x7f55c8151490 2024-04-25T12:21:59.106 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.098+0000 7f0b897fa640 1 -- 172.21.15.86:0/4228266353 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0b7805a6c0 con 0x7f0b8404d840 2024-04-25T12:21:59.106 INFO:teuthology.orchestra.run.smithi086.stdout:55834574862 2024-04-25T12:21:59.106 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.098+0000 7f976b19a640 1 -- 172.21.15.86:0/3859523574 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f97480683b0 msgr2=0x7f974806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:59.107 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.098+0000 7f976b19a640 1 --2- 172.21.15.86:0/3859523574 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f97480683b0 0x7f974806a870 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f976415fed0 tx=0x7f9754008040 comp rx=0 tx=0).stop 2024-04-25T12:21:59.107 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.098+0000 7f976b19a640 1 -- 172.21.15.86:0/3859523574 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f976406cdc0 msgr2=0x7f97641539f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:59.107 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.098+0000 7f976b19a640 1 --2- 172.21.15.86:0/3859523574 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f976406cdc0 0x7f97641539f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f97600b3040 tx=0x7f976001bad0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.107 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.098+0000 7f55affff640 1 -- 172.21.15.86:0/3498338477 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f55bc0f1620 con 0x7f55c8151490 2024-04-25T12:21:59.107 INFO:teuthology.orchestra.run.smithi086.stdout:55834574861 2024-04-25T12:21:59.108 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.098+0000 7f976b19a640 1 -- 172.21.15.86:0/3859523574 shutdown_connections 2024-04-25T12:21:59.108 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.098+0000 7f976b19a640 1 --2- 172.21.15.86:0/3859523574 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97641593e0 0x7f976415eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.108 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.098+0000 7f976b19a640 1 --2- 172.21.15.86:0/3859523574 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f97640c36f0 0x7f976415e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.108 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.098+0000 7f976b19a640 1 --2- 172.21.15.86:0/3859523574 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f97480683b0 0x7f974806a870 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.108 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.098+0000 7f976b19a640 1 --2- 172.21.15.86:0/3859523574 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f976406cdc0 0x7f97641539f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.108 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.098+0000 7f976b19a640 1 -- 172.21.15.86:0/3859523574 >> 172.21.15.86:0/3859523574 conn(0x7f976406e0d0 msgr2=0x7f9764154760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:59.108 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.102+0000 7f976b19a640 1 -- 172.21.15.86:0/3859523574 shutdown_connections 2024-04-25T12:21:59.108 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.102+0000 7f976b19a640 1 -- 172.21.15.86:0/3859523574 wait complete. 2024-04-25T12:21:59.109 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.102+0000 7f0b76ffd640 1 -- 172.21.15.86:0/4228266353 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f0b70068380 msgr2=0x7f0b7006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:59.109 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.102+0000 7f0b76ffd640 1 --2- 172.21.15.86:0/4228266353 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f0b70068380 0x7f0b7006a840 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0b80009870 tx=0x7f0b80008040 comp rx=0 tx=0).stop 2024-04-25T12:21:59.109 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.102+0000 7f0b76ffd640 1 -- 172.21.15.86:0/4228266353 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b8404d840 msgr2=0x7f0b840488a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:59.109 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.102+0000 7f0b76ffd640 1 --2- 172.21.15.86:0/4228266353 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b8404d840 0x7f0b840488a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0b7800c400 tx=0x7f0b7800c8c0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.110 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.102+0000 7f0b76ffd640 1 -- 172.21.15.86:0/4228266353 shutdown_connections 2024-04-25T12:21:59.110 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.102+0000 7f0b76ffd640 1 --2- 172.21.15.86:0/4228266353 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0b840d5c30 0x7f0b840499d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.110 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.102+0000 7f0b76ffd640 1 --2- 172.21.15.86:0/4228266353 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f0b70068380 0x7f0b7006a840 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.110 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.102+0000 7f0b76ffd640 1 --2- 172.21.15.86:0/4228266353 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b8404d840 0x7f0b840488a0 secure :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0b7800c400 tx=0x7f0b7800c8c0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.110 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.102+0000 7f0b76ffd640 1 --2- 172.21.15.86:0/4228266353 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b84046a50 0x7f0b84050820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.110 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.102+0000 7f0b76ffd640 1 -- 172.21.15.86:0/4228266353 >> 172.21.15.86:0/4228266353 conn(0x7f0b8404dd40 msgr2=0x7f0b840d3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:59.110 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.102+0000 7f0b76ffd640 1 -- 172.21.15.86:0/4228266353 shutdown_connections 2024-04-25T12:21:59.111 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574862 got 55834574862 for osd.2 2024-04-25T12:21:59.111 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.102+0000 7f0b76ffd640 1 -- 172.21.15.86:0/4228266353 wait complete. 2024-04-25T12:21:59.111 DEBUG:teuthology.parallel:result is None 2024-04-25T12:21:59.112 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.102+0000 7f55cda63640 1 -- 172.21.15.86:0/3498338477 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f55b4068480 msgr2=0x7f55b406a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:59.112 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.102+0000 7f55cda63640 1 --2- 172.21.15.86:0/3498338477 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f55b4068480 0x7f55b406a940 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f55c00070b0 tx=0x7f55c0007040 comp rx=0 tx=0).stop 2024-04-25T12:21:59.112 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.102+0000 7f55cda63640 1 -- 172.21.15.86:0/3498338477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55c8151490 msgr2=0x7f55c814d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:59.112 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.102+0000 7f55cda63640 1 --2- 172.21.15.86:0/3498338477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55c8151490 0x7f55c814d150 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f55bc0ab000 tx=0x7f55bc019220 comp rx=0 tx=0).stop 2024-04-25T12:21:59.112 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.102+0000 7f55cda63640 1 -- 172.21.15.86:0/3498338477 shutdown_connections 2024-04-25T12:21:59.112 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.102+0000 7f55cda63640 1 --2- 172.21.15.86:0/3498338477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55c8151490 0x7f55c814d150 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.112 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.102+0000 7f55cda63640 1 --2- 172.21.15.86:0/3498338477 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f55c80c39e0 0x7f55c814cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.112 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.102+0000 7f55cda63640 1 --2- 172.21.15.86:0/3498338477 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f55b4068480 0x7f55b406a940 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.112 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.102+0000 7f55cda63640 1 --2- 172.21.15.86:0/3498338477 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f55c806f700 0x7f55c8162080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.113 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.102+0000 7f55cda63640 1 -- 172.21.15.86:0/3498338477 >> 172.21.15.86:0/3498338477 conn(0x7f55c806b9d0 msgr2=0x7f55c80c8500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:59.113 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.102+0000 7f55cda63640 1 -- 172.21.15.86:0/3498338477 shutdown_connections 2024-04-25T12:21:59.113 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.102+0000 7f55cda63640 1 -- 172.21.15.86:0/3498338477 wait complete. 2024-04-25T12:21:59.117 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.110+0000 7f91118ba640 1 -- 172.21.15.86:0/837630955 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f90ec005860 con 0x7f90f4006650 2024-04-25T12:21:59.117 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.110+0000 7f90f3fff640 1 -- 172.21.15.86:0/837630955 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f91000565d0 con 0x7f90f4006650 2024-04-25T12:21:59.117 INFO:teuthology.orchestra.run.smithi086.stdout:55834574861 2024-04-25T12:21:59.119 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.114+0000 7f91118ba640 1 -- 172.21.15.86:0/837630955 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f90f8068380 msgr2=0x7f90f806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:59.119 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.114+0000 7f91118ba640 1 --2- 172.21.15.86:0/837630955 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f90f8068380 0x7f90f806a840 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f91040ab000 tx=0x7f91040b0040 comp rx=0 tx=0).stop 2024-04-25T12:21:59.119 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.114+0000 7f91118ba640 1 -- 172.21.15.86:0/837630955 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90f4006650 msgr2=0x7f910c146e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:59.119 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.114+0000 7f91118ba640 1 --2- 172.21.15.86:0/837630955 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90f4006650 0x7f910c146e00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f910000d860 tx=0x7f910000dd20 comp rx=0 tx=0).stop 2024-04-25T12:21:59.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.114+0000 7f91118ba640 1 -- 172.21.15.86:0/837630955 shutdown_connections 2024-04-25T12:21:59.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.114+0000 7f91118ba640 1 --2- 172.21.15.86:0/837630955 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f910c1efda0 0x7f910c1456a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.114+0000 7f91118ba640 1 --2- 172.21.15.86:0/837630955 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f910c140120 0x7f910c1ef860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.114+0000 7f91118ba640 1 --2- 172.21.15.86:0/837630955 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f90f8068380 0x7f90f806a840 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.114+0000 7f91118ba640 1 --2- 172.21.15.86:0/837630955 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90f4006650 0x7f910c146e00 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.114+0000 7f91118ba640 1 -- 172.21.15.86:0/837630955 >> 172.21.15.86:0/837630955 conn(0x7f910c06b9d0 msgr2=0x7f910c14a6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:59.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.114+0000 7f91118ba640 1 -- 172.21.15.86:0/837630955 shutdown_connections 2024-04-25T12:21:59.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.114+0000 7f91118ba640 1 -- 172.21.15.86:0/837630955 wait complete. 2024-04-25T12:21:59.127 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574862 got 55834574862 for osd.6 2024-04-25T12:21:59.127 DEBUG:teuthology.parallel:result is None 2024-04-25T12:21:59.138 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574862 got 55834574862 for osd.5 2024-04-25T12:21:59.138 DEBUG:teuthology.parallel:result is None 2024-04-25T12:21:59.139 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574861 got 55834574861 for osd.7 2024-04-25T12:21:59.139 DEBUG:teuthology.parallel:result is None 2024-04-25T12:21:59.139 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574861 for osd.4 2024-04-25T12:21:59.139 DEBUG:teuthology.parallel:result is None 2024-04-25T12:21:59.140 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T12:21:59.140 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T12:21:59.282 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.274+0000 7f0fc390d640 1 Processor -- start 2024-04-25T12:21:59.282 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.274+0000 7f0fc390d640 1 -- start start 2024-04-25T12:21:59.284 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.278+0000 7f0fc390d640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0fbc0c8250 0x7f0fbc0c39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:59.284 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.278+0000 7f0fc390d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0fbc0c8630 0x7f0fbc151b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:59.284 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.278+0000 7f0fc390d640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fbc15b740 con 0x7f0fbc0c8a70 2024-04-25T12:21:59.284 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.278+0000 7f0fc390d640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f0fbc0c6490 con 0x7f0fbc0c8250 2024-04-25T12:21:59.284 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.278+0000 7f0fc390d640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f0fbc0c58c0 con 0x7f0fbc0c8630 2024-04-25T12:21:59.285 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.278+0000 7f0fc16a9640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0fbc0c8250 0x7f0fbc0c39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:59.285 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.278+0000 7f0fc16a9640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0fbc0c8250 0x7f0fbc0c39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:59598/0 (socket says 172.21.15.86:59598) 2024-04-25T12:21:59.285 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.278+0000 7f0fc16a9640 1 -- 172.21.15.86:0/2854111616 learned_addr learned my addr 172.21.15.86:0/2854111616 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:59.285 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.278+0000 7f0fc0ea8640 1 --2- 172.21.15.86:0/2854111616 >> v2:172.21.15.134:3300/0 conn(0x7f0fbc0c8630 0x7f0fbc151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:59.285 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.278+0000 7f0fc16a9640 1 -- 172.21.15.86:0/2854111616 >> v2:172.21.15.134:3300/0 conn(0x7f0fbc0c8630 msgr2=0x7f0fbc151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:59.285 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.278+0000 7f0fc16a9640 1 --2- 172.21.15.86:0/2854111616 >> v2:172.21.15.134:3300/0 conn(0x7f0fbc0c8630 0x7f0fbc151b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.285 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.278+0000 7f0fc16a9640 1 -- 172.21.15.86:0/2854111616 >> v1:172.21.15.134:6789/0 conn(0x7f0fbc0c8a70 legacy=0x7f0fbc152080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:59.285 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.278+0000 7f0fc16a9640 1 -- 172.21.15.86:0/2854111616 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fbc0c5b60 con 0x7f0fbc0c8250 2024-04-25T12:21:59.287 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.282+0000 7f0fc16a9640 1 --2- 172.21.15.86:0/2854111616 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0fbc0c8250 0x7f0fbc0c39e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc0c6610 tx=0x7f0fb801eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe2062b887e50b49 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:59.287 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.282+0000 7f0faffff640 1 -- 172.21.15.86:0/2854111616 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb80b4070 con 0x7f0fbc0c8250 2024-04-25T12:21:59.287 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.282+0000 7f0faffff640 1 -- 172.21.15.86:0/2854111616 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fb80a7a00 con 0x7f0fbc0c8250 2024-04-25T12:21:59.287 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.282+0000 7f0faffff640 1 -- 172.21.15.86:0/2854111616 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb80a7dd0 con 0x7f0fbc0c8250 2024-04-25T12:21:59.288 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.282+0000 7f0fc390d640 1 -- 172.21.15.86:0/2854111616 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0fbc0c8250 msgr2=0x7f0fbc0c39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:59.288 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.282+0000 7f0fc390d640 1 --2- 172.21.15.86:0/2854111616 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0fbc0c8250 0x7f0fbc0c39e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc0c6610 tx=0x7f0fb801eb40 comp rx=0 tx=0).stop 2024-04-25T12:21:59.288 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.282+0000 7f0fc390d640 1 -- 172.21.15.86:0/2854111616 shutdown_connections 2024-04-25T12:21:59.288 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.282+0000 7f0fc390d640 1 --2- 172.21.15.86:0/2854111616 >> v2:172.21.15.134:3300/0 conn(0x7f0fbc0c8630 0x7f0fbc151b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.288 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.282+0000 7f0fc390d640 1 --2- 172.21.15.86:0/2854111616 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0fbc0c8250 0x7f0fbc0c39e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.289 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.282+0000 7f0fc390d640 1 -- 172.21.15.86:0/2854111616 >> 172.21.15.86:0/2854111616 conn(0x7f0fbc06b9d0 msgr2=0x7f0fbc06bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:59.289 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.282+0000 7f0fc390d640 1 -- 172.21.15.86:0/2854111616 shutdown_connections 2024-04-25T12:21:59.289 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.282+0000 7f0fc390d640 1 -- 172.21.15.86:0/2854111616 wait complete. 2024-04-25T12:21:59.291 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.282+0000 7f0fc390d640 1 Processor -- start 2024-04-25T12:21:59.291 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.282+0000 7f0fc390d640 1 -- start start 2024-04-25T12:21:59.291 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.282+0000 7f0fc390d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0fbc0c8250 0x7f0fbc160960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:59.292 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.282+0000 7f0fc390d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0fbc0c8630 0x7f0fbc073ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:59.292 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.282+0000 7f0fc390d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0fbc0c8a70 0x7f0fbc15a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:59.292 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.282+0000 7f0fc390d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f0fbc0c6920 con 0x7f0fbc0c8a70 2024-04-25T12:21:59.292 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.282+0000 7f0fc390d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0fbc15b400 con 0x7f0fbc0c8250 2024-04-25T12:21:59.292 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.282+0000 7f0fc390d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f0fbc0681d0 con 0x7f0fbc0c8630 2024-04-25T12:21:59.292 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.282+0000 7f0fc1eaa640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0fbc0c8a70 0x7f0fbc15a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:59.292 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.282+0000 7f0fc1eaa640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0fbc0c8a70 0x7f0fbc15a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:59610/0 (socket says 172.21.15.86:59610) 2024-04-25T12:21:59.292 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.282+0000 7f0fc1eaa640 1 -- 172.21.15.86:0/2503634510 learned_addr learned my addr 172.21.15.86:0/2503634510 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:59.292 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.282+0000 7f0fc0ea8640 1 --2- 172.21.15.86:0/2503634510 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0fbc0c8630 0x7f0fbc073ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:59.292 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.282+0000 7f0fc16a9640 1 --2- 172.21.15.86:0/2503634510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0fbc0c8250 0x7f0fbc160960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:59.292 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.282+0000 7f0fc1eaa640 1 -- 172.21.15.86:0/2503634510 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0fbc0c8630 msgr2=0x7f0fbc073ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:59.292 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.282+0000 7f0fc1eaa640 1 --2- 172.21.15.86:0/2503634510 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0fbc0c8630 0x7f0fbc073ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.293 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.282+0000 7f0fc1eaa640 1 -- 172.21.15.86:0/2503634510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0fbc0c8250 msgr2=0x7f0fbc160960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:59.293 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.282+0000 7f0fc1eaa640 1 --2- 172.21.15.86:0/2503634510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0fbc0c8250 0x7f0fbc160960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.293 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.282+0000 7f0fc1eaa640 1 -- 172.21.15.86:0/2503634510 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fbc160fa0 con 0x7f0fbc0c8a70 2024-04-25T12:21:59.293 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.282+0000 7f0fc0ea8640 1 --2- 172.21.15.86:0/2503634510 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0fbc0c8630 0x7f0fbc073ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:21:59.293 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.282+0000 7f0fc1eaa640 1 --2- 172.21.15.86:0/2503634510 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0fbc0c8a70 0x7f0fbc15a8b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0fb400c730 tx=0x7f0fb400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:59.293 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.282+0000 7f0fadffb640 1 -- 172.21.15.86:0/2503634510 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb4003b80 con 0x7f0fbc0c8a70 2024-04-25T12:21:59.293 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.282+0000 7f0fadffb640 1 -- 172.21.15.86:0/2503634510 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fb4003d20 con 0x7f0fbc0c8a70 2024-04-25T12:21:59.293 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.282+0000 7f0fc390d640 1 -- 172.21.15.86:0/2503634510 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fbc161280 con 0x7f0fbc0c8a70 2024-04-25T12:21:59.293 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.282+0000 7f0fadffb640 1 -- 172.21.15.86:0/2503634510 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb400aa30 con 0x7f0fbc0c8a70 2024-04-25T12:21:59.293 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.282+0000 7f0fc390d640 1 -- 172.21.15.86:0/2503634510 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fbc161840 con 0x7f0fbc0c8a70 2024-04-25T12:21:59.293 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.286+0000 7f0fc390d640 1 -- 172.21.15.86:0/2503634510 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fbc13e9e0 con 0x7f0fbc0c8a70 2024-04-25T12:21:59.294 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.286+0000 7f0fadffb640 1 -- 172.21.15.86:0/2503634510 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0fb400abd0 con 0x7f0fbc0c8a70 2024-04-25T12:21:59.294 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.286+0000 7f0fadffb640 1 --2- 172.21.15.86:0/2503634510 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f0fa0068380 0x7f0fa006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:59.294 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.286+0000 7f0fadffb640 1 -- 172.21.15.86:0/2503634510 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0fb4086b80 con 0x7f0fbc0c8a70 2024-04-25T12:21:59.294 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.286+0000 7f0fc16a9640 1 --2- 172.21.15.86:0/2503634510 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f0fa0068380 0x7f0fa006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:59.294 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.286+0000 7f0fc16a9640 1 --2- 172.21.15.86:0/2503634510 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f0fa0068380 0x7f0fa006a840 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0fb80b1000 tx=0x7f0fb8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:59.296 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.290+0000 7f0fadffb640 1 -- 172.21.15.86:0/2503634510 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0fbc13e9e0 con 0x7f0fbc0c8a70 2024-04-25T12:21:59.444 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.438+0000 7f0fc390d640 1 -- 172.21.15.86:0/2503634510 --> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0fbc075df0 con 0x7f0fa0068380 2024-04-25T12:21:59.456 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.450+0000 7f0fadffb640 1 -- 172.21.15.86:0/2503634510 <== mgr.4107 v2:172.21.15.86:6832/3708662606 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332533 (secure 0 0 0) 0x7f0fbc075df0 con 0x7f0fa0068380 2024-04-25T12:21:59.460 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:21:59.462 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2024-04-25T12:21:59.463 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.454+0000 7f0fc390d640 1 -- 172.21.15.86:0/2503634510 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f0fa0068380 msgr2=0x7f0fa006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:59.463 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.454+0000 7f0fc390d640 1 --2- 172.21.15.86:0/2503634510 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f0fa0068380 0x7f0fa006a840 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0fb80b1000 tx=0x7f0fb8008040 comp rx=0 tx=0).stop 2024-04-25T12:21:59.463 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.454+0000 7f0fc390d640 1 -- 172.21.15.86:0/2503634510 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0fbc0c8a70 msgr2=0x7f0fbc15a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:59.463 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.454+0000 7f0fc390d640 1 --2- 172.21.15.86:0/2503634510 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0fbc0c8a70 0x7f0fbc15a8b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0fb400c730 tx=0x7f0fb400cbf0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.463 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.454+0000 7f0fc390d640 1 -- 172.21.15.86:0/2503634510 shutdown_connections 2024-04-25T12:21:59.463 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.454+0000 7f0fc390d640 1 --2- 172.21.15.86:0/2503634510 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f0fa0068380 0x7f0fa006a840 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.463 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.454+0000 7f0fc390d640 1 --2- 172.21.15.86:0/2503634510 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0fbc0c8a70 0x7f0fbc15a8b0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.463 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.454+0000 7f0fc390d640 1 --2- 172.21.15.86:0/2503634510 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0fbc0c8630 0x7f0fbc073ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.463 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.454+0000 7f0fc390d640 1 --2- 172.21.15.86:0/2503634510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0fbc0c8250 0x7f0fbc160960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.463 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.454+0000 7f0fc390d640 1 -- 172.21.15.86:0/2503634510 >> 172.21.15.86:0/2503634510 conn(0x7f0fbc06b9d0 msgr2=0x7f0fbc140a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:59.464 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.454+0000 7f0fc390d640 1 -- 172.21.15.86:0/2503634510 shutdown_connections 2024-04-25T12:21:59.464 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.454+0000 7f0fc390d640 1 -- 172.21.15.86:0/2503634510 wait complete. 2024-04-25T12:21:59.476 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2024-04-25T12:21:57.808451+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219400,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755320,"statfs":{"total":773094113280,"available":772869447680,"internally_reserved":0,"allocated":3284992,"data_stored":1992064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004133"},"pg_stats":[{"pgid":"2.1f","version":"23'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547440+0000","last_change":"2024-04-25T12:21:23.124053+0000","last_active":"2024-04-25T12:21:29.547440+0000","last_peered":"2024-04-25T12:21:29.547440+0000","last_clean":"2024-04-25T12:21:29.547440+0000","last_became_active":"2024-04-25T12:21:23.123863+0000","last_became_peered":"2024-04-25T12:21:23.123863+0000","last_unstale":"2024-04-25T12:21:29.547440+0000","last_undegraded":"2024-04-25T12:21:29.547440+0000","last_fullsized":"2024-04-25T12:21:29.547440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:52:10.500619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.286029+0000","last_change":"2024-04-25T12:21:24.141874+0000","last_active":"2024-04-25T12:21:29.286029+0000","last_peered":"2024-04-25T12:21:29.286029+0000","last_clean":"2024-04-25T12:21:29.286029+0000","last_became_active":"2024-04-25T12:21:24.141482+0000","last_became_peered":"2024-04-25T12:21:24.141482+0000","last_unstale":"2024-04-25T12:21:29.286029+0000","last_undegraded":"2024-04-25T12:21:29.286029+0000","last_fullsized":"2024-04-25T12:21:29.286029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:45.364004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.284811+0000","last_change":"2024-04-25T12:21:28.377921+0000","last_active":"2024-04-25T12:21:29.284811+0000","last_peered":"2024-04-25T12:21:29.284811+0000","last_clean":"2024-04-25T12:21:29.284811+0000","last_became_active":"2024-04-25T12:21:28.376966+0000","last_became_peered":"2024-04-25T12:21:28.376966+0000","last_unstale":"2024-04-25T12:21:29.284811+0000","last_undegraded":"2024-04-25T12:21:29.284811+0000","last_fullsized":"2024-04-25T12:21:29.284811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:50:43.460694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.286467+0000","last_change":"2024-04-25T12:21:23.113889+0000","last_active":"2024-04-25T12:21:29.286467+0000","last_peered":"2024-04-25T12:21:29.286467+0000","last_clean":"2024-04-25T12:21:29.286467+0000","last_became_active":"2024-04-25T12:21:23.113605+0000","last_became_peered":"2024-04-25T12:21:23.113605+0000","last_unstale":"2024-04-25T12:21:29.286467+0000","last_undegraded":"2024-04-25T12:21:29.286467+0000","last_fullsized":"2024-04-25T12:21:29.286467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:01.082322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547299+0000","last_change":"2024-04-25T12:21:24.115472+0000","last_active":"2024-04-25T12:21:29.547299+0000","last_peered":"2024-04-25T12:21:29.547299+0000","last_clean":"2024-04-25T12:21:29.547299+0000","last_became_active":"2024-04-25T12:21:24.114671+0000","last_became_peered":"2024-04-25T12:21:24.114671+0000","last_unstale":"2024-04-25T12:21:29.547299+0000","last_undegraded":"2024-04-25T12:21:29.547299+0000","last_fullsized":"2024-04-25T12:21:29.547299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:01:31.853992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.165775+0000","last_change":"2024-04-25T12:21:28.205320+0000","last_active":"2024-04-25T12:21:29.165775+0000","last_peered":"2024-04-25T12:21:29.165775+0000","last_clean":"2024-04-25T12:21:29.165775+0000","last_became_active":"2024-04-25T12:21:28.204404+0000","last_became_peered":"2024-04-25T12:21:28.204404+0000","last_unstale":"2024-04-25T12:21:29.165775+0000","last_undegraded":"2024-04-25T12:21:29.165775+0000","last_fullsized":"2024-04-25T12:21:29.165775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:03:17.730928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.549885+0000","last_change":"2024-04-25T12:21:23.132332+0000","last_active":"2024-04-25T12:21:29.549885+0000","last_peered":"2024-04-25T12:21:29.549885+0000","last_clean":"2024-04-25T12:21:29.549885+0000","last_became_active":"2024-04-25T12:21:23.131566+0000","last_became_peered":"2024-04-25T12:21:23.131566+0000","last_unstale":"2024-04-25T12:21:29.549885+0000","last_undegraded":"2024-04-25T12:21:29.549885+0000","last_fullsized":"2024-04-25T12:21:29.549885+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:02.429838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.168229+0000","last_change":"2024-04-25T12:21:24.128824+0000","last_active":"2024-04-25T12:21:29.168229+0000","last_peered":"2024-04-25T12:21:29.168229+0000","last_clean":"2024-04-25T12:21:29.168229+0000","last_became_active":"2024-04-25T12:21:24.128027+0000","last_became_peered":"2024-04-25T12:21:24.128027+0000","last_unstale":"2024-04-25T12:21:29.168229+0000","last_undegraded":"2024-04-25T12:21:29.168229+0000","last_fullsized":"2024-04-25T12:21:29.168229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:57:44.137044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.167257+0000","last_change":"2024-04-25T12:21:28.202389+0000","last_active":"2024-04-25T12:21:29.167257+0000","last_peered":"2024-04-25T12:21:29.167257+0000","last_clean":"2024-04-25T12:21:29.167257+0000","last_became_active":"2024-04-25T12:21:28.201228+0000","last_became_peered":"2024-04-25T12:21:28.201228+0000","last_unstale":"2024-04-25T12:21:29.167257+0000","last_undegraded":"2024-04-25T12:21:29.167257+0000","last_fullsized":"2024-04-25T12:21:29.167257+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:45:30.365480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.549318+0000","last_change":"2024-04-25T12:21:23.128355+0000","last_active":"2024-04-25T12:21:29.549318+0000","last_peered":"2024-04-25T12:21:29.549318+0000","last_clean":"2024-04-25T12:21:29.549318+0000","last_became_active":"2024-04-25T12:21:23.127717+0000","last_became_peered":"2024-04-25T12:21:23.127717+0000","last_unstale":"2024-04-25T12:21:29.549318+0000","last_undegraded":"2024-04-25T12:21:29.549318+0000","last_fullsized":"2024-04-25T12:21:29.549318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:26.319715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.168925+0000","last_change":"2024-04-25T12:21:24.122098+0000","last_active":"2024-04-25T12:21:29.168925+0000","last_peered":"2024-04-25T12:21:29.168925+0000","last_clean":"2024-04-25T12:21:29.168925+0000","last_became_active":"2024-04-25T12:21:24.121392+0000","last_became_peered":"2024-04-25T12:21:24.121392+0000","last_unstale":"2024-04-25T12:21:29.168925+0000","last_undegraded":"2024-04-25T12:21:29.168925+0000","last_fullsized":"2024-04-25T12:21:29.168925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:11:35.116222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.167070+0000","last_change":"2024-04-25T12:21:28.189048+0000","last_active":"2024-04-25T12:21:29.167070+0000","last_peered":"2024-04-25T12:21:29.167070+0000","last_clean":"2024-04-25T12:21:29.167070+0000","last_became_active":"2024-04-25T12:21:28.187340+0000","last_became_peered":"2024-04-25T12:21:28.187340+0000","last_unstale":"2024-04-25T12:21:29.167070+0000","last_undegraded":"2024-04-25T12:21:29.167070+0000","last_fullsized":"2024-04-25T12:21:29.167070+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:47:13.797595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.280524+0000","last_change":"2024-04-25T12:21:24.126211+0000","last_active":"2024-04-25T12:21:29.280524+0000","last_peered":"2024-04-25T12:21:29.280524+0000","last_clean":"2024-04-25T12:21:29.280524+0000","last_became_active":"2024-04-25T12:21:24.123695+0000","last_became_peered":"2024-04-25T12:21:24.123695+0000","last_unstale":"2024-04-25T12:21:29.280524+0000","last_undegraded":"2024-04-25T12:21:29.280524+0000","last_fullsized":"2024-04-25T12:21:29.280524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:09:04.327157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.550040+0000","last_change":"2024-04-25T12:21:23.139676+0000","last_active":"2024-04-25T12:21:29.550040+0000","last_peered":"2024-04-25T12:21:29.550040+0000","last_clean":"2024-04-25T12:21:29.550040+0000","last_became_active":"2024-04-25T12:21:23.139025+0000","last_became_peered":"2024-04-25T12:21:23.139025+0000","last_unstale":"2024-04-25T12:21:29.550040+0000","last_undegraded":"2024-04-25T12:21:29.550040+0000","last_fullsized":"2024-04-25T12:21:29.550040+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:43:51.445149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.168869+0000","last_change":"2024-04-25T12:21:28.188852+0000","last_active":"2024-04-25T12:21:29.168869+0000","last_peered":"2024-04-25T12:21:29.168869+0000","last_clean":"2024-04-25T12:21:29.168869+0000","last_became_active":"2024-04-25T12:21:28.187619+0000","last_became_peered":"2024-04-25T12:21:28.187619+0000","last_unstale":"2024-04-25T12:21:29.168869+0000","last_undegraded":"2024-04-25T12:21:29.168869+0000","last_fullsized":"2024-04-25T12:21:29.168869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:12:14.726245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.285527+0000","last_change":"2024-04-25T12:21:24.136925+0000","last_active":"2024-04-25T12:21:29.285527+0000","last_peered":"2024-04-25T12:21:29.285527+0000","last_clean":"2024-04-25T12:21:29.285527+0000","last_became_active":"2024-04-25T12:21:24.136535+0000","last_became_peered":"2024-04-25T12:21:24.136535+0000","last_unstale":"2024-04-25T12:21:29.285527+0000","last_undegraded":"2024-04-25T12:21:29.285527+0000","last_fullsized":"2024-04-25T12:21:29.285527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:28:23.965010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547294+0000","last_change":"2024-04-25T12:21:23.105571+0000","last_active":"2024-04-25T12:21:29.547294+0000","last_peered":"2024-04-25T12:21:29.547294+0000","last_clean":"2024-04-25T12:21:29.547294+0000","last_became_active":"2024-04-25T12:21:23.105051+0000","last_became_peered":"2024-04-25T12:21:23.105051+0000","last_unstale":"2024-04-25T12:21:29.547294+0000","last_undegraded":"2024-04-25T12:21:29.547294+0000","last_fullsized":"2024-04-25T12:21:29.547294+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:52:40.783100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.167305+0000","last_change":"2024-04-25T12:21:28.202632+0000","last_active":"2024-04-25T12:21:29.167305+0000","last_peered":"2024-04-25T12:21:29.167305+0000","last_clean":"2024-04-25T12:21:29.167305+0000","last_became_active":"2024-04-25T12:21:28.201389+0000","last_became_peered":"2024-04-25T12:21:28.201389+0000","last_unstale":"2024-04-25T12:21:29.167305+0000","last_undegraded":"2024-04-25T12:21:29.167305+0000","last_fullsized":"2024-04-25T12:21:29.167305+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:48:58.246610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.285297+0000","last_change":"2024-04-25T12:21:24.138749+0000","last_active":"2024-04-25T12:21:29.285297+0000","last_peered":"2024-04-25T12:21:29.285297+0000","last_clean":"2024-04-25T12:21:29.285297+0000","last_became_active":"2024-04-25T12:21:24.138446+0000","last_became_peered":"2024-04-25T12:21:24.138446+0000","last_unstale":"2024-04-25T12:21:29.285297+0000","last_undegraded":"2024-04-25T12:21:29.285297+0000","last_fullsized":"2024-04-25T12:21:29.285297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:22:03.856237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.546669+0000","last_change":"2024-04-25T12:21:23.126871+0000","last_active":"2024-04-25T12:21:29.546669+0000","last_peered":"2024-04-25T12:21:29.546669+0000","last_clean":"2024-04-25T12:21:29.546669+0000","last_became_active":"2024-04-25T12:21:23.126521+0000","last_became_peered":"2024-04-25T12:21:23.126521+0000","last_unstale":"2024-04-25T12:21:29.546669+0000","last_undegraded":"2024-04-25T12:21:29.546669+0000","last_fullsized":"2024-04-25T12:21:29.546669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:12:31.353951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.548028+0000","last_change":"2024-04-25T12:21:28.383996+0000","last_active":"2024-04-25T12:21:29.548028+0000","last_peered":"2024-04-25T12:21:29.548028+0000","last_clean":"2024-04-25T12:21:29.548028+0000","last_became_active":"2024-04-25T12:21:28.383568+0000","last_became_peered":"2024-04-25T12:21:28.383568+0000","last_unstale":"2024-04-25T12:21:29.548028+0000","last_undegraded":"2024-04-25T12:21:29.548028+0000","last_fullsized":"2024-04-25T12:21:29.548028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:19:41.564694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.167030+0000","last_change":"2024-04-25T12:21:24.125112+0000","last_active":"2024-04-25T12:21:29.167030+0000","last_peered":"2024-04-25T12:21:29.167030+0000","last_clean":"2024-04-25T12:21:29.167030+0000","last_became_active":"2024-04-25T12:21:24.121963+0000","last_became_peered":"2024-04-25T12:21:24.121963+0000","last_unstale":"2024-04-25T12:21:29.167030+0000","last_undegraded":"2024-04-25T12:21:29.167030+0000","last_fullsized":"2024-04-25T12:21:29.167030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:33:14.123119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.548711+0000","last_change":"2024-04-25T12:21:23.117114+0000","last_active":"2024-04-25T12:21:29.548711+0000","last_peered":"2024-04-25T12:21:29.548711+0000","last_clean":"2024-04-25T12:21:29.548711+0000","last_became_active":"2024-04-25T12:21:23.115571+0000","last_became_peered":"2024-04-25T12:21:23.115571+0000","last_unstale":"2024-04-25T12:21:29.548711+0000","last_undegraded":"2024-04-25T12:21:29.548711+0000","last_fullsized":"2024-04-25T12:21:29.548711+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:47.838299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.168694+0000","last_change":"2024-04-25T12:21:28.202374+0000","last_active":"2024-04-25T12:21:29.168694+0000","last_peered":"2024-04-25T12:21:29.168694+0000","last_clean":"2024-04-25T12:21:29.168694+0000","last_became_active":"2024-04-25T12:21:28.201297+0000","last_became_peered":"2024-04-25T12:21:28.201297+0000","last_unstale":"2024-04-25T12:21:29.168694+0000","last_undegraded":"2024-04-25T12:21:29.168694+0000","last_fullsized":"2024-04-25T12:21:29.168694+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:13.461169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547865+0000","last_change":"2024-04-25T12:21:24.133827+0000","last_active":"2024-04-25T12:21:29.547865+0000","last_peered":"2024-04-25T12:21:29.547865+0000","last_clean":"2024-04-25T12:21:29.547865+0000","last_became_active":"2024-04-25T12:21:24.132703+0000","last_became_peered":"2024-04-25T12:21:24.132703+0000","last_unstale":"2024-04-25T12:21:29.547865+0000","last_undegraded":"2024-04-25T12:21:29.547865+0000","last_fullsized":"2024-04-25T12:21:29.547865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:06:22.849827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.282189+0000","last_change":"2024-04-25T12:21:23.132331+0000","last_active":"2024-04-25T12:21:29.282189+0000","last_peered":"2024-04-25T12:21:29.282189+0000","last_clean":"2024-04-25T12:21:29.282189+0000","last_became_active":"2024-04-25T12:21:23.131628+0000","last_became_peered":"2024-04-25T12:21:23.131628+0000","last_unstale":"2024-04-25T12:21:29.282189+0000","last_undegraded":"2024-04-25T12:21:29.282189+0000","last_fullsized":"2024-04-25T12:21:29.282189+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:19:13.372172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.166531+0000","last_change":"2024-04-25T12:21:28.377407+0000","last_active":"2024-04-25T12:21:29.166531+0000","last_peered":"2024-04-25T12:21:29.166531+0000","last_clean":"2024-04-25T12:21:29.166531+0000","last_became_active":"2024-04-25T12:21:28.376224+0000","last_became_peered":"2024-04-25T12:21:28.376224+0000","last_unstale":"2024-04-25T12:21:29.166531+0000","last_undegraded":"2024-04-25T12:21:29.166531+0000","last_fullsized":"2024-04-25T12:21:29.166531+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:13:02.955979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.286648+0000","last_change":"2024-04-25T12:21:24.145468+0000","last_active":"2024-04-25T12:21:29.286648+0000","last_peered":"2024-04-25T12:21:29.286648+0000","last_clean":"2024-04-25T12:21:29.286648+0000","last_became_active":"2024-04-25T12:21:24.145132+0000","last_became_peered":"2024-04-25T12:21:24.145132+0000","last_unstale":"2024-04-25T12:21:29.286648+0000","last_undegraded":"2024-04-25T12:21:29.286648+0000","last_fullsized":"2024-04-25T12:21:29.286648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:46:44.281270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.548372+0000","last_change":"2024-04-25T12:21:23.131029+0000","last_active":"2024-04-25T12:21:29.548372+0000","last_peered":"2024-04-25T12:21:29.548372+0000","last_clean":"2024-04-25T12:21:29.548372+0000","last_became_active":"2024-04-25T12:21:23.130612+0000","last_became_peered":"2024-04-25T12:21:23.130612+0000","last_unstale":"2024-04-25T12:21:29.548372+0000","last_undegraded":"2024-04-25T12:21:29.548372+0000","last_fullsized":"2024-04-25T12:21:29.548372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:02.146986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.284659+0000","last_change":"2024-04-25T12:21:28.375231+0000","last_active":"2024-04-25T12:21:29.284659+0000","last_peered":"2024-04-25T12:21:29.284659+0000","last_clean":"2024-04-25T12:21:29.284659+0000","last_became_active":"2024-04-25T12:21:28.374813+0000","last_became_peered":"2024-04-25T12:21:28.374813+0000","last_unstale":"2024-04-25T12:21:29.284659+0000","last_undegraded":"2024-04-25T12:21:29.284659+0000","last_fullsized":"2024-04-25T12:21:29.284659+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:16.393582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547074+0000","last_change":"2024-04-25T12:21:24.112280+0000","last_active":"2024-04-25T12:21:29.547074+0000","last_peered":"2024-04-25T12:21:29.547074+0000","last_clean":"2024-04-25T12:21:29.547074+0000","last_became_active":"2024-04-25T12:21:24.111430+0000","last_became_peered":"2024-04-25T12:21:24.111430+0000","last_unstale":"2024-04-25T12:21:29.547074+0000","last_undegraded":"2024-04-25T12:21:29.547074+0000","last_fullsized":"2024-04-25T12:21:29.547074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:58.325720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.550155+0000","last_change":"2024-04-25T12:21:23.124271+0000","last_active":"2024-04-25T12:21:29.550155+0000","last_peered":"2024-04-25T12:21:29.550155+0000","last_clean":"2024-04-25T12:21:29.550155+0000","last_became_active":"2024-04-25T12:21:23.123492+0000","last_became_peered":"2024-04-25T12:21:23.123492+0000","last_unstale":"2024-04-25T12:21:29.550155+0000","last_undegraded":"2024-04-25T12:21:29.550155+0000","last_fullsized":"2024-04-25T12:21:29.550155+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:31:09.080478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.546586+0000","last_change":"2024-04-25T12:21:28.375801+0000","last_active":"2024-04-25T12:21:29.546586+0000","last_peered":"2024-04-25T12:21:29.546586+0000","last_clean":"2024-04-25T12:21:29.546586+0000","last_became_active":"2024-04-25T12:21:28.375119+0000","last_became_peered":"2024-04-25T12:21:28.375119+0000","last_unstale":"2024-04-25T12:21:29.546586+0000","last_undegraded":"2024-04-25T12:21:29.546586+0000","last_fullsized":"2024-04-25T12:21:29.546586+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:00:29.908954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.169044+0000","last_change":"2024-04-25T12:21:24.131673+0000","last_active":"2024-04-25T12:21:29.169044+0000","last_peered":"2024-04-25T12:21:29.169044+0000","last_clean":"2024-04-25T12:21:29.169044+0000","last_became_active":"2024-04-25T12:21:24.130866+0000","last_became_peered":"2024-04-25T12:21:24.130866+0000","last_unstale":"2024-04-25T12:21:29.169044+0000","last_undegraded":"2024-04-25T12:21:29.169044+0000","last_fullsized":"2024-04-25T12:21:29.169044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:09:04.327157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547130+0000","last_change":"2024-04-25T12:21:23.106785+0000","last_active":"2024-04-25T12:21:29.547130+0000","last_peered":"2024-04-25T12:21:29.547130+0000","last_clean":"2024-04-25T12:21:29.547130+0000","last_became_active":"2024-04-25T12:21:23.105809+0000","last_became_peered":"2024-04-25T12:21:23.105809+0000","last_unstale":"2024-04-25T12:21:29.547130+0000","last_undegraded":"2024-04-25T12:21:29.547130+0000","last_fullsized":"2024-04-25T12:21:29.547130+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:17.185116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.546915+0000","last_change":"2024-04-25T12:21:28.193242+0000","last_active":"2024-04-25T12:21:29.546915+0000","last_peered":"2024-04-25T12:21:29.546915+0000","last_clean":"2024-04-25T12:21:29.546915+0000","last_became_active":"2024-04-25T12:21:28.192835+0000","last_became_peered":"2024-04-25T12:21:28.192835+0000","last_unstale":"2024-04-25T12:21:29.546915+0000","last_undegraded":"2024-04-25T12:21:29.546915+0000","last_fullsized":"2024-04-25T12:21:29.546915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:42:52.476024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.167733+0000","last_change":"2024-04-25T12:21:24.128902+0000","last_active":"2024-04-25T12:21:29.167733+0000","last_peered":"2024-04-25T12:21:29.167733+0000","last_clean":"2024-04-25T12:21:29.167733+0000","last_became_active":"2024-04-25T12:21:24.124563+0000","last_became_peered":"2024-04-25T12:21:24.124563+0000","last_unstale":"2024-04-25T12:21:29.167733+0000","last_undegraded":"2024-04-25T12:21:29.167733+0000","last_fullsized":"2024-04-25T12:21:29.167733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:16.937980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.168141+0000","last_change":"2024-04-25T12:21:23.114222+0000","last_active":"2024-04-25T12:21:29.168141+0000","last_peered":"2024-04-25T12:21:29.168141+0000","last_clean":"2024-04-25T12:21:29.168141+0000","last_became_active":"2024-04-25T12:21:23.113504+0000","last_became_peered":"2024-04-25T12:21:23.113504+0000","last_unstale":"2024-04-25T12:21:29.168141+0000","last_undegraded":"2024-04-25T12:21:29.168141+0000","last_fullsized":"2024-04-25T12:21:29.168141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:37:42.382391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547040+0000","last_change":"2024-04-25T12:21:28.200532+0000","last_active":"2024-04-25T12:21:29.547040+0000","last_peered":"2024-04-25T12:21:29.547040+0000","last_clean":"2024-04-25T12:21:29.547040+0000","last_became_active":"2024-04-25T12:21:28.200082+0000","last_became_peered":"2024-04-25T12:21:28.200082+0000","last_unstale":"2024-04-25T12:21:29.547040+0000","last_undegraded":"2024-04-25T12:21:29.547040+0000","last_fullsized":"2024-04-25T12:21:29.547040+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:24.889665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547331+0000","last_change":"2024-04-25T12:21:24.112524+0000","last_active":"2024-04-25T12:21:29.547331+0000","last_peered":"2024-04-25T12:21:29.547331+0000","last_clean":"2024-04-25T12:21:29.547331+0000","last_became_active":"2024-04-25T12:21:24.111503+0000","last_became_peered":"2024-04-25T12:21:24.111503+0000","last_unstale":"2024-04-25T12:21:29.547331+0000","last_undegraded":"2024-04-25T12:21:29.547331+0000","last_fullsized":"2024-04-25T12:21:29.547331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:03:35.982959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.166343+0000","last_change":"2024-04-25T12:21:23.108434+0000","last_active":"2024-04-25T12:21:29.166343+0000","last_peered":"2024-04-25T12:21:29.166343+0000","last_clean":"2024-04-25T12:21:29.166343+0000","last_became_active":"2024-04-25T12:21:23.108051+0000","last_became_peered":"2024-04-25T12:21:23.108051+0000","last_unstale":"2024-04-25T12:21:29.166343+0000","last_undegraded":"2024-04-25T12:21:29.166343+0000","last_fullsized":"2024-04-25T12:21:29.166343+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:49.222950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.548093+0000","last_change":"2024-04-25T12:21:28.189825+0000","last_active":"2024-04-25T12:21:29.548093+0000","last_peered":"2024-04-25T12:21:29.548093+0000","last_clean":"2024-04-25T12:21:29.548093+0000","last_became_active":"2024-04-25T12:21:28.189247+0000","last_became_peered":"2024-04-25T12:21:28.189247+0000","last_unstale":"2024-04-25T12:21:29.548093+0000","last_undegraded":"2024-04-25T12:21:29.548093+0000","last_fullsized":"2024-04-25T12:21:29.548093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:54:02.752212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.546226+0000","last_change":"2024-04-25T12:21:24.105746+0000","last_active":"2024-04-25T12:21:29.546226+0000","last_peered":"2024-04-25T12:21:29.546226+0000","last_clean":"2024-04-25T12:21:29.546226+0000","last_became_active":"2024-04-25T12:21:24.104947+0000","last_became_peered":"2024-04-25T12:21:24.104947+0000","last_unstale":"2024-04-25T12:21:29.546226+0000","last_undegraded":"2024-04-25T12:21:29.546226+0000","last_fullsized":"2024-04-25T12:21:29.546226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:46:14.853789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.548699+0000","last_change":"2024-04-25T12:21:23.114591+0000","last_active":"2024-04-25T12:21:29.548699+0000","last_peered":"2024-04-25T12:21:29.548699+0000","last_clean":"2024-04-25T12:21:29.548699+0000","last_became_active":"2024-04-25T12:21:23.113829+0000","last_became_peered":"2024-04-25T12:21:23.113829+0000","last_unstale":"2024-04-25T12:21:29.548699+0000","last_undegraded":"2024-04-25T12:21:29.548699+0000","last_fullsized":"2024-04-25T12:21:29.548699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:51:38.471436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547750+0000","last_change":"2024-04-25T12:21:28.378024+0000","last_active":"2024-04-25T12:21:29.547750+0000","last_peered":"2024-04-25T12:21:29.547750+0000","last_clean":"2024-04-25T12:21:29.547750+0000","last_became_active":"2024-04-25T12:21:28.377639+0000","last_became_peered":"2024-04-25T12:21:28.377639+0000","last_unstale":"2024-04-25T12:21:29.547750+0000","last_undegraded":"2024-04-25T12:21:29.547750+0000","last_fullsized":"2024-04-25T12:21:29.547750+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:18:40.723659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.285268+0000","last_change":"2024-04-25T12:21:24.120719+0000","last_active":"2024-04-25T12:21:29.285268+0000","last_peered":"2024-04-25T12:21:29.285268+0000","last_clean":"2024-04-25T12:21:29.285268+0000","last_became_active":"2024-04-25T12:21:24.119870+0000","last_became_peered":"2024-04-25T12:21:24.119870+0000","last_unstale":"2024-04-25T12:21:29.285268+0000","last_undegraded":"2024-04-25T12:21:29.285268+0000","last_fullsized":"2024-04-25T12:21:29.285268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:53:15.175473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.168316+0000","last_change":"2024-04-25T12:21:23.103524+0000","last_active":"2024-04-25T12:21:29.168316+0000","last_peered":"2024-04-25T12:21:29.168316+0000","last_clean":"2024-04-25T12:21:29.168316+0000","last_became_active":"2024-04-25T12:21:23.102790+0000","last_became_peered":"2024-04-25T12:21:23.102790+0000","last_unstale":"2024-04-25T12:21:29.168316+0000","last_undegraded":"2024-04-25T12:21:29.168316+0000","last_fullsized":"2024-04-25T12:21:29.168316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:15:54.796303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.549016+0000","last_change":"2024-04-25T12:21:13.081186+0000","last_active":"2024-04-25T12:21:29.549016+0000","last_peered":"2024-04-25T12:21:29.549016+0000","last_clean":"2024-04-25T12:21:29.549016+0000","last_became_active":"2024-04-25T12:21:13.076753+0000","last_became_peered":"2024-04-25T12:21:13.076753+0000","last_unstale":"2024-04-25T12:21:29.549016+0000","last_undegraded":"2024-04-25T12:21:29.549016+0000","last_fullsized":"2024-04-25T12:21:29.549016+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:12.013694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:12.013694+0000","last_clean_scrub_stamp":"2024-04-25T12:21:12.013694+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:18:03.288120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.281646+0000","last_change":"2024-04-25T12:21:28.379372+0000","last_active":"2024-04-25T12:21:29.281646+0000","last_peered":"2024-04-25T12:21:29.281646+0000","last_clean":"2024-04-25T12:21:29.281646+0000","last_became_active":"2024-04-25T12:21:28.378522+0000","last_became_peered":"2024-04-25T12:21:28.378522+0000","last_unstale":"2024-04-25T12:21:29.281646+0000","last_undegraded":"2024-04-25T12:21:29.281646+0000","last_fullsized":"2024-04-25T12:21:29.281646+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:54:35.288829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.549343+0000","last_change":"2024-04-25T12:21:24.144632+0000","last_active":"2024-04-25T12:21:29.549343+0000","last_peered":"2024-04-25T12:21:29.549343+0000","last_clean":"2024-04-25T12:21:29.549343+0000","last_became_active":"2024-04-25T12:21:24.142085+0000","last_became_peered":"2024-04-25T12:21:24.142085+0000","last_unstale":"2024-04-25T12:21:29.549343+0000","last_undegraded":"2024-04-25T12:21:29.549343+0000","last_fullsized":"2024-04-25T12:21:29.549343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:16:55.634329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.166743+0000","last_change":"2024-04-25T12:21:23.126527+0000","last_active":"2024-04-25T12:21:29.166743+0000","last_peered":"2024-04-25T12:21:29.166743+0000","last_clean":"2024-04-25T12:21:29.166743+0000","last_became_active":"2024-04-25T12:21:23.126103+0000","last_became_peered":"2024-04-25T12:21:23.126103+0000","last_unstale":"2024-04-25T12:21:29.166743+0000","last_undegraded":"2024-04-25T12:21:29.166743+0000","last_fullsized":"2024-04-25T12:21:29.166743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:16:36.502824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.280872+0000","last_change":"2024-04-25T12:21:28.379480+0000","last_active":"2024-04-25T12:21:29.280872+0000","last_peered":"2024-04-25T12:21:29.280872+0000","last_clean":"2024-04-25T12:21:29.280872+0000","last_became_active":"2024-04-25T12:21:28.378559+0000","last_became_peered":"2024-04-25T12:21:28.378559+0000","last_unstale":"2024-04-25T12:21:29.280872+0000","last_undegraded":"2024-04-25T12:21:29.280872+0000","last_fullsized":"2024-04-25T12:21:29.280872+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:40.975592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.168315+0000","last_change":"2024-04-25T12:21:24.129518+0000","last_active":"2024-04-25T12:21:29.168315+0000","last_peered":"2024-04-25T12:21:29.168315+0000","last_clean":"2024-04-25T12:21:29.168315+0000","last_became_active":"2024-04-25T12:21:24.126968+0000","last_became_peered":"2024-04-25T12:21:24.126968+0000","last_unstale":"2024-04-25T12:21:29.168315+0000","last_undegraded":"2024-04-25T12:21:29.168315+0000","last_fullsized":"2024-04-25T12:21:29.168315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:49.243645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547717+0000","last_change":"2024-04-25T12:21:23.116529+0000","last_active":"2024-04-25T12:21:29.547717+0000","last_peered":"2024-04-25T12:21:29.547717+0000","last_clean":"2024-04-25T12:21:29.547717+0000","last_became_active":"2024-04-25T12:21:23.116148+0000","last_became_peered":"2024-04-25T12:21:23.116148+0000","last_unstale":"2024-04-25T12:21:29.547717+0000","last_undegraded":"2024-04-25T12:21:29.547717+0000","last_fullsized":"2024-04-25T12:21:29.547717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:01:45.567238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.546941+0000","last_change":"2024-04-25T12:21:28.194823+0000","last_active":"2024-04-25T12:21:29.546941+0000","last_peered":"2024-04-25T12:21:29.546941+0000","last_clean":"2024-04-25T12:21:29.546941+0000","last_became_active":"2024-04-25T12:21:28.194191+0000","last_became_peered":"2024-04-25T12:21:28.194191+0000","last_unstale":"2024-04-25T12:21:29.546941+0000","last_undegraded":"2024-04-25T12:21:29.546941+0000","last_fullsized":"2024-04-25T12:21:29.546941+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:50:30.454926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.550030+0000","last_change":"2024-04-25T12:21:24.146733+0000","last_active":"2024-04-25T12:21:29.550030+0000","last_peered":"2024-04-25T12:21:29.550030+0000","last_clean":"2024-04-25T12:21:29.550030+0000","last_became_active":"2024-04-25T12:21:24.145807+0000","last_became_peered":"2024-04-25T12:21:24.145807+0000","last_unstale":"2024-04-25T12:21:29.550030+0000","last_undegraded":"2024-04-25T12:21:29.550030+0000","last_fullsized":"2024-04-25T12:21:29.550030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:07:35.092827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.166946+0000","last_change":"2024-04-25T12:21:23.103393+0000","last_active":"2024-04-25T12:21:29.166946+0000","last_peered":"2024-04-25T12:21:29.166946+0000","last_clean":"2024-04-25T12:21:29.166946+0000","last_became_active":"2024-04-25T12:21:23.102997+0000","last_became_peered":"2024-04-25T12:21:23.102997+0000","last_unstale":"2024-04-25T12:21:29.166946+0000","last_undegraded":"2024-04-25T12:21:29.166946+0000","last_fullsized":"2024-04-25T12:21:29.166946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:40:23.054158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.167860+0000","last_change":"2024-04-25T12:21:28.384645+0000","last_active":"2024-04-25T12:21:29.167860+0000","last_peered":"2024-04-25T12:21:29.167860+0000","last_clean":"2024-04-25T12:21:29.167860+0000","last_became_active":"2024-04-25T12:21:28.382953+0000","last_became_peered":"2024-04-25T12:21:28.382953+0000","last_unstale":"2024-04-25T12:21:29.167860+0000","last_undegraded":"2024-04-25T12:21:29.167860+0000","last_fullsized":"2024-04-25T12:21:29.167860+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:40:56.218533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.549409+0000","last_change":"2024-04-25T12:21:24.146557+0000","last_active":"2024-04-25T12:21:29.549409+0000","last_peered":"2024-04-25T12:21:29.549409+0000","last_clean":"2024-04-25T12:21:29.549409+0000","last_became_active":"2024-04-25T12:21:24.146162+0000","last_became_peered":"2024-04-25T12:21:24.146162+0000","last_unstale":"2024-04-25T12:21:29.549409+0000","last_undegraded":"2024-04-25T12:21:29.549409+0000","last_fullsized":"2024-04-25T12:21:29.549409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:09:00.995503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.169245+0000","last_change":"2024-04-25T12:21:23.135467+0000","last_active":"2024-04-25T12:21:29.169245+0000","last_peered":"2024-04-25T12:21:29.169245+0000","last_clean":"2024-04-25T12:21:29.169245+0000","last_became_active":"2024-04-25T12:21:23.134441+0000","last_became_peered":"2024-04-25T12:21:23.134441+0000","last_unstale":"2024-04-25T12:21:29.169245+0000","last_undegraded":"2024-04-25T12:21:29.169245+0000","last_fullsized":"2024-04-25T12:21:29.169245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:44:33.069221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.165946+0000","last_change":"2024-04-25T12:21:28.202610+0000","last_active":"2024-04-25T12:21:29.165946+0000","last_peered":"2024-04-25T12:21:29.165946+0000","last_clean":"2024-04-25T12:21:29.165946+0000","last_became_active":"2024-04-25T12:21:28.201479+0000","last_became_peered":"2024-04-25T12:21:28.201479+0000","last_unstale":"2024-04-25T12:21:29.165946+0000","last_undegraded":"2024-04-25T12:21:29.165946+0000","last_fullsized":"2024-04-25T12:21:29.165946+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:25:15.458202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.548957+0000","last_change":"2024-04-25T12:21:24.145131+0000","last_active":"2024-04-25T12:21:29.548957+0000","last_peered":"2024-04-25T12:21:29.548957+0000","last_clean":"2024-04-25T12:21:29.548957+0000","last_became_active":"2024-04-25T12:21:24.142422+0000","last_became_peered":"2024-04-25T12:21:24.142422+0000","last_unstale":"2024-04-25T12:21:29.548957+0000","last_undegraded":"2024-04-25T12:21:29.548957+0000","last_fullsized":"2024-04-25T12:21:29.548957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:40:24.312543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.166123+0000","last_change":"2024-04-25T12:21:23.104288+0000","last_active":"2024-04-25T12:21:29.166123+0000","last_peered":"2024-04-25T12:21:29.166123+0000","last_clean":"2024-04-25T12:21:29.166123+0000","last_became_active":"2024-04-25T12:21:23.103680+0000","last_became_peered":"2024-04-25T12:21:23.103680+0000","last_unstale":"2024-04-25T12:21:29.166123+0000","last_undegraded":"2024-04-25T12:21:29.166123+0000","last_fullsized":"2024-04-25T12:21:29.166123+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:29.672890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547646+0000","last_change":"2024-04-25T12:21:28.199834+0000","last_active":"2024-04-25T12:21:29.547646+0000","last_peered":"2024-04-25T12:21:29.547646+0000","last_clean":"2024-04-25T12:21:29.547646+0000","last_became_active":"2024-04-25T12:21:28.199411+0000","last_became_peered":"2024-04-25T12:21:28.199411+0000","last_unstale":"2024-04-25T12:21:29.547646+0000","last_undegraded":"2024-04-25T12:21:29.547646+0000","last_fullsized":"2024-04-25T12:21:29.547646+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:52:34.443813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.280647+0000","last_change":"2024-04-25T12:21:24.127488+0000","last_active":"2024-04-25T12:21:29.280647+0000","last_peered":"2024-04-25T12:21:29.280647+0000","last_clean":"2024-04-25T12:21:29.280647+0000","last_became_active":"2024-04-25T12:21:24.126721+0000","last_became_peered":"2024-04-25T12:21:24.126721+0000","last_unstale":"2024-04-25T12:21:29.280647+0000","last_undegraded":"2024-04-25T12:21:29.280647+0000","last_fullsized":"2024-04-25T12:21:29.280647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:02.153025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.280911+0000","last_change":"2024-04-25T12:21:23.139626+0000","last_active":"2024-04-25T12:21:29.280911+0000","last_peered":"2024-04-25T12:21:29.280911+0000","last_clean":"2024-04-25T12:21:29.280911+0000","last_became_active":"2024-04-25T12:21:23.138837+0000","last_became_peered":"2024-04-25T12:21:23.138837+0000","last_unstale":"2024-04-25T12:21:29.280911+0000","last_undegraded":"2024-04-25T12:21:29.280911+0000","last_fullsized":"2024-04-25T12:21:29.280911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:09.309384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.286588+0000","last_change":"2024-04-25T12:21:28.383919+0000","last_active":"2024-04-25T12:21:29.286588+0000","last_peered":"2024-04-25T12:21:29.286588+0000","last_clean":"2024-04-25T12:21:29.286588+0000","last_became_active":"2024-04-25T12:21:28.383298+0000","last_became_peered":"2024-04-25T12:21:28.383298+0000","last_unstale":"2024-04-25T12:21:29.286588+0000","last_undegraded":"2024-04-25T12:21:29.286588+0000","last_fullsized":"2024-04-25T12:21:29.286588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:01.115040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.549858+0000","last_change":"2024-04-25T12:21:24.146454+0000","last_active":"2024-04-25T12:21:29.549858+0000","last_peered":"2024-04-25T12:21:29.549858+0000","last_clean":"2024-04-25T12:21:29.549858+0000","last_became_active":"2024-04-25T12:21:24.145931+0000","last_became_peered":"2024-04-25T12:21:24.145931+0000","last_unstale":"2024-04-25T12:21:29.549858+0000","last_undegraded":"2024-04-25T12:21:29.549858+0000","last_fullsized":"2024-04-25T12:21:29.549858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:35:22.490243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.168054+0000","last_change":"2024-04-25T12:21:23.122495+0000","last_active":"2024-04-25T12:21:29.168054+0000","last_peered":"2024-04-25T12:21:29.168054+0000","last_clean":"2024-04-25T12:21:29.168054+0000","last_became_active":"2024-04-25T12:21:23.121429+0000","last_became_peered":"2024-04-25T12:21:23.121429+0000","last_unstale":"2024-04-25T12:21:29.168054+0000","last_undegraded":"2024-04-25T12:21:29.168054+0000","last_fullsized":"2024-04-25T12:21:29.168054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:10.530248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.285955+0000","last_change":"2024-04-25T12:21:28.375971+0000","last_active":"2024-04-25T12:21:29.285955+0000","last_peered":"2024-04-25T12:21:29.285955+0000","last_clean":"2024-04-25T12:21:29.285955+0000","last_became_active":"2024-04-25T12:21:28.375013+0000","last_became_peered":"2024-04-25T12:21:28.375013+0000","last_unstale":"2024-04-25T12:21:29.285955+0000","last_undegraded":"2024-04-25T12:21:29.285955+0000","last_fullsized":"2024-04-25T12:21:29.285955+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:56:45.398763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.546876+0000","last_change":"2024-04-25T12:21:24.138293+0000","last_active":"2024-04-25T12:21:29.546876+0000","last_peered":"2024-04-25T12:21:29.546876+0000","last_clean":"2024-04-25T12:21:29.546876+0000","last_became_active":"2024-04-25T12:21:24.138016+0000","last_became_peered":"2024-04-25T12:21:24.138016+0000","last_unstale":"2024-04-25T12:21:29.546876+0000","last_undegraded":"2024-04-25T12:21:29.546876+0000","last_fullsized":"2024-04-25T12:21:29.546876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:48:54.078239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547256+0000","last_change":"2024-04-25T12:21:23.136227+0000","last_active":"2024-04-25T12:21:29.547256+0000","last_peered":"2024-04-25T12:21:29.547256+0000","last_clean":"2024-04-25T12:21:29.547256+0000","last_became_active":"2024-04-25T12:21:23.135947+0000","last_became_peered":"2024-04-25T12:21:23.135947+0000","last_unstale":"2024-04-25T12:21:29.547256+0000","last_undegraded":"2024-04-25T12:21:29.547256+0000","last_fullsized":"2024-04-25T12:21:29.547256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:41:24.323924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.168847+0000","last_change":"2024-04-25T12:21:28.378564+0000","last_active":"2024-04-25T12:21:29.168847+0000","last_peered":"2024-04-25T12:21:29.168847+0000","last_clean":"2024-04-25T12:21:29.168847+0000","last_became_active":"2024-04-25T12:21:28.377532+0000","last_became_peered":"2024-04-25T12:21:28.377532+0000","last_unstale":"2024-04-25T12:21:29.168847+0000","last_undegraded":"2024-04-25T12:21:29.168847+0000","last_fullsized":"2024-04-25T12:21:29.168847+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:20.576562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.549070+0000","last_change":"2024-04-25T12:21:24.148665+0000","last_active":"2024-04-25T12:21:29.549070+0000","last_peered":"2024-04-25T12:21:29.549070+0000","last_clean":"2024-04-25T12:21:29.549070+0000","last_became_active":"2024-04-25T12:21:24.142505+0000","last_became_peered":"2024-04-25T12:21:24.142505+0000","last_unstale":"2024-04-25T12:21:29.549070+0000","last_undegraded":"2024-04-25T12:21:29.549070+0000","last_fullsized":"2024-04-25T12:21:29.549070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:19:44.014834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:38.438513+0000","last_change":"2024-04-25T12:21:23.130231+0000","last_active":"2024-04-25T12:21:38.438513+0000","last_peered":"2024-04-25T12:21:38.438513+0000","last_clean":"2024-04-25T12:21:38.438513+0000","last_became_active":"2024-04-25T12:21:23.129474+0000","last_became_peered":"2024-04-25T12:21:23.129474+0000","last_unstale":"2024-04-25T12:21:38.438513+0000","last_undegraded":"2024-04-25T12:21:38.438513+0000","last_fullsized":"2024-04-25T12:21:38.438513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:50.974387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547082+0000","last_change":"2024-04-25T12:21:28.200551+0000","last_active":"2024-04-25T12:21:29.547082+0000","last_peered":"2024-04-25T12:21:29.547082+0000","last_clean":"2024-04-25T12:21:29.547082+0000","last_became_active":"2024-04-25T12:21:28.200152+0000","last_became_peered":"2024-04-25T12:21:28.200152+0000","last_unstale":"2024-04-25T12:21:29.547082+0000","last_undegraded":"2024-04-25T12:21:29.547082+0000","last_fullsized":"2024-04-25T12:21:29.547082+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:17:34.847925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.167585+0000","last_change":"2024-04-25T12:21:24.142957+0000","last_active":"2024-04-25T12:21:29.167585+0000","last_peered":"2024-04-25T12:21:29.167585+0000","last_clean":"2024-04-25T12:21:29.167585+0000","last_became_active":"2024-04-25T12:21:24.142594+0000","last_became_peered":"2024-04-25T12:21:24.142594+0000","last_unstale":"2024-04-25T12:21:29.167585+0000","last_undegraded":"2024-04-25T12:21:29.167585+0000","last_fullsized":"2024-04-25T12:21:29.167585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:36:47.719946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547660+0000","last_change":"2024-04-25T12:21:23.125118+0000","last_active":"2024-04-25T12:21:29.547660+0000","last_peered":"2024-04-25T12:21:29.547660+0000","last_clean":"2024-04-25T12:21:29.547660+0000","last_became_active":"2024-04-25T12:21:23.124836+0000","last_became_peered":"2024-04-25T12:21:23.124836+0000","last_unstale":"2024-04-25T12:21:29.547660+0000","last_undegraded":"2024-04-25T12:21:29.547660+0000","last_fullsized":"2024-04-25T12:21:29.547660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:03:28.500940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.167503+0000","last_change":"2024-04-25T12:21:28.194476+0000","last_active":"2024-04-25T12:21:29.167503+0000","last_peered":"2024-04-25T12:21:29.167503+0000","last_clean":"2024-04-25T12:21:29.167503+0000","last_became_active":"2024-04-25T12:21:28.193277+0000","last_became_peered":"2024-04-25T12:21:28.193277+0000","last_unstale":"2024-04-25T12:21:29.167503+0000","last_undegraded":"2024-04-25T12:21:29.167503+0000","last_fullsized":"2024-04-25T12:21:29.167503+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:31.495441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547391+0000","last_change":"2024-04-25T12:21:24.115104+0000","last_active":"2024-04-25T12:21:29.547391+0000","last_peered":"2024-04-25T12:21:29.547391+0000","last_clean":"2024-04-25T12:21:29.547391+0000","last_became_active":"2024-04-25T12:21:24.114367+0000","last_became_peered":"2024-04-25T12:21:24.114367+0000","last_unstale":"2024-04-25T12:21:29.547391+0000","last_undegraded":"2024-04-25T12:21:29.547391+0000","last_fullsized":"2024-04-25T12:21:29.547391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:03.107076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.168564+0000","last_change":"2024-04-25T12:21:23.132996+0000","last_active":"2024-04-25T12:21:29.168564+0000","last_peered":"2024-04-25T12:21:29.168564+0000","last_clean":"2024-04-25T12:21:29.168564+0000","last_became_active":"2024-04-25T12:21:23.132223+0000","last_became_peered":"2024-04-25T12:21:23.132223+0000","last_unstale":"2024-04-25T12:21:29.168564+0000","last_undegraded":"2024-04-25T12:21:29.168564+0000","last_fullsized":"2024-04-25T12:21:29.168564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:18.689461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.285114+0000","last_change":"2024-04-25T12:21:28.203302+0000","last_active":"2024-04-25T12:21:29.285114+0000","last_peered":"2024-04-25T12:21:29.285114+0000","last_clean":"2024-04-25T12:21:29.285114+0000","last_became_active":"2024-04-25T12:21:28.202800+0000","last_became_peered":"2024-04-25T12:21:28.202800+0000","last_unstale":"2024-04-25T12:21:29.285114+0000","last_undegraded":"2024-04-25T12:21:29.285114+0000","last_fullsized":"2024-04-25T12:21:29.285114+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:27:16.676736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.169161+0000","last_change":"2024-04-25T12:21:24.142716+0000","last_active":"2024-04-25T12:21:29.169161+0000","last_peered":"2024-04-25T12:21:29.169161+0000","last_clean":"2024-04-25T12:21:29.169161+0000","last_became_active":"2024-04-25T12:21:24.142363+0000","last_became_peered":"2024-04-25T12:21:24.142363+0000","last_unstale":"2024-04-25T12:21:29.169161+0000","last_undegraded":"2024-04-25T12:21:29.169161+0000","last_fullsized":"2024-04-25T12:21:29.169161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:02.153025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.281923+0000","last_change":"2024-04-25T12:21:23.130843+0000","last_active":"2024-04-25T12:21:29.281923+0000","last_peered":"2024-04-25T12:21:29.281923+0000","last_clean":"2024-04-25T12:21:29.281923+0000","last_became_active":"2024-04-25T12:21:23.129967+0000","last_became_peered":"2024-04-25T12:21:23.129967+0000","last_unstale":"2024-04-25T12:21:29.281923+0000","last_undegraded":"2024-04-25T12:21:29.281923+0000","last_fullsized":"2024-04-25T12:21:29.281923+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:19:22.719364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.285047+0000","last_change":"2024-04-25T12:21:28.384082+0000","last_active":"2024-04-25T12:21:29.285047+0000","last_peered":"2024-04-25T12:21:29.285047+0000","last_clean":"2024-04-25T12:21:29.285047+0000","last_became_active":"2024-04-25T12:21:28.383228+0000","last_became_peered":"2024-04-25T12:21:28.383228+0000","last_unstale":"2024-04-25T12:21:29.285047+0000","last_undegraded":"2024-04-25T12:21:29.285047+0000","last_fullsized":"2024-04-25T12:21:29.285047+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:14.600341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547535+0000","last_change":"2024-04-25T12:21:28.378352+0000","last_active":"2024-04-25T12:21:29.547535+0000","last_peered":"2024-04-25T12:21:29.547535+0000","last_clean":"2024-04-25T12:21:29.547535+0000","last_became_active":"2024-04-25T12:21:28.377742+0000","last_became_peered":"2024-04-25T12:21:28.377742+0000","last_unstale":"2024-04-25T12:21:29.547535+0000","last_undegraded":"2024-04-25T12:21:29.547535+0000","last_fullsized":"2024-04-25T12:21:29.547535+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:20.075296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.546465+0000","last_change":"2024-04-25T12:21:24.126158+0000","last_active":"2024-04-25T12:21:29.546465+0000","last_peered":"2024-04-25T12:21:29.546465+0000","last_clean":"2024-04-25T12:21:29.546465+0000","last_became_active":"2024-04-25T12:21:24.125448+0000","last_became_peered":"2024-04-25T12:21:24.125448+0000","last_unstale":"2024-04-25T12:21:29.546465+0000","last_undegraded":"2024-04-25T12:21:29.546465+0000","last_fullsized":"2024-04-25T12:21:29.546465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:42.769206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.168026+0000","last_change":"2024-04-25T12:21:23.117159+0000","last_active":"2024-04-25T12:21:29.168026+0000","last_peered":"2024-04-25T12:21:29.168026+0000","last_clean":"2024-04-25T12:21:29.168026+0000","last_became_active":"2024-04-25T12:21:23.115911+0000","last_became_peered":"2024-04-25T12:21:23.115911+0000","last_unstale":"2024-04-25T12:21:29.168026+0000","last_undegraded":"2024-04-25T12:21:29.168026+0000","last_fullsized":"2024-04-25T12:21:29.168026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:46:10.238958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.281751+0000","last_change":"2024-04-25T12:21:28.205952+0000","last_active":"2024-04-25T12:21:29.281751+0000","last_peered":"2024-04-25T12:21:29.281751+0000","last_clean":"2024-04-25T12:21:29.281751+0000","last_became_active":"2024-04-25T12:21:28.204472+0000","last_became_peered":"2024-04-25T12:21:28.204472+0000","last_unstale":"2024-04-25T12:21:29.281751+0000","last_undegraded":"2024-04-25T12:21:29.281751+0000","last_fullsized":"2024-04-25T12:21:29.281751+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:16:03.460343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.285501+0000","last_change":"2024-04-25T12:21:24.137477+0000","last_active":"2024-04-25T12:21:29.285501+0000","last_peered":"2024-04-25T12:21:29.285501+0000","last_clean":"2024-04-25T12:21:29.285501+0000","last_became_active":"2024-04-25T12:21:24.137078+0000","last_became_peered":"2024-04-25T12:21:24.137078+0000","last_unstale":"2024-04-25T12:21:29.285501+0000","last_undegraded":"2024-04-25T12:21:29.285501+0000","last_fullsized":"2024-04-25T12:21:29.285501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:53.321239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.285357+0000","last_change":"2024-04-25T12:21:23.130046+0000","last_active":"2024-04-25T12:21:29.285357+0000","last_peered":"2024-04-25T12:21:29.285357+0000","last_clean":"2024-04-25T12:21:29.285357+0000","last_became_active":"2024-04-25T12:21:23.129779+0000","last_became_peered":"2024-04-25T12:21:23.129779+0000","last_unstale":"2024-04-25T12:21:29.285357+0000","last_undegraded":"2024-04-25T12:21:29.285357+0000","last_fullsized":"2024-04-25T12:21:29.285357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:24:43.733780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.281044+0000","last_change":"2024-04-25T12:21:23.138152+0000","last_active":"2024-04-25T12:21:29.281044+0000","last_peered":"2024-04-25T12:21:29.281044+0000","last_clean":"2024-04-25T12:21:29.281044+0000","last_became_active":"2024-04-25T12:21:23.137393+0000","last_became_peered":"2024-04-25T12:21:23.137393+0000","last_unstale":"2024-04-25T12:21:29.281044+0000","last_undegraded":"2024-04-25T12:21:29.281044+0000","last_fullsized":"2024-04-25T12:21:29.281044+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:10:42.713304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547129+0000","last_change":"2024-04-25T12:21:24.122299+0000","last_active":"2024-04-25T12:21:29.547129+0000","last_peered":"2024-04-25T12:21:29.547129+0000","last_clean":"2024-04-25T12:21:29.547129+0000","last_became_active":"2024-04-25T12:21:24.121480+0000","last_became_peered":"2024-04-25T12:21:24.121480+0000","last_unstale":"2024-04-25T12:21:29.547129+0000","last_undegraded":"2024-04-25T12:21:29.547129+0000","last_fullsized":"2024-04-25T12:21:29.547129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:05:46.050357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.166540+0000","last_change":"2024-04-25T12:21:28.183735+0000","last_active":"2024-04-25T12:21:29.166540+0000","last_peered":"2024-04-25T12:21:29.166540+0000","last_clean":"2024-04-25T12:21:29.166540+0000","last_became_active":"2024-04-25T12:21:28.183319+0000","last_became_peered":"2024-04-25T12:21:28.183319+0000","last_unstale":"2024-04-25T12:21:29.166540+0000","last_undegraded":"2024-04-25T12:21:29.166540+0000","last_fullsized":"2024-04-25T12:21:29.166540+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:42:14.120075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.285705+0000","last_change":"2024-04-25T12:21:23.113080+0000","last_active":"2024-04-25T12:21:29.285705+0000","last_peered":"2024-04-25T12:21:29.285705+0000","last_clean":"2024-04-25T12:21:29.285705+0000","last_became_active":"2024-04-25T12:21:23.112721+0000","last_became_peered":"2024-04-25T12:21:23.112721+0000","last_unstale":"2024-04-25T12:21:29.285705+0000","last_undegraded":"2024-04-25T12:21:29.285705+0000","last_fullsized":"2024-04-25T12:21:29.285705+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:25.396377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.167162+0000","last_change":"2024-04-25T12:21:24.134267+0000","last_active":"2024-04-25T12:21:29.167162+0000","last_peered":"2024-04-25T12:21:29.167162+0000","last_clean":"2024-04-25T12:21:29.167162+0000","last_became_active":"2024-04-25T12:21:24.133493+0000","last_became_peered":"2024-04-25T12:21:24.133493+0000","last_unstale":"2024-04-25T12:21:29.167162+0000","last_undegraded":"2024-04-25T12:21:29.167162+0000","last_fullsized":"2024-04-25T12:21:29.167162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:24:25.810067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.286483+0000","last_change":"2024-04-25T12:21:28.188314+0000","last_active":"2024-04-25T12:21:29.286483+0000","last_peered":"2024-04-25T12:21:29.286483+0000","last_clean":"2024-04-25T12:21:29.286483+0000","last_became_active":"2024-04-25T12:21:28.187955+0000","last_became_peered":"2024-04-25T12:21:28.187955+0000","last_unstale":"2024-04-25T12:21:29.286483+0000","last_undegraded":"2024-04-25T12:21:29.286483+0000","last_fullsized":"2024-04-25T12:21:29.286483+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:17.889868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.280334+0000","last_change":"2024-04-25T12:21:24.126582+0000","last_active":"2024-04-25T12:21:29.280334+0000","last_peered":"2024-04-25T12:21:29.280334+0000","last_clean":"2024-04-25T12:21:29.280334+0000","last_became_active":"2024-04-25T12:21:24.125831+0000","last_became_peered":"2024-04-25T12:21:24.125831+0000","last_unstale":"2024-04-25T12:21:29.280334+0000","last_undegraded":"2024-04-25T12:21:29.280334+0000","last_fullsized":"2024-04-25T12:21:29.280334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:53.129274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.166193+0000","last_change":"2024-04-25T12:21:24.117441+0000","last_active":"2024-04-25T12:21:29.166193+0000","last_peered":"2024-04-25T12:21:29.166193+0000","last_clean":"2024-04-25T12:21:29.166193+0000","last_became_active":"2024-04-25T12:21:24.116498+0000","last_became_peered":"2024-04-25T12:21:24.116498+0000","last_unstale":"2024-04-25T12:21:29.166193+0000","last_undegraded":"2024-04-25T12:21:29.166193+0000","last_fullsized":"2024-04-25T12:21:29.166193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:06:45.632199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.167962+0000","last_change":"2024-04-25T12:21:24.117995+0000","last_active":"2024-04-25T12:21:29.167962+0000","last_peered":"2024-04-25T12:21:29.167962+0000","last_clean":"2024-04-25T12:21:29.167962+0000","last_became_active":"2024-04-25T12:21:24.114742+0000","last_became_peered":"2024-04-25T12:21:24.114742+0000","last_unstale":"2024-04-25T12:21:29.167962+0000","last_undegraded":"2024-04-25T12:21:29.167962+0000","last_fullsized":"2024-04-25T12:21:29.167962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:59.864082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547009+0000","last_change":"2024-04-25T12:21:24.134863+0000","last_active":"2024-04-25T12:21:29.547009+0000","last_peered":"2024-04-25T12:21:29.547009+0000","last_clean":"2024-04-25T12:21:29.547009+0000","last_became_active":"2024-04-25T12:21:24.126476+0000","last_became_peered":"2024-04-25T12:21:24.126476+0000","last_unstale":"2024-04-25T12:21:29.547009+0000","last_undegraded":"2024-04-25T12:21:29.547009+0000","last_fullsized":"2024-04-25T12:21:29.547009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:19:32.516429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.286222+0000","last_change":"2024-04-25T12:21:24.135699+0000","last_active":"2024-04-25T12:21:29.286222+0000","last_peered":"2024-04-25T12:21:29.286222+0000","last_clean":"2024-04-25T12:21:29.286222+0000","last_became_active":"2024-04-25T12:21:24.135257+0000","last_became_peered":"2024-04-25T12:21:24.135257+0000","last_unstale":"2024-04-25T12:21:29.286222+0000","last_undegraded":"2024-04-25T12:21:29.286222+0000","last_fullsized":"2024-04-25T12:21:29.286222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:55:21.195220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547552+0000","last_change":"2024-04-25T12:21:24.132760+0000","last_active":"2024-04-25T12:21:29.547552+0000","last_peered":"2024-04-25T12:21:29.547552+0000","last_clean":"2024-04-25T12:21:29.547552+0000","last_became_active":"2024-04-25T12:21:24.132225+0000","last_became_peered":"2024-04-25T12:21:24.132225+0000","last_unstale":"2024-04-25T12:21:29.547552+0000","last_undegraded":"2024-04-25T12:21:29.547552+0000","last_fullsized":"2024-04-25T12:21:29.547552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:44:23.025905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.281911+0000","last_change":"2024-04-25T12:21:24.148515+0000","last_active":"2024-04-25T12:21:29.281911+0000","last_peered":"2024-04-25T12:21:29.281911+0000","last_clean":"2024-04-25T12:21:29.281911+0000","last_became_active":"2024-04-25T12:21:24.148025+0000","last_became_peered":"2024-04-25T12:21:24.148025+0000","last_unstale":"2024-04-25T12:21:29.281911+0000","last_undegraded":"2024-04-25T12:21:29.281911+0000","last_fullsized":"2024-04-25T12:21:29.281911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:49:29.665678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.286467+0000","last_change":"2024-04-25T12:21:24.135856+0000","last_active":"2024-04-25T12:21:29.286467+0000","last_peered":"2024-04-25T12:21:29.286467+0000","last_clean":"2024-04-25T12:21:29.286467+0000","last_became_active":"2024-04-25T12:21:24.135310+0000","last_became_peered":"2024-04-25T12:21:24.135310+0000","last_unstale":"2024-04-25T12:21:29.286467+0000","last_undegraded":"2024-04-25T12:21:29.286467+0000","last_fullsized":"2024-04-25T12:21:29.286467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:02.396753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.167926+0000","last_change":"2024-04-25T12:21:24.119002+0000","last_active":"2024-04-25T12:21:29.167926+0000","last_peered":"2024-04-25T12:21:29.167926+0000","last_clean":"2024-04-25T12:21:29.167926+0000","last_became_active":"2024-04-25T12:21:24.112992+0000","last_became_peered":"2024-04-25T12:21:24.112992+0000","last_unstale":"2024-04-25T12:21:29.167926+0000","last_undegraded":"2024-04-25T12:21:29.167926+0000","last_fullsized":"2024-04-25T12:21:29.167926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:44:34.461656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.285101+0000","last_change":"2024-04-25T12:21:24.118251+0000","last_active":"2024-04-25T12:21:29.285101+0000","last_peered":"2024-04-25T12:21:29.285101+0000","last_clean":"2024-04-25T12:21:29.285101+0000","last_became_active":"2024-04-25T12:21:24.117412+0000","last_became_peered":"2024-04-25T12:21:24.117412+0000","last_unstale":"2024-04-25T12:21:29.285101+0000","last_undegraded":"2024-04-25T12:21:29.285101+0000","last_fullsized":"2024-04-25T12:21:29.285101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:44:13.238510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.167670+0000","last_change":"2024-04-25T12:21:24.138641+0000","last_active":"2024-04-25T12:21:29.167670+0000","last_peered":"2024-04-25T12:21:29.167670+0000","last_clean":"2024-04-25T12:21:29.167670+0000","last_became_active":"2024-04-25T12:21:24.137937+0000","last_became_peered":"2024-04-25T12:21:24.137937+0000","last_unstale":"2024-04-25T12:21:29.167670+0000","last_undegraded":"2024-04-25T12:21:29.167670+0000","last_fullsized":"2024-04-25T12:21:29.167670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:55:49.291319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.546657+0000","last_change":"2024-04-25T12:21:24.137779+0000","last_active":"2024-04-25T12:21:29.546657+0000","last_peered":"2024-04-25T12:21:29.546657+0000","last_clean":"2024-04-25T12:21:29.546657+0000","last_became_active":"2024-04-25T12:21:24.137431+0000","last_became_peered":"2024-04-25T12:21:24.137431+0000","last_unstale":"2024-04-25T12:21:29.546657+0000","last_undegraded":"2024-04-25T12:21:29.546657+0000","last_fullsized":"2024-04-25T12:21:29.546657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:24:24.181972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.281098+0000","last_change":"2024-04-25T12:21:24.128960+0000","last_active":"2024-04-25T12:21:29.281098+0000","last_peered":"2024-04-25T12:21:29.281098+0000","last_clean":"2024-04-25T12:21:29.281098+0000","last_became_active":"2024-04-25T12:21:24.128125+0000","last_became_peered":"2024-04-25T12:21:24.128125+0000","last_unstale":"2024-04-25T12:21:29.281098+0000","last_undegraded":"2024-04-25T12:21:29.281098+0000","last_fullsized":"2024-04-25T12:21:29.281098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:01.701850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.550097+0000","last_change":"2024-04-25T12:21:24.149001+0000","last_active":"2024-04-25T12:21:29.550097+0000","last_peered":"2024-04-25T12:21:29.550097+0000","last_clean":"2024-04-25T12:21:29.550097+0000","last_became_active":"2024-04-25T12:21:24.147230+0000","last_became_peered":"2024-04-25T12:21:24.147230+0000","last_unstale":"2024-04-25T12:21:29.550097+0000","last_undegraded":"2024-04-25T12:21:29.550097+0000","last_fullsized":"2024-04-25T12:21:29.550097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:05:17.824845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.166871+0000","last_change":"2024-04-25T12:21:24.119941+0000","last_active":"2024-04-25T12:21:29.166871+0000","last_peered":"2024-04-25T12:21:29.166871+0000","last_clean":"2024-04-25T12:21:29.166871+0000","last_became_active":"2024-04-25T12:21:24.118761+0000","last_became_peered":"2024-04-25T12:21:24.118761+0000","last_unstale":"2024-04-25T12:21:29.166871+0000","last_undegraded":"2024-04-25T12:21:29.166871+0000","last_fullsized":"2024-04-25T12:21:29.166871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:49:41.353812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.168941+0000","last_change":"2024-04-25T12:21:24.144163+0000","last_active":"2024-04-25T12:21:29.168941+0000","last_peered":"2024-04-25T12:21:29.168941+0000","last_clean":"2024-04-25T12:21:29.168941+0000","last_became_active":"2024-04-25T12:21:24.143786+0000","last_became_peered":"2024-04-25T12:21:24.143786+0000","last_unstale":"2024-04-25T12:21:29.168941+0000","last_undegraded":"2024-04-25T12:21:29.168941+0000","last_fullsized":"2024-04-25T12:21:29.168941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:17.961437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.167895+0000","last_change":"2024-04-25T12:21:24.107551+0000","last_active":"2024-04-25T12:21:29.167895+0000","last_peered":"2024-04-25T12:21:29.167895+0000","last_clean":"2024-04-25T12:21:29.167895+0000","last_became_active":"2024-04-25T12:21:24.106818+0000","last_became_peered":"2024-04-25T12:21:24.106818+0000","last_unstale":"2024-04-25T12:21:29.167895+0000","last_undegraded":"2024-04-25T12:21:29.167895+0000","last_fullsized":"2024-04-25T12:21:29.167895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:09:24.627007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.546570+0000","last_change":"2024-04-25T12:21:24.114917+0000","last_active":"2024-04-25T12:21:29.546570+0000","last_peered":"2024-04-25T12:21:29.546570+0000","last_clean":"2024-04-25T12:21:29.546570+0000","last_became_active":"2024-04-25T12:21:24.114237+0000","last_became_peered":"2024-04-25T12:21:24.114237+0000","last_unstale":"2024-04-25T12:21:29.546570+0000","last_undegraded":"2024-04-25T12:21:29.546570+0000","last_fullsized":"2024-04-25T12:21:29.546570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:32:38.296553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.546685+0000","last_change":"2024-04-25T12:21:24.132860+0000","last_active":"2024-04-25T12:21:29.546685+0000","last_peered":"2024-04-25T12:21:29.546685+0000","last_clean":"2024-04-25T12:21:29.546685+0000","last_became_active":"2024-04-25T12:21:24.132094+0000","last_became_peered":"2024-04-25T12:21:24.132094+0000","last_unstale":"2024-04-25T12:21:29.546685+0000","last_undegraded":"2024-04-25T12:21:29.546685+0000","last_fullsized":"2024-04-25T12:21:29.546685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:27:24.026145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.285468+0000","last_change":"2024-04-25T12:21:24.118083+0000","last_active":"2024-04-25T12:21:29.285468+0000","last_peered":"2024-04-25T12:21:29.285468+0000","last_clean":"2024-04-25T12:21:29.285468+0000","last_became_active":"2024-04-25T12:21:24.116766+0000","last_became_peered":"2024-04-25T12:21:24.116766+0000","last_unstale":"2024-04-25T12:21:29.285468+0000","last_undegraded":"2024-04-25T12:21:29.285468+0000","last_fullsized":"2024-04-25T12:21:29.285468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:02.432868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.167503+0000","last_change":"2024-04-25T12:21:24.124288+0000","last_active":"2024-04-25T12:21:29.167503+0000","last_peered":"2024-04-25T12:21:29.167503+0000","last_clean":"2024-04-25T12:21:29.167503+0000","last_became_active":"2024-04-25T12:21:24.116973+0000","last_became_peered":"2024-04-25T12:21:24.116973+0000","last_unstale":"2024-04-25T12:21:29.167503+0000","last_undegraded":"2024-04-25T12:21:29.167503+0000","last_fullsized":"2024-04-25T12:21:29.167503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:34:53.390321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.281584+0000","last_change":"2024-04-25T12:21:24.115615+0000","last_active":"2024-04-25T12:21:29.281584+0000","last_peered":"2024-04-25T12:21:29.281584+0000","last_clean":"2024-04-25T12:21:29.281584+0000","last_became_active":"2024-04-25T12:21:24.114829+0000","last_became_peered":"2024-04-25T12:21:24.114829+0000","last_unstale":"2024-04-25T12:21:29.281584+0000","last_undegraded":"2024-04-25T12:21:29.281584+0000","last_fullsized":"2024-04-25T12:21:29.281584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:17.961437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.281900+0000","last_change":"2024-04-25T12:21:24.117225+0000","last_active":"2024-04-25T12:21:29.281900+0000","last_peered":"2024-04-25T12:21:29.281900+0000","last_clean":"2024-04-25T12:21:29.281900+0000","last_became_active":"2024-04-25T12:21:24.116359+0000","last_became_peered":"2024-04-25T12:21:24.116359+0000","last_unstale":"2024-04-25T12:21:29.281900+0000","last_undegraded":"2024-04-25T12:21:29.281900+0000","last_fullsized":"2024-04-25T12:21:29.281900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:22:27.461512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.550024+0000","last_change":"2024-04-25T12:21:24.145198+0000","last_active":"2024-04-25T12:21:29.550024+0000","last_peered":"2024-04-25T12:21:29.550024+0000","last_clean":"2024-04-25T12:21:29.550024+0000","last_became_active":"2024-04-25T12:21:24.142353+0000","last_became_peered":"2024-04-25T12:21:24.142353+0000","last_unstale":"2024-04-25T12:21:29.550024+0000","last_undegraded":"2024-04-25T12:21:29.550024+0000","last_fullsized":"2024-04-25T12:21:29.550024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:44:24.335226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.285030+0000","last_change":"2024-04-25T12:21:24.128086+0000","last_active":"2024-04-25T12:21:29.285030+0000","last_peered":"2024-04-25T12:21:29.285030+0000","last_clean":"2024-04-25T12:21:29.285030+0000","last_became_active":"2024-04-25T12:21:24.127315+0000","last_became_peered":"2024-04-25T12:21:24.127315+0000","last_unstale":"2024-04-25T12:21:29.285030+0000","last_undegraded":"2024-04-25T12:21:29.285030+0000","last_fullsized":"2024-04-25T12:21:29.285030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:20.513145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.549407+0000","last_change":"2024-04-25T12:21:24.142394+0000","last_active":"2024-04-25T12:21:29.549407+0000","last_peered":"2024-04-25T12:21:29.549407+0000","last_clean":"2024-04-25T12:21:29.549407+0000","last_became_active":"2024-04-25T12:21:24.142029+0000","last_became_peered":"2024-04-25T12:21:24.142029+0000","last_unstale":"2024-04-25T12:21:29.549407+0000","last_undegraded":"2024-04-25T12:21:29.549407+0000","last_fullsized":"2024-04-25T12:21:29.549407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:02:56.129724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.167820+0000","last_change":"2024-04-25T12:21:24.113876+0000","last_active":"2024-04-25T12:21:29.167820+0000","last_peered":"2024-04-25T12:21:29.167820+0000","last_clean":"2024-04-25T12:21:29.167820+0000","last_became_active":"2024-04-25T12:21:24.112339+0000","last_became_peered":"2024-04-25T12:21:24.112339+0000","last_unstale":"2024-04-25T12:21:29.167820+0000","last_undegraded":"2024-04-25T12:21:29.167820+0000","last_fullsized":"2024-04-25T12:21:29.167820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:31:44.641068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.549669+0000","last_change":"2024-04-25T12:21:24.144879+0000","last_active":"2024-04-25T12:21:29.549669+0000","last_peered":"2024-04-25T12:21:29.549669+0000","last_clean":"2024-04-25T12:21:29.549669+0000","last_became_active":"2024-04-25T12:21:24.142422+0000","last_became_peered":"2024-04-25T12:21:24.142422+0000","last_unstale":"2024-04-25T12:21:29.549669+0000","last_undegraded":"2024-04-25T12:21:29.549669+0000","last_fullsized":"2024-04-25T12:21:29.549669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:03.206429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.168142+0000","last_change":"2024-04-25T12:21:24.132561+0000","last_active":"2024-04-25T12:21:29.168142+0000","last_peered":"2024-04-25T12:21:29.168142+0000","last_clean":"2024-04-25T12:21:29.168142+0000","last_became_active":"2024-04-25T12:21:24.131746+0000","last_became_peered":"2024-04-25T12:21:24.131746+0000","last_unstale":"2024-04-25T12:21:29.168142+0000","last_undegraded":"2024-04-25T12:21:29.168142+0000","last_fullsized":"2024-04-25T12:21:29.168142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:24.441417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.546747+0000","last_change":"2024-04-25T12:21:24.111956+0000","last_active":"2024-04-25T12:21:29.546747+0000","last_peered":"2024-04-25T12:21:29.546747+0000","last_clean":"2024-04-25T12:21:29.546747+0000","last_became_active":"2024-04-25T12:21:24.111154+0000","last_became_peered":"2024-04-25T12:21:24.111154+0000","last_unstale":"2024-04-25T12:21:29.546747+0000","last_undegraded":"2024-04-25T12:21:29.546747+0000","last_fullsized":"2024-04-25T12:21:29.546747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:39:56.070884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.548238+0000","last_change":"2024-04-25T12:21:24.134511+0000","last_active":"2024-04-25T12:21:29.548238+0000","last_peered":"2024-04-25T12:21:29.548238+0000","last_clean":"2024-04-25T12:21:29.548238+0000","last_became_active":"2024-04-25T12:21:24.133839+0000","last_became_peered":"2024-04-25T12:21:24.133839+0000","last_unstale":"2024-04-25T12:21:29.548238+0000","last_undegraded":"2024-04-25T12:21:29.548238+0000","last_fullsized":"2024-04-25T12:21:29.548238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:43.263673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.549724+0000","last_change":"2024-04-25T12:21:24.147519+0000","last_active":"2024-04-25T12:21:29.549724+0000","last_peered":"2024-04-25T12:21:29.549724+0000","last_clean":"2024-04-25T12:21:29.549724+0000","last_became_active":"2024-04-25T12:21:24.146805+0000","last_became_peered":"2024-04-25T12:21:24.146805+0000","last_unstale":"2024-04-25T12:21:29.549724+0000","last_undegraded":"2024-04-25T12:21:29.549724+0000","last_fullsized":"2024-04-25T12:21:29.549724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:23.200746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T12:21:59.481 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T12:21:59.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.626+0000 7f4d27e4c640 1 Processor -- start 2024-04-25T12:21:59.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.626+0000 7f4d27e4c640 1 -- start start 2024-04-25T12:21:59.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.626+0000 7f4d27e4c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d20074100 0x7f4d2006f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:59.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.626+0000 7f4d27e4c640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d200c5d70 con 0x7f4d2014ffa0 2024-04-25T12:21:59.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.626+0000 7f4d27e4c640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d200c6050 con 0x7f4d2014fbc0 2024-04-25T12:21:59.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.626+0000 7f4d27e4c640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f4d200c6330 con 0x7f4d20074100 2024-04-25T12:21:59.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.626+0000 7f4d253e7640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f4d2014ffa0 0x7f4d200c7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:40978/0 (socket says 172.21.15.86:40978) 2024-04-25T12:21:59.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.626+0000 7f4d253e7640 1 -- 172.21.15.86:0/2391071603 learned_addr learned my addr 172.21.15.86:0/2391071603 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-04-25T12:21:59.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.626+0000 7f4d263e9640 1 --2- 172.21.15.86:0/2391071603 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d20074100 0x7f4d2006f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:59.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.626+0000 7f4d24be6640 1 -- 172.21.15.86:0/2391071603 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1259363210 0 0) 0x7f4d200c5d70 con 0x7f4d2014ffa0 2024-04-25T12:21:59.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.626+0000 7f4d24be6640 1 -- 172.21.15.86:0/2391071603 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d0c003530 con 0x7f4d2014ffa0 2024-04-25T12:21:59.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.626+0000 7f4d24be6640 1 -- 172.21.15.86:0/2391071603 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 210610752 0 0) 0x7f4d200c6050 con 0x7f4d2014fbc0 2024-04-25T12:21:59.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.626+0000 7f4d24be6640 1 -- 172.21.15.86:0/2391071603 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d200c5d70 con 0x7f4d2014fbc0 2024-04-25T12:21:59.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.626+0000 7f4d24be6640 1 -- 172.21.15.86:0/2391071603 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3793074474 0 0) 0x7f4d0c003530 con 0x7f4d2014ffa0 2024-04-25T12:21:59.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.626+0000 7f4d24be6640 1 -- 172.21.15.86:0/2391071603 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d20074100 msgr2=0x7f4d2006f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:59.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.626+0000 7f4d24be6640 1 --2- 172.21.15.86:0/2391071603 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d20074100 0x7f4d2006f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.626+0000 7f4d24be6640 1 -- 172.21.15.86:0/2391071603 >> v1:172.21.15.134:6789/0 conn(0x7f4d2014fbc0 legacy=0x7f4d200c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:59.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.626+0000 7f4d24be6640 1 -- 172.21.15.86:0/2391071603 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d200c6610 con 0x7f4d2014ffa0 2024-04-25T12:21:59.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.626+0000 7f4d24be6640 1 -- 172.21.15.86:0/2391071603 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1387950573 0 0) 0x7f4d10001680 con 0x7f4d2014ffa0 2024-04-25T12:21:59.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.626+0000 7f4d263e9640 1 --2- 172.21.15.86:0/2391071603 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d20074100 0x7f4d2006f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T12:21:59.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.626+0000 7f4d24be6640 1 -- 172.21.15.86:0/2391071603 >> v1:172.21.15.86:6789/0 conn(0x7f4d2014ffa0 legacy=0x7f4d200c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:59.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.626+0000 7f4d24be6640 1 --2- 172.21.15.86:0/2391071603 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d20074100 0x7f4d0c003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:59.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.626+0000 7f4d24be6640 1 --2- 172.21.15.86:0/2391071603 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d0c0040c0 0x7f4d0c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:59.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.626+0000 7f4d24be6640 1 --2- 172.21.15.86:0/2391071603 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d0c004d50 0x7f4d0c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:59.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.626+0000 7f4d24be6640 1 -- 172.21.15.86:0/2391071603 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4d200c6330 con 0x7f4d0c004d50 2024-04-25T12:21:59.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.626+0000 7f4d24be6640 1 -- 172.21.15.86:0/2391071603 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4d0c00ba80 con 0x7f4d0c0040c0 2024-04-25T12:21:59.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.626+0000 7f4d24be6640 1 -- 172.21.15.86:0/2391071603 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f4d0c00bc80 con 0x7f4d20074100 2024-04-25T12:21:59.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.626+0000 7f4d263e9640 1 --2- 172.21.15.86:0/2391071603 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d0c004d50 0x7f4d0c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:59.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.626+0000 7f4d253e7640 1 --2- 172.21.15.86:0/2391071603 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d0c0040c0 0x7f4d0c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:59.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.626+0000 7f4d25be8640 1 --2- 172.21.15.86:0/2391071603 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d20074100 0x7f4d0c003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:59.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.626+0000 7f4d263e9640 1 -- 172.21.15.86:0/2391071603 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d20074100 msgr2=0x7f4d0c003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:59.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.626+0000 7f4d263e9640 1 --2- 172.21.15.86:0/2391071603 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d20074100 0x7f4d0c003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.626+0000 7f4d263e9640 1 -- 172.21.15.86:0/2391071603 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d0c0040c0 msgr2=0x7f4d0c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:59.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.626+0000 7f4d263e9640 1 --2- 172.21.15.86:0/2391071603 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d0c0040c0 0x7f4d0c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.626+0000 7f4d263e9640 1 -- 172.21.15.86:0/2391071603 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d0c003530 con 0x7f4d0c004d50 2024-04-25T12:21:59.640 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.630+0000 7f4d263e9640 1 --2- 172.21.15.86:0/2391071603 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d0c004d50 0x7f4d0c0051d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4d2015a080 tx=0x7f4d1801cda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88c64ef583bccb4e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:59.640 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.630+0000 7f4d24be6640 1 -- 172.21.15.86:0/2391071603 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d18009dc0 con 0x7f4d0c004d50 2024-04-25T12:21:59.640 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.630+0000 7f4d24be6640 1 -- 172.21.15.86:0/2391071603 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d180a5ca0 con 0x7f4d0c004d50 2024-04-25T12:21:59.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.630+0000 7f4d24be6640 1 -- 172.21.15.86:0/2391071603 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d18003ba0 con 0x7f4d0c004d50 2024-04-25T12:21:59.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.630+0000 7f4d27e4c640 1 -- 172.21.15.86:0/2391071603 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d0c004d50 msgr2=0x7f4d0c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:59.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.630+0000 7f4d27e4c640 1 --2- 172.21.15.86:0/2391071603 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d0c004d50 0x7f4d0c0051d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4d2015a080 tx=0x7f4d1801cda0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.630+0000 7f4d263e9640 1 -- 172.21.15.86:0/2391071603 reap_dead start 2024-04-25T12:21:59.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.630+0000 7f4d27e4c640 1 -- 172.21.15.86:0/2391071603 shutdown_connections 2024-04-25T12:21:59.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.630+0000 7f4d27e4c640 1 -- 172.21.15.86:0/2391071603 >> 172.21.15.86:0/2391071603 conn(0x7f4d2006b9d0 msgr2=0x7f4d2006bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:59.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.630+0000 7f4d27e4c640 1 -- 172.21.15.86:0/2391071603 shutdown_connections 2024-04-25T12:21:59.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.630+0000 7f4d27e4c640 1 -- 172.21.15.86:0/2391071603 wait complete. 2024-04-25T12:21:59.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.630+0000 7f4d27e4c640 1 Processor -- start 2024-04-25T12:21:59.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.630+0000 7f4d27e4c640 1 -- start start 2024-04-25T12:21:59.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.630+0000 7f4d27e4c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d0c004d50 0x7f4d201e2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:59.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.630+0000 7f4d27e4c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d20148ef0 0x7f4d200ba6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:59.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.630+0000 7f4d27e4c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d200bac30 0x7f4d201483a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:59.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.630+0000 7f4d27e4c640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4d20068350 con 0x7f4d200bac30 2024-04-25T12:21:59.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.630+0000 7f4d27e4c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4d200681d0 con 0x7f4d0c004d50 2024-04-25T12:21:59.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.630+0000 7f4d27e4c640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f4d200c8930 con 0x7f4d20148ef0 2024-04-25T12:21:59.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.630+0000 7f4d263e9640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d200bac30 0x7f4d201483a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:59.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.630+0000 7f4d263e9640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d200bac30 0x7f4d201483a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:59628/0 (socket says 172.21.15.86:59628) 2024-04-25T12:21:59.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.630+0000 7f4d263e9640 1 -- 172.21.15.86:0/854129565 learned_addr learned my addr 172.21.15.86:0/854129565 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:59.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.630+0000 7f4d253e7640 1 --2- 172.21.15.86:0/854129565 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d20148ef0 0x7f4d200ba6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:59.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.630+0000 7f4d25be8640 1 --2- 172.21.15.86:0/854129565 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d0c004d50 0x7f4d201e2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:59.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.630+0000 7f4d263e9640 1 -- 172.21.15.86:0/854129565 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d20148ef0 msgr2=0x7f4d200ba6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:59.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.630+0000 7f4d263e9640 1 --2- 172.21.15.86:0/854129565 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d20148ef0 0x7f4d200ba6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.630+0000 7f4d263e9640 1 -- 172.21.15.86:0/854129565 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d0c004d50 msgr2=0x7f4d201e2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:59.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.630+0000 7f4d263e9640 1 --2- 172.21.15.86:0/854129565 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d0c004d50 0x7f4d201e2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.630+0000 7f4d263e9640 1 -- 172.21.15.86:0/854129565 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d201ef1c0 con 0x7f4d200bac30 2024-04-25T12:21:59.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.634+0000 7f4d263e9640 1 --2- 172.21.15.86:0/854129565 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d200bac30 0x7f4d201483a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4d1801c810 tx=0x7f4d18009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:59.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.634+0000 7f4d167fc640 1 -- 172.21.15.86:0/854129565 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d18009dc0 con 0x7f4d200bac30 2024-04-25T12:21:59.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.634+0000 7f4d167fc640 1 -- 172.21.15.86:0/854129565 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d180bd070 con 0x7f4d200bac30 2024-04-25T12:21:59.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.634+0000 7f4d27e4c640 1 -- 172.21.15.86:0/854129565 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d201ef4a0 con 0x7f4d200bac30 2024-04-25T12:21:59.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.634+0000 7f4d167fc640 1 -- 172.21.15.86:0/854129565 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d18003e60 con 0x7f4d200bac30 2024-04-25T12:21:59.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.634+0000 7f4d27e4c640 1 -- 172.21.15.86:0/854129565 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d2015b690 con 0x7f4d200bac30 2024-04-25T12:21:59.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.634+0000 7f4d27e4c640 1 -- 172.21.15.86:0/854129565 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d20075df0 con 0x7f4d200bac30 2024-04-25T12:21:59.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.634+0000 7f4d167fc640 1 -- 172.21.15.86:0/854129565 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4d18004470 con 0x7f4d200bac30 2024-04-25T12:21:59.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.634+0000 7f4d167fc640 1 --2- 172.21.15.86:0/854129565 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f4d04068380 0x7f4d0406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:59.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.634+0000 7f4d25be8640 1 --2- 172.21.15.86:0/854129565 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f4d04068380 0x7f4d0406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:59.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.634+0000 7f4d167fc640 1 -- 172.21.15.86:0/854129565 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f4d18121cd0 con 0x7f4d200bac30 2024-04-25T12:21:59.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.634+0000 7f4d25be8640 1 --2- 172.21.15.86:0/854129565 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f4d04068380 0x7f4d0406a840 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c007af0 tx=0x7f4d1c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:59.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.638+0000 7f4d167fc640 1 -- 172.21.15.86:0/854129565 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4d18016ab0 con 0x7f4d200bac30 2024-04-25T12:21:59.794 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.786+0000 7f4d27e4c640 1 -- 172.21.15.86:0/854129565 --> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4d200c7df0 con 0x7f4d04068380 2024-04-25T12:21:59.808 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.802+0000 7f4d167fc640 1 -- 172.21.15.86:0/854129565 <== mgr.4107 v2:172.21.15.86:6832/3708662606 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332533 (secure 0 0 0) 0x7f4d200c7df0 con 0x7f4d04068380 2024-04-25T12:21:59.811 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:21:59.813 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2024-04-25T12:21:59.814 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.806+0000 7f4d27e4c640 1 -- 172.21.15.86:0/854129565 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f4d04068380 msgr2=0x7f4d0406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:59.815 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.806+0000 7f4d27e4c640 1 --2- 172.21.15.86:0/854129565 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f4d04068380 0x7f4d0406a840 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c007af0 tx=0x7f4d1c009040 comp rx=0 tx=0).stop 2024-04-25T12:21:59.815 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.806+0000 7f4d27e4c640 1 -- 172.21.15.86:0/854129565 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d200bac30 msgr2=0x7f4d201483a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:59.815 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.806+0000 7f4d27e4c640 1 --2- 172.21.15.86:0/854129565 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d200bac30 0x7f4d201483a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4d1801c810 tx=0x7f4d18009750 comp rx=0 tx=0).stop 2024-04-25T12:21:59.815 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.806+0000 7f4d27e4c640 1 -- 172.21.15.86:0/854129565 shutdown_connections 2024-04-25T12:21:59.815 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.806+0000 7f4d27e4c640 1 --2- 172.21.15.86:0/854129565 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f4d04068380 0x7f4d0406a840 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.815 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.806+0000 7f4d27e4c640 1 --2- 172.21.15.86:0/854129565 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d200bac30 0x7f4d201483a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.815 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.806+0000 7f4d27e4c640 1 --2- 172.21.15.86:0/854129565 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d20148ef0 0x7f4d200ba6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.815 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.806+0000 7f4d27e4c640 1 --2- 172.21.15.86:0/854129565 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d0c004d50 0x7f4d201e2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.815 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.806+0000 7f4d27e4c640 1 -- 172.21.15.86:0/854129565 >> 172.21.15.86:0/854129565 conn(0x7f4d2006b9d0 msgr2=0x7f4d200ca760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:59.815 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.806+0000 7f4d27e4c640 1 -- 172.21.15.86:0/854129565 shutdown_connections 2024-04-25T12:21:59.815 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.806+0000 7f4d27e4c640 1 -- 172.21.15.86:0/854129565 wait complete. 2024-04-25T12:21:59.828 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2024-04-25T12:21:57.808451+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219400,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755320,"statfs":{"total":773094113280,"available":772869447680,"internally_reserved":0,"allocated":3284992,"data_stored":1992064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004133"},"pg_stats":[{"pgid":"2.1f","version":"23'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547440+0000","last_change":"2024-04-25T12:21:23.124053+0000","last_active":"2024-04-25T12:21:29.547440+0000","last_peered":"2024-04-25T12:21:29.547440+0000","last_clean":"2024-04-25T12:21:29.547440+0000","last_became_active":"2024-04-25T12:21:23.123863+0000","last_became_peered":"2024-04-25T12:21:23.123863+0000","last_unstale":"2024-04-25T12:21:29.547440+0000","last_undegraded":"2024-04-25T12:21:29.547440+0000","last_fullsized":"2024-04-25T12:21:29.547440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:52:10.500619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.286029+0000","last_change":"2024-04-25T12:21:24.141874+0000","last_active":"2024-04-25T12:21:29.286029+0000","last_peered":"2024-04-25T12:21:29.286029+0000","last_clean":"2024-04-25T12:21:29.286029+0000","last_became_active":"2024-04-25T12:21:24.141482+0000","last_became_peered":"2024-04-25T12:21:24.141482+0000","last_unstale":"2024-04-25T12:21:29.286029+0000","last_undegraded":"2024-04-25T12:21:29.286029+0000","last_fullsized":"2024-04-25T12:21:29.286029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:45.364004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.284811+0000","last_change":"2024-04-25T12:21:28.377921+0000","last_active":"2024-04-25T12:21:29.284811+0000","last_peered":"2024-04-25T12:21:29.284811+0000","last_clean":"2024-04-25T12:21:29.284811+0000","last_became_active":"2024-04-25T12:21:28.376966+0000","last_became_peered":"2024-04-25T12:21:28.376966+0000","last_unstale":"2024-04-25T12:21:29.284811+0000","last_undegraded":"2024-04-25T12:21:29.284811+0000","last_fullsized":"2024-04-25T12:21:29.284811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:50:43.460694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.286467+0000","last_change":"2024-04-25T12:21:23.113889+0000","last_active":"2024-04-25T12:21:29.286467+0000","last_peered":"2024-04-25T12:21:29.286467+0000","last_clean":"2024-04-25T12:21:29.286467+0000","last_became_active":"2024-04-25T12:21:23.113605+0000","last_became_peered":"2024-04-25T12:21:23.113605+0000","last_unstale":"2024-04-25T12:21:29.286467+0000","last_undegraded":"2024-04-25T12:21:29.286467+0000","last_fullsized":"2024-04-25T12:21:29.286467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:01.082322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547299+0000","last_change":"2024-04-25T12:21:24.115472+0000","last_active":"2024-04-25T12:21:29.547299+0000","last_peered":"2024-04-25T12:21:29.547299+0000","last_clean":"2024-04-25T12:21:29.547299+0000","last_became_active":"2024-04-25T12:21:24.114671+0000","last_became_peered":"2024-04-25T12:21:24.114671+0000","last_unstale":"2024-04-25T12:21:29.547299+0000","last_undegraded":"2024-04-25T12:21:29.547299+0000","last_fullsized":"2024-04-25T12:21:29.547299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:01:31.853992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.165775+0000","last_change":"2024-04-25T12:21:28.205320+0000","last_active":"2024-04-25T12:21:29.165775+0000","last_peered":"2024-04-25T12:21:29.165775+0000","last_clean":"2024-04-25T12:21:29.165775+0000","last_became_active":"2024-04-25T12:21:28.204404+0000","last_became_peered":"2024-04-25T12:21:28.204404+0000","last_unstale":"2024-04-25T12:21:29.165775+0000","last_undegraded":"2024-04-25T12:21:29.165775+0000","last_fullsized":"2024-04-25T12:21:29.165775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:03:17.730928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.549885+0000","last_change":"2024-04-25T12:21:23.132332+0000","last_active":"2024-04-25T12:21:29.549885+0000","last_peered":"2024-04-25T12:21:29.549885+0000","last_clean":"2024-04-25T12:21:29.549885+0000","last_became_active":"2024-04-25T12:21:23.131566+0000","last_became_peered":"2024-04-25T12:21:23.131566+0000","last_unstale":"2024-04-25T12:21:29.549885+0000","last_undegraded":"2024-04-25T12:21:29.549885+0000","last_fullsized":"2024-04-25T12:21:29.549885+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:02.429838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.168229+0000","last_change":"2024-04-25T12:21:24.128824+0000","last_active":"2024-04-25T12:21:29.168229+0000","last_peered":"2024-04-25T12:21:29.168229+0000","last_clean":"2024-04-25T12:21:29.168229+0000","last_became_active":"2024-04-25T12:21:24.128027+0000","last_became_peered":"2024-04-25T12:21:24.128027+0000","last_unstale":"2024-04-25T12:21:29.168229+0000","last_undegraded":"2024-04-25T12:21:29.168229+0000","last_fullsized":"2024-04-25T12:21:29.168229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:57:44.137044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.167257+0000","last_change":"2024-04-25T12:21:28.202389+0000","last_active":"2024-04-25T12:21:29.167257+0000","last_peered":"2024-04-25T12:21:29.167257+0000","last_clean":"2024-04-25T12:21:29.167257+0000","last_became_active":"2024-04-25T12:21:28.201228+0000","last_became_peered":"2024-04-25T12:21:28.201228+0000","last_unstale":"2024-04-25T12:21:29.167257+0000","last_undegraded":"2024-04-25T12:21:29.167257+0000","last_fullsized":"2024-04-25T12:21:29.167257+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:45:30.365480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.549318+0000","last_change":"2024-04-25T12:21:23.128355+0000","last_active":"2024-04-25T12:21:29.549318+0000","last_peered":"2024-04-25T12:21:29.549318+0000","last_clean":"2024-04-25T12:21:29.549318+0000","last_became_active":"2024-04-25T12:21:23.127717+0000","last_became_peered":"2024-04-25T12:21:23.127717+0000","last_unstale":"2024-04-25T12:21:29.549318+0000","last_undegraded":"2024-04-25T12:21:29.549318+0000","last_fullsized":"2024-04-25T12:21:29.549318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:26.319715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.168925+0000","last_change":"2024-04-25T12:21:24.122098+0000","last_active":"2024-04-25T12:21:29.168925+0000","last_peered":"2024-04-25T12:21:29.168925+0000","last_clean":"2024-04-25T12:21:29.168925+0000","last_became_active":"2024-04-25T12:21:24.121392+0000","last_became_peered":"2024-04-25T12:21:24.121392+0000","last_unstale":"2024-04-25T12:21:29.168925+0000","last_undegraded":"2024-04-25T12:21:29.168925+0000","last_fullsized":"2024-04-25T12:21:29.168925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:11:35.116222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.167070+0000","last_change":"2024-04-25T12:21:28.189048+0000","last_active":"2024-04-25T12:21:29.167070+0000","last_peered":"2024-04-25T12:21:29.167070+0000","last_clean":"2024-04-25T12:21:29.167070+0000","last_became_active":"2024-04-25T12:21:28.187340+0000","last_became_peered":"2024-04-25T12:21:28.187340+0000","last_unstale":"2024-04-25T12:21:29.167070+0000","last_undegraded":"2024-04-25T12:21:29.167070+0000","last_fullsized":"2024-04-25T12:21:29.167070+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:47:13.797595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.280524+0000","last_change":"2024-04-25T12:21:24.126211+0000","last_active":"2024-04-25T12:21:29.280524+0000","last_peered":"2024-04-25T12:21:29.280524+0000","last_clean":"2024-04-25T12:21:29.280524+0000","last_became_active":"2024-04-25T12:21:24.123695+0000","last_became_peered":"2024-04-25T12:21:24.123695+0000","last_unstale":"2024-04-25T12:21:29.280524+0000","last_undegraded":"2024-04-25T12:21:29.280524+0000","last_fullsized":"2024-04-25T12:21:29.280524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:09:04.327157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.550040+0000","last_change":"2024-04-25T12:21:23.139676+0000","last_active":"2024-04-25T12:21:29.550040+0000","last_peered":"2024-04-25T12:21:29.550040+0000","last_clean":"2024-04-25T12:21:29.550040+0000","last_became_active":"2024-04-25T12:21:23.139025+0000","last_became_peered":"2024-04-25T12:21:23.139025+0000","last_unstale":"2024-04-25T12:21:29.550040+0000","last_undegraded":"2024-04-25T12:21:29.550040+0000","last_fullsized":"2024-04-25T12:21:29.550040+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:43:51.445149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.168869+0000","last_change":"2024-04-25T12:21:28.188852+0000","last_active":"2024-04-25T12:21:29.168869+0000","last_peered":"2024-04-25T12:21:29.168869+0000","last_clean":"2024-04-25T12:21:29.168869+0000","last_became_active":"2024-04-25T12:21:28.187619+0000","last_became_peered":"2024-04-25T12:21:28.187619+0000","last_unstale":"2024-04-25T12:21:29.168869+0000","last_undegraded":"2024-04-25T12:21:29.168869+0000","last_fullsized":"2024-04-25T12:21:29.168869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:12:14.726245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.285527+0000","last_change":"2024-04-25T12:21:24.136925+0000","last_active":"2024-04-25T12:21:29.285527+0000","last_peered":"2024-04-25T12:21:29.285527+0000","last_clean":"2024-04-25T12:21:29.285527+0000","last_became_active":"2024-04-25T12:21:24.136535+0000","last_became_peered":"2024-04-25T12:21:24.136535+0000","last_unstale":"2024-04-25T12:21:29.285527+0000","last_undegraded":"2024-04-25T12:21:29.285527+0000","last_fullsized":"2024-04-25T12:21:29.285527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:28:23.965010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547294+0000","last_change":"2024-04-25T12:21:23.105571+0000","last_active":"2024-04-25T12:21:29.547294+0000","last_peered":"2024-04-25T12:21:29.547294+0000","last_clean":"2024-04-25T12:21:29.547294+0000","last_became_active":"2024-04-25T12:21:23.105051+0000","last_became_peered":"2024-04-25T12:21:23.105051+0000","last_unstale":"2024-04-25T12:21:29.547294+0000","last_undegraded":"2024-04-25T12:21:29.547294+0000","last_fullsized":"2024-04-25T12:21:29.547294+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:52:40.783100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.167305+0000","last_change":"2024-04-25T12:21:28.202632+0000","last_active":"2024-04-25T12:21:29.167305+0000","last_peered":"2024-04-25T12:21:29.167305+0000","last_clean":"2024-04-25T12:21:29.167305+0000","last_became_active":"2024-04-25T12:21:28.201389+0000","last_became_peered":"2024-04-25T12:21:28.201389+0000","last_unstale":"2024-04-25T12:21:29.167305+0000","last_undegraded":"2024-04-25T12:21:29.167305+0000","last_fullsized":"2024-04-25T12:21:29.167305+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:48:58.246610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.285297+0000","last_change":"2024-04-25T12:21:24.138749+0000","last_active":"2024-04-25T12:21:29.285297+0000","last_peered":"2024-04-25T12:21:29.285297+0000","last_clean":"2024-04-25T12:21:29.285297+0000","last_became_active":"2024-04-25T12:21:24.138446+0000","last_became_peered":"2024-04-25T12:21:24.138446+0000","last_unstale":"2024-04-25T12:21:29.285297+0000","last_undegraded":"2024-04-25T12:21:29.285297+0000","last_fullsized":"2024-04-25T12:21:29.285297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:22:03.856237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.546669+0000","last_change":"2024-04-25T12:21:23.126871+0000","last_active":"2024-04-25T12:21:29.546669+0000","last_peered":"2024-04-25T12:21:29.546669+0000","last_clean":"2024-04-25T12:21:29.546669+0000","last_became_active":"2024-04-25T12:21:23.126521+0000","last_became_peered":"2024-04-25T12:21:23.126521+0000","last_unstale":"2024-04-25T12:21:29.546669+0000","last_undegraded":"2024-04-25T12:21:29.546669+0000","last_fullsized":"2024-04-25T12:21:29.546669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:12:31.353951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.548028+0000","last_change":"2024-04-25T12:21:28.383996+0000","last_active":"2024-04-25T12:21:29.548028+0000","last_peered":"2024-04-25T12:21:29.548028+0000","last_clean":"2024-04-25T12:21:29.548028+0000","last_became_active":"2024-04-25T12:21:28.383568+0000","last_became_peered":"2024-04-25T12:21:28.383568+0000","last_unstale":"2024-04-25T12:21:29.548028+0000","last_undegraded":"2024-04-25T12:21:29.548028+0000","last_fullsized":"2024-04-25T12:21:29.548028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:19:41.564694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.167030+0000","last_change":"2024-04-25T12:21:24.125112+0000","last_active":"2024-04-25T12:21:29.167030+0000","last_peered":"2024-04-25T12:21:29.167030+0000","last_clean":"2024-04-25T12:21:29.167030+0000","last_became_active":"2024-04-25T12:21:24.121963+0000","last_became_peered":"2024-04-25T12:21:24.121963+0000","last_unstale":"2024-04-25T12:21:29.167030+0000","last_undegraded":"2024-04-25T12:21:29.167030+0000","last_fullsized":"2024-04-25T12:21:29.167030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:33:14.123119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.548711+0000","last_change":"2024-04-25T12:21:23.117114+0000","last_active":"2024-04-25T12:21:29.548711+0000","last_peered":"2024-04-25T12:21:29.548711+0000","last_clean":"2024-04-25T12:21:29.548711+0000","last_became_active":"2024-04-25T12:21:23.115571+0000","last_became_peered":"2024-04-25T12:21:23.115571+0000","last_unstale":"2024-04-25T12:21:29.548711+0000","last_undegraded":"2024-04-25T12:21:29.548711+0000","last_fullsized":"2024-04-25T12:21:29.548711+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:47.838299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.168694+0000","last_change":"2024-04-25T12:21:28.202374+0000","last_active":"2024-04-25T12:21:29.168694+0000","last_peered":"2024-04-25T12:21:29.168694+0000","last_clean":"2024-04-25T12:21:29.168694+0000","last_became_active":"2024-04-25T12:21:28.201297+0000","last_became_peered":"2024-04-25T12:21:28.201297+0000","last_unstale":"2024-04-25T12:21:29.168694+0000","last_undegraded":"2024-04-25T12:21:29.168694+0000","last_fullsized":"2024-04-25T12:21:29.168694+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:13.461169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547865+0000","last_change":"2024-04-25T12:21:24.133827+0000","last_active":"2024-04-25T12:21:29.547865+0000","last_peered":"2024-04-25T12:21:29.547865+0000","last_clean":"2024-04-25T12:21:29.547865+0000","last_became_active":"2024-04-25T12:21:24.132703+0000","last_became_peered":"2024-04-25T12:21:24.132703+0000","last_unstale":"2024-04-25T12:21:29.547865+0000","last_undegraded":"2024-04-25T12:21:29.547865+0000","last_fullsized":"2024-04-25T12:21:29.547865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:06:22.849827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.282189+0000","last_change":"2024-04-25T12:21:23.132331+0000","last_active":"2024-04-25T12:21:29.282189+0000","last_peered":"2024-04-25T12:21:29.282189+0000","last_clean":"2024-04-25T12:21:29.282189+0000","last_became_active":"2024-04-25T12:21:23.131628+0000","last_became_peered":"2024-04-25T12:21:23.131628+0000","last_unstale":"2024-04-25T12:21:29.282189+0000","last_undegraded":"2024-04-25T12:21:29.282189+0000","last_fullsized":"2024-04-25T12:21:29.282189+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:19:13.372172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.166531+0000","last_change":"2024-04-25T12:21:28.377407+0000","last_active":"2024-04-25T12:21:29.166531+0000","last_peered":"2024-04-25T12:21:29.166531+0000","last_clean":"2024-04-25T12:21:29.166531+0000","last_became_active":"2024-04-25T12:21:28.376224+0000","last_became_peered":"2024-04-25T12:21:28.376224+0000","last_unstale":"2024-04-25T12:21:29.166531+0000","last_undegraded":"2024-04-25T12:21:29.166531+0000","last_fullsized":"2024-04-25T12:21:29.166531+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:13:02.955979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.286648+0000","last_change":"2024-04-25T12:21:24.145468+0000","last_active":"2024-04-25T12:21:29.286648+0000","last_peered":"2024-04-25T12:21:29.286648+0000","last_clean":"2024-04-25T12:21:29.286648+0000","last_became_active":"2024-04-25T12:21:24.145132+0000","last_became_peered":"2024-04-25T12:21:24.145132+0000","last_unstale":"2024-04-25T12:21:29.286648+0000","last_undegraded":"2024-04-25T12:21:29.286648+0000","last_fullsized":"2024-04-25T12:21:29.286648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:46:44.281270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.548372+0000","last_change":"2024-04-25T12:21:23.131029+0000","last_active":"2024-04-25T12:21:29.548372+0000","last_peered":"2024-04-25T12:21:29.548372+0000","last_clean":"2024-04-25T12:21:29.548372+0000","last_became_active":"2024-04-25T12:21:23.130612+0000","last_became_peered":"2024-04-25T12:21:23.130612+0000","last_unstale":"2024-04-25T12:21:29.548372+0000","last_undegraded":"2024-04-25T12:21:29.548372+0000","last_fullsized":"2024-04-25T12:21:29.548372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:02.146986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.284659+0000","last_change":"2024-04-25T12:21:28.375231+0000","last_active":"2024-04-25T12:21:29.284659+0000","last_peered":"2024-04-25T12:21:29.284659+0000","last_clean":"2024-04-25T12:21:29.284659+0000","last_became_active":"2024-04-25T12:21:28.374813+0000","last_became_peered":"2024-04-25T12:21:28.374813+0000","last_unstale":"2024-04-25T12:21:29.284659+0000","last_undegraded":"2024-04-25T12:21:29.284659+0000","last_fullsized":"2024-04-25T12:21:29.284659+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:16.393582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547074+0000","last_change":"2024-04-25T12:21:24.112280+0000","last_active":"2024-04-25T12:21:29.547074+0000","last_peered":"2024-04-25T12:21:29.547074+0000","last_clean":"2024-04-25T12:21:29.547074+0000","last_became_active":"2024-04-25T12:21:24.111430+0000","last_became_peered":"2024-04-25T12:21:24.111430+0000","last_unstale":"2024-04-25T12:21:29.547074+0000","last_undegraded":"2024-04-25T12:21:29.547074+0000","last_fullsized":"2024-04-25T12:21:29.547074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:58.325720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.550155+0000","last_change":"2024-04-25T12:21:23.124271+0000","last_active":"2024-04-25T12:21:29.550155+0000","last_peered":"2024-04-25T12:21:29.550155+0000","last_clean":"2024-04-25T12:21:29.550155+0000","last_became_active":"2024-04-25T12:21:23.123492+0000","last_became_peered":"2024-04-25T12:21:23.123492+0000","last_unstale":"2024-04-25T12:21:29.550155+0000","last_undegraded":"2024-04-25T12:21:29.550155+0000","last_fullsized":"2024-04-25T12:21:29.550155+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:31:09.080478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.546586+0000","last_change":"2024-04-25T12:21:28.375801+0000","last_active":"2024-04-25T12:21:29.546586+0000","last_peered":"2024-04-25T12:21:29.546586+0000","last_clean":"2024-04-25T12:21:29.546586+0000","last_became_active":"2024-04-25T12:21:28.375119+0000","last_became_peered":"2024-04-25T12:21:28.375119+0000","last_unstale":"2024-04-25T12:21:29.546586+0000","last_undegraded":"2024-04-25T12:21:29.546586+0000","last_fullsized":"2024-04-25T12:21:29.546586+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:00:29.908954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.169044+0000","last_change":"2024-04-25T12:21:24.131673+0000","last_active":"2024-04-25T12:21:29.169044+0000","last_peered":"2024-04-25T12:21:29.169044+0000","last_clean":"2024-04-25T12:21:29.169044+0000","last_became_active":"2024-04-25T12:21:24.130866+0000","last_became_peered":"2024-04-25T12:21:24.130866+0000","last_unstale":"2024-04-25T12:21:29.169044+0000","last_undegraded":"2024-04-25T12:21:29.169044+0000","last_fullsized":"2024-04-25T12:21:29.169044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:09:04.327157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547130+0000","last_change":"2024-04-25T12:21:23.106785+0000","last_active":"2024-04-25T12:21:29.547130+0000","last_peered":"2024-04-25T12:21:29.547130+0000","last_clean":"2024-04-25T12:21:29.547130+0000","last_became_active":"2024-04-25T12:21:23.105809+0000","last_became_peered":"2024-04-25T12:21:23.105809+0000","last_unstale":"2024-04-25T12:21:29.547130+0000","last_undegraded":"2024-04-25T12:21:29.547130+0000","last_fullsized":"2024-04-25T12:21:29.547130+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:17.185116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.546915+0000","last_change":"2024-04-25T12:21:28.193242+0000","last_active":"2024-04-25T12:21:29.546915+0000","last_peered":"2024-04-25T12:21:29.546915+0000","last_clean":"2024-04-25T12:21:29.546915+0000","last_became_active":"2024-04-25T12:21:28.192835+0000","last_became_peered":"2024-04-25T12:21:28.192835+0000","last_unstale":"2024-04-25T12:21:29.546915+0000","last_undegraded":"2024-04-25T12:21:29.546915+0000","last_fullsized":"2024-04-25T12:21:29.546915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:42:52.476024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.167733+0000","last_change":"2024-04-25T12:21:24.128902+0000","last_active":"2024-04-25T12:21:29.167733+0000","last_peered":"2024-04-25T12:21:29.167733+0000","last_clean":"2024-04-25T12:21:29.167733+0000","last_became_active":"2024-04-25T12:21:24.124563+0000","last_became_peered":"2024-04-25T12:21:24.124563+0000","last_unstale":"2024-04-25T12:21:29.167733+0000","last_undegraded":"2024-04-25T12:21:29.167733+0000","last_fullsized":"2024-04-25T12:21:29.167733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:16.937980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.168141+0000","last_change":"2024-04-25T12:21:23.114222+0000","last_active":"2024-04-25T12:21:29.168141+0000","last_peered":"2024-04-25T12:21:29.168141+0000","last_clean":"2024-04-25T12:21:29.168141+0000","last_became_active":"2024-04-25T12:21:23.113504+0000","last_became_peered":"2024-04-25T12:21:23.113504+0000","last_unstale":"2024-04-25T12:21:29.168141+0000","last_undegraded":"2024-04-25T12:21:29.168141+0000","last_fullsized":"2024-04-25T12:21:29.168141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:37:42.382391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547040+0000","last_change":"2024-04-25T12:21:28.200532+0000","last_active":"2024-04-25T12:21:29.547040+0000","last_peered":"2024-04-25T12:21:29.547040+0000","last_clean":"2024-04-25T12:21:29.547040+0000","last_became_active":"2024-04-25T12:21:28.200082+0000","last_became_peered":"2024-04-25T12:21:28.200082+0000","last_unstale":"2024-04-25T12:21:29.547040+0000","last_undegraded":"2024-04-25T12:21:29.547040+0000","last_fullsized":"2024-04-25T12:21:29.547040+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:24.889665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547331+0000","last_change":"2024-04-25T12:21:24.112524+0000","last_active":"2024-04-25T12:21:29.547331+0000","last_peered":"2024-04-25T12:21:29.547331+0000","last_clean":"2024-04-25T12:21:29.547331+0000","last_became_active":"2024-04-25T12:21:24.111503+0000","last_became_peered":"2024-04-25T12:21:24.111503+0000","last_unstale":"2024-04-25T12:21:29.547331+0000","last_undegraded":"2024-04-25T12:21:29.547331+0000","last_fullsized":"2024-04-25T12:21:29.547331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:03:35.982959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.166343+0000","last_change":"2024-04-25T12:21:23.108434+0000","last_active":"2024-04-25T12:21:29.166343+0000","last_peered":"2024-04-25T12:21:29.166343+0000","last_clean":"2024-04-25T12:21:29.166343+0000","last_became_active":"2024-04-25T12:21:23.108051+0000","last_became_peered":"2024-04-25T12:21:23.108051+0000","last_unstale":"2024-04-25T12:21:29.166343+0000","last_undegraded":"2024-04-25T12:21:29.166343+0000","last_fullsized":"2024-04-25T12:21:29.166343+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:49.222950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.548093+0000","last_change":"2024-04-25T12:21:28.189825+0000","last_active":"2024-04-25T12:21:29.548093+0000","last_peered":"2024-04-25T12:21:29.548093+0000","last_clean":"2024-04-25T12:21:29.548093+0000","last_became_active":"2024-04-25T12:21:28.189247+0000","last_became_peered":"2024-04-25T12:21:28.189247+0000","last_unstale":"2024-04-25T12:21:29.548093+0000","last_undegraded":"2024-04-25T12:21:29.548093+0000","last_fullsized":"2024-04-25T12:21:29.548093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:54:02.752212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.546226+0000","last_change":"2024-04-25T12:21:24.105746+0000","last_active":"2024-04-25T12:21:29.546226+0000","last_peered":"2024-04-25T12:21:29.546226+0000","last_clean":"2024-04-25T12:21:29.546226+0000","last_became_active":"2024-04-25T12:21:24.104947+0000","last_became_peered":"2024-04-25T12:21:24.104947+0000","last_unstale":"2024-04-25T12:21:29.546226+0000","last_undegraded":"2024-04-25T12:21:29.546226+0000","last_fullsized":"2024-04-25T12:21:29.546226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:46:14.853789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.548699+0000","last_change":"2024-04-25T12:21:23.114591+0000","last_active":"2024-04-25T12:21:29.548699+0000","last_peered":"2024-04-25T12:21:29.548699+0000","last_clean":"2024-04-25T12:21:29.548699+0000","last_became_active":"2024-04-25T12:21:23.113829+0000","last_became_peered":"2024-04-25T12:21:23.113829+0000","last_unstale":"2024-04-25T12:21:29.548699+0000","last_undegraded":"2024-04-25T12:21:29.548699+0000","last_fullsized":"2024-04-25T12:21:29.548699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:51:38.471436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547750+0000","last_change":"2024-04-25T12:21:28.378024+0000","last_active":"2024-04-25T12:21:29.547750+0000","last_peered":"2024-04-25T12:21:29.547750+0000","last_clean":"2024-04-25T12:21:29.547750+0000","last_became_active":"2024-04-25T12:21:28.377639+0000","last_became_peered":"2024-04-25T12:21:28.377639+0000","last_unstale":"2024-04-25T12:21:29.547750+0000","last_undegraded":"2024-04-25T12:21:29.547750+0000","last_fullsized":"2024-04-25T12:21:29.547750+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:18:40.723659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.285268+0000","last_change":"2024-04-25T12:21:24.120719+0000","last_active":"2024-04-25T12:21:29.285268+0000","last_peered":"2024-04-25T12:21:29.285268+0000","last_clean":"2024-04-25T12:21:29.285268+0000","last_became_active":"2024-04-25T12:21:24.119870+0000","last_became_peered":"2024-04-25T12:21:24.119870+0000","last_unstale":"2024-04-25T12:21:29.285268+0000","last_undegraded":"2024-04-25T12:21:29.285268+0000","last_fullsized":"2024-04-25T12:21:29.285268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:53:15.175473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.168316+0000","last_change":"2024-04-25T12:21:23.103524+0000","last_active":"2024-04-25T12:21:29.168316+0000","last_peered":"2024-04-25T12:21:29.168316+0000","last_clean":"2024-04-25T12:21:29.168316+0000","last_became_active":"2024-04-25T12:21:23.102790+0000","last_became_peered":"2024-04-25T12:21:23.102790+0000","last_unstale":"2024-04-25T12:21:29.168316+0000","last_undegraded":"2024-04-25T12:21:29.168316+0000","last_fullsized":"2024-04-25T12:21:29.168316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:15:54.796303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.549016+0000","last_change":"2024-04-25T12:21:13.081186+0000","last_active":"2024-04-25T12:21:29.549016+0000","last_peered":"2024-04-25T12:21:29.549016+0000","last_clean":"2024-04-25T12:21:29.549016+0000","last_became_active":"2024-04-25T12:21:13.076753+0000","last_became_peered":"2024-04-25T12:21:13.076753+0000","last_unstale":"2024-04-25T12:21:29.549016+0000","last_undegraded":"2024-04-25T12:21:29.549016+0000","last_fullsized":"2024-04-25T12:21:29.549016+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:12.013694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:12.013694+0000","last_clean_scrub_stamp":"2024-04-25T12:21:12.013694+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:18:03.288120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.281646+0000","last_change":"2024-04-25T12:21:28.379372+0000","last_active":"2024-04-25T12:21:29.281646+0000","last_peered":"2024-04-25T12:21:29.281646+0000","last_clean":"2024-04-25T12:21:29.281646+0000","last_became_active":"2024-04-25T12:21:28.378522+0000","last_became_peered":"2024-04-25T12:21:28.378522+0000","last_unstale":"2024-04-25T12:21:29.281646+0000","last_undegraded":"2024-04-25T12:21:29.281646+0000","last_fullsized":"2024-04-25T12:21:29.281646+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:54:35.288829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.549343+0000","last_change":"2024-04-25T12:21:24.144632+0000","last_active":"2024-04-25T12:21:29.549343+0000","last_peered":"2024-04-25T12:21:29.549343+0000","last_clean":"2024-04-25T12:21:29.549343+0000","last_became_active":"2024-04-25T12:21:24.142085+0000","last_became_peered":"2024-04-25T12:21:24.142085+0000","last_unstale":"2024-04-25T12:21:29.549343+0000","last_undegraded":"2024-04-25T12:21:29.549343+0000","last_fullsized":"2024-04-25T12:21:29.549343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:16:55.634329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.166743+0000","last_change":"2024-04-25T12:21:23.126527+0000","last_active":"2024-04-25T12:21:29.166743+0000","last_peered":"2024-04-25T12:21:29.166743+0000","last_clean":"2024-04-25T12:21:29.166743+0000","last_became_active":"2024-04-25T12:21:23.126103+0000","last_became_peered":"2024-04-25T12:21:23.126103+0000","last_unstale":"2024-04-25T12:21:29.166743+0000","last_undegraded":"2024-04-25T12:21:29.166743+0000","last_fullsized":"2024-04-25T12:21:29.166743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:16:36.502824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.280872+0000","last_change":"2024-04-25T12:21:28.379480+0000","last_active":"2024-04-25T12:21:29.280872+0000","last_peered":"2024-04-25T12:21:29.280872+0000","last_clean":"2024-04-25T12:21:29.280872+0000","last_became_active":"2024-04-25T12:21:28.378559+0000","last_became_peered":"2024-04-25T12:21:28.378559+0000","last_unstale":"2024-04-25T12:21:29.280872+0000","last_undegraded":"2024-04-25T12:21:29.280872+0000","last_fullsized":"2024-04-25T12:21:29.280872+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:40.975592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.168315+0000","last_change":"2024-04-25T12:21:24.129518+0000","last_active":"2024-04-25T12:21:29.168315+0000","last_peered":"2024-04-25T12:21:29.168315+0000","last_clean":"2024-04-25T12:21:29.168315+0000","last_became_active":"2024-04-25T12:21:24.126968+0000","last_became_peered":"2024-04-25T12:21:24.126968+0000","last_unstale":"2024-04-25T12:21:29.168315+0000","last_undegraded":"2024-04-25T12:21:29.168315+0000","last_fullsized":"2024-04-25T12:21:29.168315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:49.243645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547717+0000","last_change":"2024-04-25T12:21:23.116529+0000","last_active":"2024-04-25T12:21:29.547717+0000","last_peered":"2024-04-25T12:21:29.547717+0000","last_clean":"2024-04-25T12:21:29.547717+0000","last_became_active":"2024-04-25T12:21:23.116148+0000","last_became_peered":"2024-04-25T12:21:23.116148+0000","last_unstale":"2024-04-25T12:21:29.547717+0000","last_undegraded":"2024-04-25T12:21:29.547717+0000","last_fullsized":"2024-04-25T12:21:29.547717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:01:45.567238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.546941+0000","last_change":"2024-04-25T12:21:28.194823+0000","last_active":"2024-04-25T12:21:29.546941+0000","last_peered":"2024-04-25T12:21:29.546941+0000","last_clean":"2024-04-25T12:21:29.546941+0000","last_became_active":"2024-04-25T12:21:28.194191+0000","last_became_peered":"2024-04-25T12:21:28.194191+0000","last_unstale":"2024-04-25T12:21:29.546941+0000","last_undegraded":"2024-04-25T12:21:29.546941+0000","last_fullsized":"2024-04-25T12:21:29.546941+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:50:30.454926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.550030+0000","last_change":"2024-04-25T12:21:24.146733+0000","last_active":"2024-04-25T12:21:29.550030+0000","last_peered":"2024-04-25T12:21:29.550030+0000","last_clean":"2024-04-25T12:21:29.550030+0000","last_became_active":"2024-04-25T12:21:24.145807+0000","last_became_peered":"2024-04-25T12:21:24.145807+0000","last_unstale":"2024-04-25T12:21:29.550030+0000","last_undegraded":"2024-04-25T12:21:29.550030+0000","last_fullsized":"2024-04-25T12:21:29.550030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:07:35.092827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.166946+0000","last_change":"2024-04-25T12:21:23.103393+0000","last_active":"2024-04-25T12:21:29.166946+0000","last_peered":"2024-04-25T12:21:29.166946+0000","last_clean":"2024-04-25T12:21:29.166946+0000","last_became_active":"2024-04-25T12:21:23.102997+0000","last_became_peered":"2024-04-25T12:21:23.102997+0000","last_unstale":"2024-04-25T12:21:29.166946+0000","last_undegraded":"2024-04-25T12:21:29.166946+0000","last_fullsized":"2024-04-25T12:21:29.166946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:40:23.054158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.167860+0000","last_change":"2024-04-25T12:21:28.384645+0000","last_active":"2024-04-25T12:21:29.167860+0000","last_peered":"2024-04-25T12:21:29.167860+0000","last_clean":"2024-04-25T12:21:29.167860+0000","last_became_active":"2024-04-25T12:21:28.382953+0000","last_became_peered":"2024-04-25T12:21:28.382953+0000","last_unstale":"2024-04-25T12:21:29.167860+0000","last_undegraded":"2024-04-25T12:21:29.167860+0000","last_fullsized":"2024-04-25T12:21:29.167860+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:40:56.218533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.549409+0000","last_change":"2024-04-25T12:21:24.146557+0000","last_active":"2024-04-25T12:21:29.549409+0000","last_peered":"2024-04-25T12:21:29.549409+0000","last_clean":"2024-04-25T12:21:29.549409+0000","last_became_active":"2024-04-25T12:21:24.146162+0000","last_became_peered":"2024-04-25T12:21:24.146162+0000","last_unstale":"2024-04-25T12:21:29.549409+0000","last_undegraded":"2024-04-25T12:21:29.549409+0000","last_fullsized":"2024-04-25T12:21:29.549409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:09:00.995503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.169245+0000","last_change":"2024-04-25T12:21:23.135467+0000","last_active":"2024-04-25T12:21:29.169245+0000","last_peered":"2024-04-25T12:21:29.169245+0000","last_clean":"2024-04-25T12:21:29.169245+0000","last_became_active":"2024-04-25T12:21:23.134441+0000","last_became_peered":"2024-04-25T12:21:23.134441+0000","last_unstale":"2024-04-25T12:21:29.169245+0000","last_undegraded":"2024-04-25T12:21:29.169245+0000","last_fullsized":"2024-04-25T12:21:29.169245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:44:33.069221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.165946+0000","last_change":"2024-04-25T12:21:28.202610+0000","last_active":"2024-04-25T12:21:29.165946+0000","last_peered":"2024-04-25T12:21:29.165946+0000","last_clean":"2024-04-25T12:21:29.165946+0000","last_became_active":"2024-04-25T12:21:28.201479+0000","last_became_peered":"2024-04-25T12:21:28.201479+0000","last_unstale":"2024-04-25T12:21:29.165946+0000","last_undegraded":"2024-04-25T12:21:29.165946+0000","last_fullsized":"2024-04-25T12:21:29.165946+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:25:15.458202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.548957+0000","last_change":"2024-04-25T12:21:24.145131+0000","last_active":"2024-04-25T12:21:29.548957+0000","last_peered":"2024-04-25T12:21:29.548957+0000","last_clean":"2024-04-25T12:21:29.548957+0000","last_became_active":"2024-04-25T12:21:24.142422+0000","last_became_peered":"2024-04-25T12:21:24.142422+0000","last_unstale":"2024-04-25T12:21:29.548957+0000","last_undegraded":"2024-04-25T12:21:29.548957+0000","last_fullsized":"2024-04-25T12:21:29.548957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:40:24.312543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.166123+0000","last_change":"2024-04-25T12:21:23.104288+0000","last_active":"2024-04-25T12:21:29.166123+0000","last_peered":"2024-04-25T12:21:29.166123+0000","last_clean":"2024-04-25T12:21:29.166123+0000","last_became_active":"2024-04-25T12:21:23.103680+0000","last_became_peered":"2024-04-25T12:21:23.103680+0000","last_unstale":"2024-04-25T12:21:29.166123+0000","last_undegraded":"2024-04-25T12:21:29.166123+0000","last_fullsized":"2024-04-25T12:21:29.166123+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:29.672890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547646+0000","last_change":"2024-04-25T12:21:28.199834+0000","last_active":"2024-04-25T12:21:29.547646+0000","last_peered":"2024-04-25T12:21:29.547646+0000","last_clean":"2024-04-25T12:21:29.547646+0000","last_became_active":"2024-04-25T12:21:28.199411+0000","last_became_peered":"2024-04-25T12:21:28.199411+0000","last_unstale":"2024-04-25T12:21:29.547646+0000","last_undegraded":"2024-04-25T12:21:29.547646+0000","last_fullsized":"2024-04-25T12:21:29.547646+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:52:34.443813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.280647+0000","last_change":"2024-04-25T12:21:24.127488+0000","last_active":"2024-04-25T12:21:29.280647+0000","last_peered":"2024-04-25T12:21:29.280647+0000","last_clean":"2024-04-25T12:21:29.280647+0000","last_became_active":"2024-04-25T12:21:24.126721+0000","last_became_peered":"2024-04-25T12:21:24.126721+0000","last_unstale":"2024-04-25T12:21:29.280647+0000","last_undegraded":"2024-04-25T12:21:29.280647+0000","last_fullsized":"2024-04-25T12:21:29.280647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:02.153025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.280911+0000","last_change":"2024-04-25T12:21:23.139626+0000","last_active":"2024-04-25T12:21:29.280911+0000","last_peered":"2024-04-25T12:21:29.280911+0000","last_clean":"2024-04-25T12:21:29.280911+0000","last_became_active":"2024-04-25T12:21:23.138837+0000","last_became_peered":"2024-04-25T12:21:23.138837+0000","last_unstale":"2024-04-25T12:21:29.280911+0000","last_undegraded":"2024-04-25T12:21:29.280911+0000","last_fullsized":"2024-04-25T12:21:29.280911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:09.309384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.286588+0000","last_change":"2024-04-25T12:21:28.383919+0000","last_active":"2024-04-25T12:21:29.286588+0000","last_peered":"2024-04-25T12:21:29.286588+0000","last_clean":"2024-04-25T12:21:29.286588+0000","last_became_active":"2024-04-25T12:21:28.383298+0000","last_became_peered":"2024-04-25T12:21:28.383298+0000","last_unstale":"2024-04-25T12:21:29.286588+0000","last_undegraded":"2024-04-25T12:21:29.286588+0000","last_fullsized":"2024-04-25T12:21:29.286588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:01.115040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.549858+0000","last_change":"2024-04-25T12:21:24.146454+0000","last_active":"2024-04-25T12:21:29.549858+0000","last_peered":"2024-04-25T12:21:29.549858+0000","last_clean":"2024-04-25T12:21:29.549858+0000","last_became_active":"2024-04-25T12:21:24.145931+0000","last_became_peered":"2024-04-25T12:21:24.145931+0000","last_unstale":"2024-04-25T12:21:29.549858+0000","last_undegraded":"2024-04-25T12:21:29.549858+0000","last_fullsized":"2024-04-25T12:21:29.549858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:35:22.490243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.168054+0000","last_change":"2024-04-25T12:21:23.122495+0000","last_active":"2024-04-25T12:21:29.168054+0000","last_peered":"2024-04-25T12:21:29.168054+0000","last_clean":"2024-04-25T12:21:29.168054+0000","last_became_active":"2024-04-25T12:21:23.121429+0000","last_became_peered":"2024-04-25T12:21:23.121429+0000","last_unstale":"2024-04-25T12:21:29.168054+0000","last_undegraded":"2024-04-25T12:21:29.168054+0000","last_fullsized":"2024-04-25T12:21:29.168054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:10.530248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.285955+0000","last_change":"2024-04-25T12:21:28.375971+0000","last_active":"2024-04-25T12:21:29.285955+0000","last_peered":"2024-04-25T12:21:29.285955+0000","last_clean":"2024-04-25T12:21:29.285955+0000","last_became_active":"2024-04-25T12:21:28.375013+0000","last_became_peered":"2024-04-25T12:21:28.375013+0000","last_unstale":"2024-04-25T12:21:29.285955+0000","last_undegraded":"2024-04-25T12:21:29.285955+0000","last_fullsized":"2024-04-25T12:21:29.285955+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:56:45.398763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.546876+0000","last_change":"2024-04-25T12:21:24.138293+0000","last_active":"2024-04-25T12:21:29.546876+0000","last_peered":"2024-04-25T12:21:29.546876+0000","last_clean":"2024-04-25T12:21:29.546876+0000","last_became_active":"2024-04-25T12:21:24.138016+0000","last_became_peered":"2024-04-25T12:21:24.138016+0000","last_unstale":"2024-04-25T12:21:29.546876+0000","last_undegraded":"2024-04-25T12:21:29.546876+0000","last_fullsized":"2024-04-25T12:21:29.546876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:48:54.078239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547256+0000","last_change":"2024-04-25T12:21:23.136227+0000","last_active":"2024-04-25T12:21:29.547256+0000","last_peered":"2024-04-25T12:21:29.547256+0000","last_clean":"2024-04-25T12:21:29.547256+0000","last_became_active":"2024-04-25T12:21:23.135947+0000","last_became_peered":"2024-04-25T12:21:23.135947+0000","last_unstale":"2024-04-25T12:21:29.547256+0000","last_undegraded":"2024-04-25T12:21:29.547256+0000","last_fullsized":"2024-04-25T12:21:29.547256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:41:24.323924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.168847+0000","last_change":"2024-04-25T12:21:28.378564+0000","last_active":"2024-04-25T12:21:29.168847+0000","last_peered":"2024-04-25T12:21:29.168847+0000","last_clean":"2024-04-25T12:21:29.168847+0000","last_became_active":"2024-04-25T12:21:28.377532+0000","last_became_peered":"2024-04-25T12:21:28.377532+0000","last_unstale":"2024-04-25T12:21:29.168847+0000","last_undegraded":"2024-04-25T12:21:29.168847+0000","last_fullsized":"2024-04-25T12:21:29.168847+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:20.576562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.549070+0000","last_change":"2024-04-25T12:21:24.148665+0000","last_active":"2024-04-25T12:21:29.549070+0000","last_peered":"2024-04-25T12:21:29.549070+0000","last_clean":"2024-04-25T12:21:29.549070+0000","last_became_active":"2024-04-25T12:21:24.142505+0000","last_became_peered":"2024-04-25T12:21:24.142505+0000","last_unstale":"2024-04-25T12:21:29.549070+0000","last_undegraded":"2024-04-25T12:21:29.549070+0000","last_fullsized":"2024-04-25T12:21:29.549070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:19:44.014834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:38.438513+0000","last_change":"2024-04-25T12:21:23.130231+0000","last_active":"2024-04-25T12:21:38.438513+0000","last_peered":"2024-04-25T12:21:38.438513+0000","last_clean":"2024-04-25T12:21:38.438513+0000","last_became_active":"2024-04-25T12:21:23.129474+0000","last_became_peered":"2024-04-25T12:21:23.129474+0000","last_unstale":"2024-04-25T12:21:38.438513+0000","last_undegraded":"2024-04-25T12:21:38.438513+0000","last_fullsized":"2024-04-25T12:21:38.438513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:50.974387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547082+0000","last_change":"2024-04-25T12:21:28.200551+0000","last_active":"2024-04-25T12:21:29.547082+0000","last_peered":"2024-04-25T12:21:29.547082+0000","last_clean":"2024-04-25T12:21:29.547082+0000","last_became_active":"2024-04-25T12:21:28.200152+0000","last_became_peered":"2024-04-25T12:21:28.200152+0000","last_unstale":"2024-04-25T12:21:29.547082+0000","last_undegraded":"2024-04-25T12:21:29.547082+0000","last_fullsized":"2024-04-25T12:21:29.547082+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:17:34.847925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.167585+0000","last_change":"2024-04-25T12:21:24.142957+0000","last_active":"2024-04-25T12:21:29.167585+0000","last_peered":"2024-04-25T12:21:29.167585+0000","last_clean":"2024-04-25T12:21:29.167585+0000","last_became_active":"2024-04-25T12:21:24.142594+0000","last_became_peered":"2024-04-25T12:21:24.142594+0000","last_unstale":"2024-04-25T12:21:29.167585+0000","last_undegraded":"2024-04-25T12:21:29.167585+0000","last_fullsized":"2024-04-25T12:21:29.167585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:36:47.719946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547660+0000","last_change":"2024-04-25T12:21:23.125118+0000","last_active":"2024-04-25T12:21:29.547660+0000","last_peered":"2024-04-25T12:21:29.547660+0000","last_clean":"2024-04-25T12:21:29.547660+0000","last_became_active":"2024-04-25T12:21:23.124836+0000","last_became_peered":"2024-04-25T12:21:23.124836+0000","last_unstale":"2024-04-25T12:21:29.547660+0000","last_undegraded":"2024-04-25T12:21:29.547660+0000","last_fullsized":"2024-04-25T12:21:29.547660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:03:28.500940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.167503+0000","last_change":"2024-04-25T12:21:28.194476+0000","last_active":"2024-04-25T12:21:29.167503+0000","last_peered":"2024-04-25T12:21:29.167503+0000","last_clean":"2024-04-25T12:21:29.167503+0000","last_became_active":"2024-04-25T12:21:28.193277+0000","last_became_peered":"2024-04-25T12:21:28.193277+0000","last_unstale":"2024-04-25T12:21:29.167503+0000","last_undegraded":"2024-04-25T12:21:29.167503+0000","last_fullsized":"2024-04-25T12:21:29.167503+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:31.495441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547391+0000","last_change":"2024-04-25T12:21:24.115104+0000","last_active":"2024-04-25T12:21:29.547391+0000","last_peered":"2024-04-25T12:21:29.547391+0000","last_clean":"2024-04-25T12:21:29.547391+0000","last_became_active":"2024-04-25T12:21:24.114367+0000","last_became_peered":"2024-04-25T12:21:24.114367+0000","last_unstale":"2024-04-25T12:21:29.547391+0000","last_undegraded":"2024-04-25T12:21:29.547391+0000","last_fullsized":"2024-04-25T12:21:29.547391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:03.107076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.168564+0000","last_change":"2024-04-25T12:21:23.132996+0000","last_active":"2024-04-25T12:21:29.168564+0000","last_peered":"2024-04-25T12:21:29.168564+0000","last_clean":"2024-04-25T12:21:29.168564+0000","last_became_active":"2024-04-25T12:21:23.132223+0000","last_became_peered":"2024-04-25T12:21:23.132223+0000","last_unstale":"2024-04-25T12:21:29.168564+0000","last_undegraded":"2024-04-25T12:21:29.168564+0000","last_fullsized":"2024-04-25T12:21:29.168564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:18.689461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.285114+0000","last_change":"2024-04-25T12:21:28.203302+0000","last_active":"2024-04-25T12:21:29.285114+0000","last_peered":"2024-04-25T12:21:29.285114+0000","last_clean":"2024-04-25T12:21:29.285114+0000","last_became_active":"2024-04-25T12:21:28.202800+0000","last_became_peered":"2024-04-25T12:21:28.202800+0000","last_unstale":"2024-04-25T12:21:29.285114+0000","last_undegraded":"2024-04-25T12:21:29.285114+0000","last_fullsized":"2024-04-25T12:21:29.285114+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:27:16.676736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.169161+0000","last_change":"2024-04-25T12:21:24.142716+0000","last_active":"2024-04-25T12:21:29.169161+0000","last_peered":"2024-04-25T12:21:29.169161+0000","last_clean":"2024-04-25T12:21:29.169161+0000","last_became_active":"2024-04-25T12:21:24.142363+0000","last_became_peered":"2024-04-25T12:21:24.142363+0000","last_unstale":"2024-04-25T12:21:29.169161+0000","last_undegraded":"2024-04-25T12:21:29.169161+0000","last_fullsized":"2024-04-25T12:21:29.169161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:02.153025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.281923+0000","last_change":"2024-04-25T12:21:23.130843+0000","last_active":"2024-04-25T12:21:29.281923+0000","last_peered":"2024-04-25T12:21:29.281923+0000","last_clean":"2024-04-25T12:21:29.281923+0000","last_became_active":"2024-04-25T12:21:23.129967+0000","last_became_peered":"2024-04-25T12:21:23.129967+0000","last_unstale":"2024-04-25T12:21:29.281923+0000","last_undegraded":"2024-04-25T12:21:29.281923+0000","last_fullsized":"2024-04-25T12:21:29.281923+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:19:22.719364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.285047+0000","last_change":"2024-04-25T12:21:28.384082+0000","last_active":"2024-04-25T12:21:29.285047+0000","last_peered":"2024-04-25T12:21:29.285047+0000","last_clean":"2024-04-25T12:21:29.285047+0000","last_became_active":"2024-04-25T12:21:28.383228+0000","last_became_peered":"2024-04-25T12:21:28.383228+0000","last_unstale":"2024-04-25T12:21:29.285047+0000","last_undegraded":"2024-04-25T12:21:29.285047+0000","last_fullsized":"2024-04-25T12:21:29.285047+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:14.600341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547535+0000","last_change":"2024-04-25T12:21:28.378352+0000","last_active":"2024-04-25T12:21:29.547535+0000","last_peered":"2024-04-25T12:21:29.547535+0000","last_clean":"2024-04-25T12:21:29.547535+0000","last_became_active":"2024-04-25T12:21:28.377742+0000","last_became_peered":"2024-04-25T12:21:28.377742+0000","last_unstale":"2024-04-25T12:21:29.547535+0000","last_undegraded":"2024-04-25T12:21:29.547535+0000","last_fullsized":"2024-04-25T12:21:29.547535+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:20.075296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.546465+0000","last_change":"2024-04-25T12:21:24.126158+0000","last_active":"2024-04-25T12:21:29.546465+0000","last_peered":"2024-04-25T12:21:29.546465+0000","last_clean":"2024-04-25T12:21:29.546465+0000","last_became_active":"2024-04-25T12:21:24.125448+0000","last_became_peered":"2024-04-25T12:21:24.125448+0000","last_unstale":"2024-04-25T12:21:29.546465+0000","last_undegraded":"2024-04-25T12:21:29.546465+0000","last_fullsized":"2024-04-25T12:21:29.546465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:42.769206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.168026+0000","last_change":"2024-04-25T12:21:23.117159+0000","last_active":"2024-04-25T12:21:29.168026+0000","last_peered":"2024-04-25T12:21:29.168026+0000","last_clean":"2024-04-25T12:21:29.168026+0000","last_became_active":"2024-04-25T12:21:23.115911+0000","last_became_peered":"2024-04-25T12:21:23.115911+0000","last_unstale":"2024-04-25T12:21:29.168026+0000","last_undegraded":"2024-04-25T12:21:29.168026+0000","last_fullsized":"2024-04-25T12:21:29.168026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:46:10.238958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.281751+0000","last_change":"2024-04-25T12:21:28.205952+0000","last_active":"2024-04-25T12:21:29.281751+0000","last_peered":"2024-04-25T12:21:29.281751+0000","last_clean":"2024-04-25T12:21:29.281751+0000","last_became_active":"2024-04-25T12:21:28.204472+0000","last_became_peered":"2024-04-25T12:21:28.204472+0000","last_unstale":"2024-04-25T12:21:29.281751+0000","last_undegraded":"2024-04-25T12:21:29.281751+0000","last_fullsized":"2024-04-25T12:21:29.281751+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:16:03.460343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.285501+0000","last_change":"2024-04-25T12:21:24.137477+0000","last_active":"2024-04-25T12:21:29.285501+0000","last_peered":"2024-04-25T12:21:29.285501+0000","last_clean":"2024-04-25T12:21:29.285501+0000","last_became_active":"2024-04-25T12:21:24.137078+0000","last_became_peered":"2024-04-25T12:21:24.137078+0000","last_unstale":"2024-04-25T12:21:29.285501+0000","last_undegraded":"2024-04-25T12:21:29.285501+0000","last_fullsized":"2024-04-25T12:21:29.285501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:53.321239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.285357+0000","last_change":"2024-04-25T12:21:23.130046+0000","last_active":"2024-04-25T12:21:29.285357+0000","last_peered":"2024-04-25T12:21:29.285357+0000","last_clean":"2024-04-25T12:21:29.285357+0000","last_became_active":"2024-04-25T12:21:23.129779+0000","last_became_peered":"2024-04-25T12:21:23.129779+0000","last_unstale":"2024-04-25T12:21:29.285357+0000","last_undegraded":"2024-04-25T12:21:29.285357+0000","last_fullsized":"2024-04-25T12:21:29.285357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:24:43.733780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.281044+0000","last_change":"2024-04-25T12:21:23.138152+0000","last_active":"2024-04-25T12:21:29.281044+0000","last_peered":"2024-04-25T12:21:29.281044+0000","last_clean":"2024-04-25T12:21:29.281044+0000","last_became_active":"2024-04-25T12:21:23.137393+0000","last_became_peered":"2024-04-25T12:21:23.137393+0000","last_unstale":"2024-04-25T12:21:29.281044+0000","last_undegraded":"2024-04-25T12:21:29.281044+0000","last_fullsized":"2024-04-25T12:21:29.281044+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:10:42.713304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547129+0000","last_change":"2024-04-25T12:21:24.122299+0000","last_active":"2024-04-25T12:21:29.547129+0000","last_peered":"2024-04-25T12:21:29.547129+0000","last_clean":"2024-04-25T12:21:29.547129+0000","last_became_active":"2024-04-25T12:21:24.121480+0000","last_became_peered":"2024-04-25T12:21:24.121480+0000","last_unstale":"2024-04-25T12:21:29.547129+0000","last_undegraded":"2024-04-25T12:21:29.547129+0000","last_fullsized":"2024-04-25T12:21:29.547129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:05:46.050357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.166540+0000","last_change":"2024-04-25T12:21:28.183735+0000","last_active":"2024-04-25T12:21:29.166540+0000","last_peered":"2024-04-25T12:21:29.166540+0000","last_clean":"2024-04-25T12:21:29.166540+0000","last_became_active":"2024-04-25T12:21:28.183319+0000","last_became_peered":"2024-04-25T12:21:28.183319+0000","last_unstale":"2024-04-25T12:21:29.166540+0000","last_undegraded":"2024-04-25T12:21:29.166540+0000","last_fullsized":"2024-04-25T12:21:29.166540+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:42:14.120075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.285705+0000","last_change":"2024-04-25T12:21:23.113080+0000","last_active":"2024-04-25T12:21:29.285705+0000","last_peered":"2024-04-25T12:21:29.285705+0000","last_clean":"2024-04-25T12:21:29.285705+0000","last_became_active":"2024-04-25T12:21:23.112721+0000","last_became_peered":"2024-04-25T12:21:23.112721+0000","last_unstale":"2024-04-25T12:21:29.285705+0000","last_undegraded":"2024-04-25T12:21:29.285705+0000","last_fullsized":"2024-04-25T12:21:29.285705+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:25.396377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.167162+0000","last_change":"2024-04-25T12:21:24.134267+0000","last_active":"2024-04-25T12:21:29.167162+0000","last_peered":"2024-04-25T12:21:29.167162+0000","last_clean":"2024-04-25T12:21:29.167162+0000","last_became_active":"2024-04-25T12:21:24.133493+0000","last_became_peered":"2024-04-25T12:21:24.133493+0000","last_unstale":"2024-04-25T12:21:29.167162+0000","last_undegraded":"2024-04-25T12:21:29.167162+0000","last_fullsized":"2024-04-25T12:21:29.167162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:24:25.810067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.286483+0000","last_change":"2024-04-25T12:21:28.188314+0000","last_active":"2024-04-25T12:21:29.286483+0000","last_peered":"2024-04-25T12:21:29.286483+0000","last_clean":"2024-04-25T12:21:29.286483+0000","last_became_active":"2024-04-25T12:21:28.187955+0000","last_became_peered":"2024-04-25T12:21:28.187955+0000","last_unstale":"2024-04-25T12:21:29.286483+0000","last_undegraded":"2024-04-25T12:21:29.286483+0000","last_fullsized":"2024-04-25T12:21:29.286483+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:17.889868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.280334+0000","last_change":"2024-04-25T12:21:24.126582+0000","last_active":"2024-04-25T12:21:29.280334+0000","last_peered":"2024-04-25T12:21:29.280334+0000","last_clean":"2024-04-25T12:21:29.280334+0000","last_became_active":"2024-04-25T12:21:24.125831+0000","last_became_peered":"2024-04-25T12:21:24.125831+0000","last_unstale":"2024-04-25T12:21:29.280334+0000","last_undegraded":"2024-04-25T12:21:29.280334+0000","last_fullsized":"2024-04-25T12:21:29.280334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:53.129274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.166193+0000","last_change":"2024-04-25T12:21:24.117441+0000","last_active":"2024-04-25T12:21:29.166193+0000","last_peered":"2024-04-25T12:21:29.166193+0000","last_clean":"2024-04-25T12:21:29.166193+0000","last_became_active":"2024-04-25T12:21:24.116498+0000","last_became_peered":"2024-04-25T12:21:24.116498+0000","last_unstale":"2024-04-25T12:21:29.166193+0000","last_undegraded":"2024-04-25T12:21:29.166193+0000","last_fullsized":"2024-04-25T12:21:29.166193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:06:45.632199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.167962+0000","last_change":"2024-04-25T12:21:24.117995+0000","last_active":"2024-04-25T12:21:29.167962+0000","last_peered":"2024-04-25T12:21:29.167962+0000","last_clean":"2024-04-25T12:21:29.167962+0000","last_became_active":"2024-04-25T12:21:24.114742+0000","last_became_peered":"2024-04-25T12:21:24.114742+0000","last_unstale":"2024-04-25T12:21:29.167962+0000","last_undegraded":"2024-04-25T12:21:29.167962+0000","last_fullsized":"2024-04-25T12:21:29.167962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:59.864082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547009+0000","last_change":"2024-04-25T12:21:24.134863+0000","last_active":"2024-04-25T12:21:29.547009+0000","last_peered":"2024-04-25T12:21:29.547009+0000","last_clean":"2024-04-25T12:21:29.547009+0000","last_became_active":"2024-04-25T12:21:24.126476+0000","last_became_peered":"2024-04-25T12:21:24.126476+0000","last_unstale":"2024-04-25T12:21:29.547009+0000","last_undegraded":"2024-04-25T12:21:29.547009+0000","last_fullsized":"2024-04-25T12:21:29.547009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:19:32.516429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.286222+0000","last_change":"2024-04-25T12:21:24.135699+0000","last_active":"2024-04-25T12:21:29.286222+0000","last_peered":"2024-04-25T12:21:29.286222+0000","last_clean":"2024-04-25T12:21:29.286222+0000","last_became_active":"2024-04-25T12:21:24.135257+0000","last_became_peered":"2024-04-25T12:21:24.135257+0000","last_unstale":"2024-04-25T12:21:29.286222+0000","last_undegraded":"2024-04-25T12:21:29.286222+0000","last_fullsized":"2024-04-25T12:21:29.286222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:55:21.195220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.547552+0000","last_change":"2024-04-25T12:21:24.132760+0000","last_active":"2024-04-25T12:21:29.547552+0000","last_peered":"2024-04-25T12:21:29.547552+0000","last_clean":"2024-04-25T12:21:29.547552+0000","last_became_active":"2024-04-25T12:21:24.132225+0000","last_became_peered":"2024-04-25T12:21:24.132225+0000","last_unstale":"2024-04-25T12:21:29.547552+0000","last_undegraded":"2024-04-25T12:21:29.547552+0000","last_fullsized":"2024-04-25T12:21:29.547552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:44:23.025905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.281911+0000","last_change":"2024-04-25T12:21:24.148515+0000","last_active":"2024-04-25T12:21:29.281911+0000","last_peered":"2024-04-25T12:21:29.281911+0000","last_clean":"2024-04-25T12:21:29.281911+0000","last_became_active":"2024-04-25T12:21:24.148025+0000","last_became_peered":"2024-04-25T12:21:24.148025+0000","last_unstale":"2024-04-25T12:21:29.281911+0000","last_undegraded":"2024-04-25T12:21:29.281911+0000","last_fullsized":"2024-04-25T12:21:29.281911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:49:29.665678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.286467+0000","last_change":"2024-04-25T12:21:24.135856+0000","last_active":"2024-04-25T12:21:29.286467+0000","last_peered":"2024-04-25T12:21:29.286467+0000","last_clean":"2024-04-25T12:21:29.286467+0000","last_became_active":"2024-04-25T12:21:24.135310+0000","last_became_peered":"2024-04-25T12:21:24.135310+0000","last_unstale":"2024-04-25T12:21:29.286467+0000","last_undegraded":"2024-04-25T12:21:29.286467+0000","last_fullsized":"2024-04-25T12:21:29.286467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:02.396753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.167926+0000","last_change":"2024-04-25T12:21:24.119002+0000","last_active":"2024-04-25T12:21:29.167926+0000","last_peered":"2024-04-25T12:21:29.167926+0000","last_clean":"2024-04-25T12:21:29.167926+0000","last_became_active":"2024-04-25T12:21:24.112992+0000","last_became_peered":"2024-04-25T12:21:24.112992+0000","last_unstale":"2024-04-25T12:21:29.167926+0000","last_undegraded":"2024-04-25T12:21:29.167926+0000","last_fullsized":"2024-04-25T12:21:29.167926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:44:34.461656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.285101+0000","last_change":"2024-04-25T12:21:24.118251+0000","last_active":"2024-04-25T12:21:29.285101+0000","last_peered":"2024-04-25T12:21:29.285101+0000","last_clean":"2024-04-25T12:21:29.285101+0000","last_became_active":"2024-04-25T12:21:24.117412+0000","last_became_peered":"2024-04-25T12:21:24.117412+0000","last_unstale":"2024-04-25T12:21:29.285101+0000","last_undegraded":"2024-04-25T12:21:29.285101+0000","last_fullsized":"2024-04-25T12:21:29.285101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:44:13.238510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.167670+0000","last_change":"2024-04-25T12:21:24.138641+0000","last_active":"2024-04-25T12:21:29.167670+0000","last_peered":"2024-04-25T12:21:29.167670+0000","last_clean":"2024-04-25T12:21:29.167670+0000","last_became_active":"2024-04-25T12:21:24.137937+0000","last_became_peered":"2024-04-25T12:21:24.137937+0000","last_unstale":"2024-04-25T12:21:29.167670+0000","last_undegraded":"2024-04-25T12:21:29.167670+0000","last_fullsized":"2024-04-25T12:21:29.167670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:55:49.291319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.546657+0000","last_change":"2024-04-25T12:21:24.137779+0000","last_active":"2024-04-25T12:21:29.546657+0000","last_peered":"2024-04-25T12:21:29.546657+0000","last_clean":"2024-04-25T12:21:29.546657+0000","last_became_active":"2024-04-25T12:21:24.137431+0000","last_became_peered":"2024-04-25T12:21:24.137431+0000","last_unstale":"2024-04-25T12:21:29.546657+0000","last_undegraded":"2024-04-25T12:21:29.546657+0000","last_fullsized":"2024-04-25T12:21:29.546657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:24:24.181972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.281098+0000","last_change":"2024-04-25T12:21:24.128960+0000","last_active":"2024-04-25T12:21:29.281098+0000","last_peered":"2024-04-25T12:21:29.281098+0000","last_clean":"2024-04-25T12:21:29.281098+0000","last_became_active":"2024-04-25T12:21:24.128125+0000","last_became_peered":"2024-04-25T12:21:24.128125+0000","last_unstale":"2024-04-25T12:21:29.281098+0000","last_undegraded":"2024-04-25T12:21:29.281098+0000","last_fullsized":"2024-04-25T12:21:29.281098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:01.701850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.550097+0000","last_change":"2024-04-25T12:21:24.149001+0000","last_active":"2024-04-25T12:21:29.550097+0000","last_peered":"2024-04-25T12:21:29.550097+0000","last_clean":"2024-04-25T12:21:29.550097+0000","last_became_active":"2024-04-25T12:21:24.147230+0000","last_became_peered":"2024-04-25T12:21:24.147230+0000","last_unstale":"2024-04-25T12:21:29.550097+0000","last_undegraded":"2024-04-25T12:21:29.550097+0000","last_fullsized":"2024-04-25T12:21:29.550097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:05:17.824845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.166871+0000","last_change":"2024-04-25T12:21:24.119941+0000","last_active":"2024-04-25T12:21:29.166871+0000","last_peered":"2024-04-25T12:21:29.166871+0000","last_clean":"2024-04-25T12:21:29.166871+0000","last_became_active":"2024-04-25T12:21:24.118761+0000","last_became_peered":"2024-04-25T12:21:24.118761+0000","last_unstale":"2024-04-25T12:21:29.166871+0000","last_undegraded":"2024-04-25T12:21:29.166871+0000","last_fullsized":"2024-04-25T12:21:29.166871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:49:41.353812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.168941+0000","last_change":"2024-04-25T12:21:24.144163+0000","last_active":"2024-04-25T12:21:29.168941+0000","last_peered":"2024-04-25T12:21:29.168941+0000","last_clean":"2024-04-25T12:21:29.168941+0000","last_became_active":"2024-04-25T12:21:24.143786+0000","last_became_peered":"2024-04-25T12:21:24.143786+0000","last_unstale":"2024-04-25T12:21:29.168941+0000","last_undegraded":"2024-04-25T12:21:29.168941+0000","last_fullsized":"2024-04-25T12:21:29.168941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:17.961437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.167895+0000","last_change":"2024-04-25T12:21:24.107551+0000","last_active":"2024-04-25T12:21:29.167895+0000","last_peered":"2024-04-25T12:21:29.167895+0000","last_clean":"2024-04-25T12:21:29.167895+0000","last_became_active":"2024-04-25T12:21:24.106818+0000","last_became_peered":"2024-04-25T12:21:24.106818+0000","last_unstale":"2024-04-25T12:21:29.167895+0000","last_undegraded":"2024-04-25T12:21:29.167895+0000","last_fullsized":"2024-04-25T12:21:29.167895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:09:24.627007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.546570+0000","last_change":"2024-04-25T12:21:24.114917+0000","last_active":"2024-04-25T12:21:29.546570+0000","last_peered":"2024-04-25T12:21:29.546570+0000","last_clean":"2024-04-25T12:21:29.546570+0000","last_became_active":"2024-04-25T12:21:24.114237+0000","last_became_peered":"2024-04-25T12:21:24.114237+0000","last_unstale":"2024-04-25T12:21:29.546570+0000","last_undegraded":"2024-04-25T12:21:29.546570+0000","last_fullsized":"2024-04-25T12:21:29.546570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:32:38.296553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.546685+0000","last_change":"2024-04-25T12:21:24.132860+0000","last_active":"2024-04-25T12:21:29.546685+0000","last_peered":"2024-04-25T12:21:29.546685+0000","last_clean":"2024-04-25T12:21:29.546685+0000","last_became_active":"2024-04-25T12:21:24.132094+0000","last_became_peered":"2024-04-25T12:21:24.132094+0000","last_unstale":"2024-04-25T12:21:29.546685+0000","last_undegraded":"2024-04-25T12:21:29.546685+0000","last_fullsized":"2024-04-25T12:21:29.546685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:27:24.026145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.285468+0000","last_change":"2024-04-25T12:21:24.118083+0000","last_active":"2024-04-25T12:21:29.285468+0000","last_peered":"2024-04-25T12:21:29.285468+0000","last_clean":"2024-04-25T12:21:29.285468+0000","last_became_active":"2024-04-25T12:21:24.116766+0000","last_became_peered":"2024-04-25T12:21:24.116766+0000","last_unstale":"2024-04-25T12:21:29.285468+0000","last_undegraded":"2024-04-25T12:21:29.285468+0000","last_fullsized":"2024-04-25T12:21:29.285468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:02.432868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.167503+0000","last_change":"2024-04-25T12:21:24.124288+0000","last_active":"2024-04-25T12:21:29.167503+0000","last_peered":"2024-04-25T12:21:29.167503+0000","last_clean":"2024-04-25T12:21:29.167503+0000","last_became_active":"2024-04-25T12:21:24.116973+0000","last_became_peered":"2024-04-25T12:21:24.116973+0000","last_unstale":"2024-04-25T12:21:29.167503+0000","last_undegraded":"2024-04-25T12:21:29.167503+0000","last_fullsized":"2024-04-25T12:21:29.167503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:34:53.390321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.281584+0000","last_change":"2024-04-25T12:21:24.115615+0000","last_active":"2024-04-25T12:21:29.281584+0000","last_peered":"2024-04-25T12:21:29.281584+0000","last_clean":"2024-04-25T12:21:29.281584+0000","last_became_active":"2024-04-25T12:21:24.114829+0000","last_became_peered":"2024-04-25T12:21:24.114829+0000","last_unstale":"2024-04-25T12:21:29.281584+0000","last_undegraded":"2024-04-25T12:21:29.281584+0000","last_fullsized":"2024-04-25T12:21:29.281584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:17.961437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.281900+0000","last_change":"2024-04-25T12:21:24.117225+0000","last_active":"2024-04-25T12:21:29.281900+0000","last_peered":"2024-04-25T12:21:29.281900+0000","last_clean":"2024-04-25T12:21:29.281900+0000","last_became_active":"2024-04-25T12:21:24.116359+0000","last_became_peered":"2024-04-25T12:21:24.116359+0000","last_unstale":"2024-04-25T12:21:29.281900+0000","last_undegraded":"2024-04-25T12:21:29.281900+0000","last_fullsized":"2024-04-25T12:21:29.281900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:22:27.461512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.550024+0000","last_change":"2024-04-25T12:21:24.145198+0000","last_active":"2024-04-25T12:21:29.550024+0000","last_peered":"2024-04-25T12:21:29.550024+0000","last_clean":"2024-04-25T12:21:29.550024+0000","last_became_active":"2024-04-25T12:21:24.142353+0000","last_became_peered":"2024-04-25T12:21:24.142353+0000","last_unstale":"2024-04-25T12:21:29.550024+0000","last_undegraded":"2024-04-25T12:21:29.550024+0000","last_fullsized":"2024-04-25T12:21:29.550024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:44:24.335226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.285030+0000","last_change":"2024-04-25T12:21:24.128086+0000","last_active":"2024-04-25T12:21:29.285030+0000","last_peered":"2024-04-25T12:21:29.285030+0000","last_clean":"2024-04-25T12:21:29.285030+0000","last_became_active":"2024-04-25T12:21:24.127315+0000","last_became_peered":"2024-04-25T12:21:24.127315+0000","last_unstale":"2024-04-25T12:21:29.285030+0000","last_undegraded":"2024-04-25T12:21:29.285030+0000","last_fullsized":"2024-04-25T12:21:29.285030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:20.513145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.549407+0000","last_change":"2024-04-25T12:21:24.142394+0000","last_active":"2024-04-25T12:21:29.549407+0000","last_peered":"2024-04-25T12:21:29.549407+0000","last_clean":"2024-04-25T12:21:29.549407+0000","last_became_active":"2024-04-25T12:21:24.142029+0000","last_became_peered":"2024-04-25T12:21:24.142029+0000","last_unstale":"2024-04-25T12:21:29.549407+0000","last_undegraded":"2024-04-25T12:21:29.549407+0000","last_fullsized":"2024-04-25T12:21:29.549407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:02:56.129724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.167820+0000","last_change":"2024-04-25T12:21:24.113876+0000","last_active":"2024-04-25T12:21:29.167820+0000","last_peered":"2024-04-25T12:21:29.167820+0000","last_clean":"2024-04-25T12:21:29.167820+0000","last_became_active":"2024-04-25T12:21:24.112339+0000","last_became_peered":"2024-04-25T12:21:24.112339+0000","last_unstale":"2024-04-25T12:21:29.167820+0000","last_undegraded":"2024-04-25T12:21:29.167820+0000","last_fullsized":"2024-04-25T12:21:29.167820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:31:44.641068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.549669+0000","last_change":"2024-04-25T12:21:24.144879+0000","last_active":"2024-04-25T12:21:29.549669+0000","last_peered":"2024-04-25T12:21:29.549669+0000","last_clean":"2024-04-25T12:21:29.549669+0000","last_became_active":"2024-04-25T12:21:24.142422+0000","last_became_peered":"2024-04-25T12:21:24.142422+0000","last_unstale":"2024-04-25T12:21:29.549669+0000","last_undegraded":"2024-04-25T12:21:29.549669+0000","last_fullsized":"2024-04-25T12:21:29.549669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:03.206429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.168142+0000","last_change":"2024-04-25T12:21:24.132561+0000","last_active":"2024-04-25T12:21:29.168142+0000","last_peered":"2024-04-25T12:21:29.168142+0000","last_clean":"2024-04-25T12:21:29.168142+0000","last_became_active":"2024-04-25T12:21:24.131746+0000","last_became_peered":"2024-04-25T12:21:24.131746+0000","last_unstale":"2024-04-25T12:21:29.168142+0000","last_undegraded":"2024-04-25T12:21:29.168142+0000","last_fullsized":"2024-04-25T12:21:29.168142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:24.441417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.546747+0000","last_change":"2024-04-25T12:21:24.111956+0000","last_active":"2024-04-25T12:21:29.546747+0000","last_peered":"2024-04-25T12:21:29.546747+0000","last_clean":"2024-04-25T12:21:29.546747+0000","last_became_active":"2024-04-25T12:21:24.111154+0000","last_became_peered":"2024-04-25T12:21:24.111154+0000","last_unstale":"2024-04-25T12:21:29.546747+0000","last_undegraded":"2024-04-25T12:21:29.546747+0000","last_fullsized":"2024-04-25T12:21:29.546747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:39:56.070884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.548238+0000","last_change":"2024-04-25T12:21:24.134511+0000","last_active":"2024-04-25T12:21:29.548238+0000","last_peered":"2024-04-25T12:21:29.548238+0000","last_clean":"2024-04-25T12:21:29.548238+0000","last_became_active":"2024-04-25T12:21:24.133839+0000","last_became_peered":"2024-04-25T12:21:24.133839+0000","last_unstale":"2024-04-25T12:21:29.548238+0000","last_undegraded":"2024-04-25T12:21:29.548238+0000","last_fullsized":"2024-04-25T12:21:29.548238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:43.263673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T12:21:29.549724+0000","last_change":"2024-04-25T12:21:24.147519+0000","last_active":"2024-04-25T12:21:29.549724+0000","last_peered":"2024-04-25T12:21:29.549724+0000","last_clean":"2024-04-25T12:21:29.549724+0000","last_became_active":"2024-04-25T12:21:24.146805+0000","last_became_peered":"2024-04-25T12:21:24.146805+0000","last_unstale":"2024-04-25T12:21:29.549724+0000","last_undegraded":"2024-04-25T12:21:29.549724+0000","last_fullsized":"2024-04-25T12:21:29.549724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:23.200746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T12:21:59.832 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T12:21:59.833 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-25T12:21:59.833 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-25T12:21:59.833 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T12:21:59.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.974+0000 7fc551721640 1 Processor -- start 2024-04-25T12:21:59.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.974+0000 7fc551721640 1 -- start start 2024-04-25T12:21:59.984 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.974+0000 7fc551721640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc54c0c4b40 0x7fc54c0c5780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:59.984 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.974+0000 7fc551721640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc54c0c6150 con 0x7fc54c0c8800 2024-04-25T12:21:59.985 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.974+0000 7fc551721640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc54c0c8be0 con 0x7fc54c0c5cc0 2024-04-25T12:21:59.985 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.974+0000 7fc551721640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fc54c158090 con 0x7fc54c0c4b40 2024-04-25T12:21:59.985 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.974+0000 7fc54affd640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fc54c0c8800 0x7fc54c0c39e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:40982/0 (socket says 172.21.15.86:40982) 2024-04-25T12:21:59.985 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.974+0000 7fc54affd640 1 -- 172.21.15.86:0/938665275 learned_addr learned my addr 172.21.15.86:0/938665275 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-04-25T12:21:59.985 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.978+0000 7fc54a7fc640 1 --2- 172.21.15.86:0/938665275 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc54c0c4b40 0x7fc54c0c5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:59.985 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.978+0000 7fc549ffb640 1 -- 172.21.15.86:0/938665275 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 104822826 0 0) 0x7fc54c0c6150 con 0x7fc54c0c8800 2024-04-25T12:21:59.985 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.978+0000 7fc549ffb640 1 -- 172.21.15.86:0/938665275 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc534003450 con 0x7fc54c0c8800 2024-04-25T12:21:59.985 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.978+0000 7fc549ffb640 1 -- 172.21.15.86:0/938665275 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2086542541 0 0) 0x7fc54c0c8be0 con 0x7fc54c0c5cc0 2024-04-25T12:21:59.985 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.978+0000 7fc549ffb640 1 -- 172.21.15.86:0/938665275 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc54c0c6150 con 0x7fc54c0c5cc0 2024-04-25T12:21:59.985 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.978+0000 7fc549ffb640 1 -- 172.21.15.86:0/938665275 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2459892693 0 0) 0x7fc534003450 con 0x7fc54c0c8800 2024-04-25T12:21:59.985 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.978+0000 7fc549ffb640 1 -- 172.21.15.86:0/938665275 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc54c0c4b40 msgr2=0x7fc54c0c5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:59.985 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.978+0000 7fc549ffb640 1 --2- 172.21.15.86:0/938665275 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc54c0c4b40 0x7fc54c0c5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.986 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.978+0000 7fc549ffb640 1 -- 172.21.15.86:0/938665275 >> v1:172.21.15.134:6789/0 conn(0x7fc54c0c5cc0 legacy=0x7fc54c161eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:59.986 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.978+0000 7fc549ffb640 1 -- 172.21.15.86:0/938665275 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc54c0c4790 con 0x7fc54c0c8800 2024-04-25T12:21:59.986 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.978+0000 7fc549ffb640 1 -- 172.21.15.86:0/938665275 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1387950573 0 0) 0x7fc544001980 con 0x7fc54c0c8800 2024-04-25T12:21:59.986 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.978+0000 7fc549ffb640 1 -- 172.21.15.86:0/938665275 >> v1:172.21.15.86:6789/0 conn(0x7fc54c0c8800 legacy=0x7fc54c0c39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:59.986 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.978+0000 7fc549ffb640 1 --2- 172.21.15.86:0/938665275 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc54c0c4b40 0x7fc534003c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:59.986 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.978+0000 7fc549ffb640 1 --2- 172.21.15.86:0/938665275 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc534008860 0x7fc53400ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:59.986 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.978+0000 7fc549ffb640 1 --2- 172.21.15.86:0/938665275 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc53400b190 0x7fc53400d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:59.986 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.978+0000 7fc549ffb640 1 -- 172.21.15.86:0/938665275 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc54c158090 con 0x7fc534008860 2024-04-25T12:21:59.986 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.978+0000 7fc549ffb640 1 -- 172.21.15.86:0/938665275 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc53400de40 con 0x7fc53400b190 2024-04-25T12:21:59.986 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.978+0000 7fc549ffb640 1 -- 172.21.15.86:0/938665275 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fc53400e040 con 0x7fc54c0c4b40 2024-04-25T12:21:59.986 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.978+0000 7fc54a7fc640 1 --2- 172.21.15.86:0/938665275 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc534008860 0x7fc53400ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:59.986 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.978+0000 7fc54b7fe640 1 --2- 172.21.15.86:0/938665275 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc53400b190 0x7fc53400d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:59.986 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.978+0000 7fc54affd640 1 --2- 172.21.15.86:0/938665275 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc54c0c4b40 0x7fc534003c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:59.987 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.978+0000 7fc54a7fc640 1 -- 172.21.15.86:0/938665275 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc54c0c4b40 msgr2=0x7fc534003c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:59.987 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.978+0000 7fc54a7fc640 1 --2- 172.21.15.86:0/938665275 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc54c0c4b40 0x7fc534003c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.987 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.978+0000 7fc54a7fc640 1 -- 172.21.15.86:0/938665275 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc53400b190 msgr2=0x7fc53400d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:59.987 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.978+0000 7fc54a7fc640 1 --2- 172.21.15.86:0/938665275 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc53400b190 0x7fc53400d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.987 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.978+0000 7fc54a7fc640 1 -- 172.21.15.86:0/938665275 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc534003450 con 0x7fc534008860 2024-04-25T12:21:59.987 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.978+0000 7fc54affd640 1 --2- 172.21.15.86:0/938665275 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc54c0c4b40 0x7fc534003c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:21:59.990 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.978+0000 7fc54a7fc640 1 --2- 172.21.15.86:0/938665275 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc534008860 0x7fc53400ac50 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc540009ae0 tx=0x7fc54001ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d78f324896431f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:59.990 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.978+0000 7fc549ffb640 1 -- 172.21.15.86:0/938665275 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5400b2070 con 0x7fc534008860 2024-04-25T12:21:59.990 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.978+0000 7fc549ffb640 1 -- 172.21.15.86:0/938665275 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5400a55e0 con 0x7fc534008860 2024-04-25T12:21:59.990 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.978+0000 7fc549ffb640 1 -- 172.21.15.86:0/938665275 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5400096b0 con 0x7fc534008860 2024-04-25T12:21:59.990 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.978+0000 7fc551721640 1 -- 172.21.15.86:0/938665275 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc534008860 msgr2=0x7fc53400ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:59.990 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.978+0000 7fc551721640 1 --2- 172.21.15.86:0/938665275 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc534008860 0x7fc53400ac50 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc540009ae0 tx=0x7fc54001ca70 comp rx=0 tx=0).stop 2024-04-25T12:21:59.990 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.978+0000 7fc54b7fe640 1 -- 172.21.15.86:0/938665275 reap_dead start 2024-04-25T12:21:59.990 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.978+0000 7fc551721640 1 -- 172.21.15.86:0/938665275 shutdown_connections 2024-04-25T12:21:59.991 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.982+0000 7fc551721640 1 -- 172.21.15.86:0/938665275 >> 172.21.15.86:0/938665275 conn(0x7fc54c06b9d0 msgr2=0x7fc54c06bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:59.991 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.982+0000 7fc551721640 1 -- 172.21.15.86:0/938665275 shutdown_connections 2024-04-25T12:21:59.991 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.982+0000 7fc551721640 1 -- 172.21.15.86:0/938665275 wait complete. 2024-04-25T12:21:59.991 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.982+0000 7fc551721640 1 Processor -- start 2024-04-25T12:21:59.991 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.982+0000 7fc551721640 1 -- start start 2024-04-25T12:21:59.991 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.982+0000 7fc551721640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc534008860 0x7fc54c154740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:59.991 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.982+0000 7fc551721640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc54c1f1c00 0x7fc54c1f2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:59.991 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.982+0000 7fc551721640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc54c14ad80 0x7fc54c14b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:59.991 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.982+0000 7fc551721640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc54c0c52f0 con 0x7fc534008860 2024-04-25T12:21:59.991 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.982+0000 7fc551721640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc54c1585c0 con 0x7fc54c14ad80 2024-04-25T12:21:59.991 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.982+0000 7fc551721640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fc54c068610 con 0x7fc54c1f1c00 2024-04-25T12:21:59.991 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.982+0000 7fc54affd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc534008860 0x7fc54c154740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:59.991 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.982+0000 7fc54affd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc534008860 0x7fc54c154740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:59656/0 (socket says 172.21.15.86:59656) 2024-04-25T12:21:59.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.982+0000 7fc54affd640 1 -- 172.21.15.86:0/462964484 learned_addr learned my addr 172.21.15.86:0/462964484 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:21:59.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.982+0000 7fc54a7fc640 1 --2- 172.21.15.86:0/462964484 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc54c1f1c00 0x7fc54c1f2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:59.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.982+0000 7fc54b7fe640 1 --2- 172.21.15.86:0/462964484 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc54c14ad80 0x7fc54c14b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:59.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.982+0000 7fc54affd640 1 -- 172.21.15.86:0/462964484 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc54c1f1c00 msgr2=0x7fc54c1f2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:59.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.982+0000 7fc54affd640 1 --2- 172.21.15.86:0/462964484 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc54c1f1c00 0x7fc54c1f2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.982+0000 7fc54affd640 1 -- 172.21.15.86:0/462964484 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc54c14ad80 msgr2=0x7fc54c14b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:59.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.982+0000 7fc54affd640 1 --2- 172.21.15.86:0/462964484 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc54c14ad80 0x7fc54c14b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.982+0000 7fc54affd640 1 -- 172.21.15.86:0/462964484 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc54c1f2580 con 0x7fc534008860 2024-04-25T12:21:59.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.982+0000 7fc54affd640 1 --2- 172.21.15.86:0/462964484 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc534008860 0x7fc54c154740 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc544002060 tx=0x7fc54400b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:59.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.982+0000 7fc5337fe640 1 -- 172.21.15.86:0/462964484 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc544019070 con 0x7fc534008860 2024-04-25T12:21:59.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.982+0000 7fc5337fe640 1 -- 172.21.15.86:0/462964484 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc54400bb50 con 0x7fc534008860 2024-04-25T12:21:59.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.982+0000 7fc551721640 1 -- 172.21.15.86:0/462964484 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc54c154d80 con 0x7fc534008860 2024-04-25T12:21:59.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.982+0000 7fc5337fe640 1 -- 172.21.15.86:0/462964484 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5440070d0 con 0x7fc534008860 2024-04-25T12:21:59.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.982+0000 7fc551721640 1 -- 172.21.15.86:0/462964484 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc54c1f0af0 con 0x7fc534008860 2024-04-25T12:21:59.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.982+0000 7fc551721640 1 -- 172.21.15.86:0/462964484 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc54c075df0 con 0x7fc534008860 2024-04-25T12:21:59.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.982+0000 7fc5337fe640 1 -- 172.21.15.86:0/462964484 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc54401c070 con 0x7fc534008860 2024-04-25T12:21:59.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.986+0000 7fc5337fe640 1 --2- 172.21.15.86:0/462964484 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fc538068380 0x7fc53806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:59.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.986+0000 7fc54a7fc640 1 --2- 172.21.15.86:0/462964484 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fc538068380 0x7fc53806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:59.994 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.986+0000 7fc5337fe640 1 -- 172.21.15.86:0/462964484 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fc544086e10 con 0x7fc534008860 2024-04-25T12:21:59.994 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.986+0000 7fc54a7fc640 1 --2- 172.21.15.86:0/462964484 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fc538068380 0x7fc53806a840 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc5400af000 tx=0x7fc540008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:59.995 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:21:59.990+0000 7fc5337fe640 1 -- 172.21.15.86:0/462964484 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc54c1f2580 con 0x7fc534008860 2024-04-25T12:22:00.181 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:00.174+0000 7fc551721640 1 -- 172.21.15.86:0/462964484 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc54c15dc70 con 0x7fc534008860 2024-04-25T12:22:00.181 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:00.174+0000 7fc5337fe640 1 -- 172.21.15.86:0/462964484 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+196 (secure 0 0 0) 0x7fc544057000 con 0x7fc534008860 2024-04-25T12:22:00.181 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:22:00.182 INFO:teuthology.orchestra.run.smithi086.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2024-04-25T12:22:00.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:00.178+0000 7fc551721640 1 -- 172.21.15.86:0/462964484 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fc538068380 msgr2=0x7fc53806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:00.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:00.178+0000 7fc551721640 1 --2- 172.21.15.86:0/462964484 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fc538068380 0x7fc53806a840 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc5400af000 tx=0x7fc540008040 comp rx=0 tx=0).stop 2024-04-25T12:22:00.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:00.178+0000 7fc551721640 1 -- 172.21.15.86:0/462964484 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc534008860 msgr2=0x7fc54c154740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:00.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:00.178+0000 7fc551721640 1 --2- 172.21.15.86:0/462964484 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc534008860 0x7fc54c154740 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc544002060 tx=0x7fc54400b4a0 comp rx=0 tx=0).stop 2024-04-25T12:22:00.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:00.178+0000 7fc551721640 1 -- 172.21.15.86:0/462964484 shutdown_connections 2024-04-25T12:22:00.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:00.178+0000 7fc551721640 1 --2- 172.21.15.86:0/462964484 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc54c14ad80 0x7fc54c14b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:00.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:00.178+0000 7fc551721640 1 --2- 172.21.15.86:0/462964484 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc54c1f1c00 0x7fc54c1f2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:00.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:00.178+0000 7fc551721640 1 --2- 172.21.15.86:0/462964484 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fc538068380 0x7fc53806a840 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:00.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:00.178+0000 7fc551721640 1 --2- 172.21.15.86:0/462964484 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc534008860 0x7fc54c154740 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:00.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:00.178+0000 7fc551721640 1 -- 172.21.15.86:0/462964484 >> 172.21.15.86:0/462964484 conn(0x7fc54c06b9d0 msgr2=0x7fc54c06eef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:00.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:00.178+0000 7fc551721640 1 -- 172.21.15.86:0/462964484 shutdown_connections 2024-04-25T12:22:00.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:00.178+0000 7fc551721640 1 -- 172.21.15.86:0/462964484 wait complete. 2024-04-25T12:22:03.201 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T12:22:03.326 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.318+0000 7f65b94d9640 1 Processor -- start 2024-04-25T12:22:03.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.318+0000 7f65b94d9640 1 -- start start 2024-04-25T12:22:03.344 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.322+0000 7f65b94d9640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f65b406daf0 0x7f65b40702e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:03.344 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.322+0000 7f65b94d9640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f65b406df10 0x7f65b4070820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:03.344 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.322+0000 7f65b94d9640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65b415b180 con 0x7f65b41443c0 2024-04-25T12:22:03.344 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.322+0000 7f65b94d9640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f65b41447a0 con 0x7f65b406df10 2024-04-25T12:22:03.344 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.322+0000 7f65b94d9640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f65b415b420 con 0x7f65b406daf0 2024-04-25T12:22:03.344 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.322+0000 7f65b2ffd640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f65b41443c0 0x7f65b4072ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.86:52606/0 (socket says 172.21.15.86:52606) 2024-04-25T12:22:03.345 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.322+0000 7f65b2ffd640 1 -- 172.21.15.86:0/3710340791 learned_addr learned my addr 172.21.15.86:0/3710340791 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-04-25T12:22:03.345 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.322+0000 7f65b27fc640 1 --2- 172.21.15.86:0/3710340791 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f65b406daf0 0x7f65b40702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:03.345 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.322+0000 7f65b37fe640 1 --2- 172.21.15.86:0/3710340791 >> v2:172.21.15.134:3300/0 conn(0x7f65b406df10 0x7f65b4070820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:03.345 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.322+0000 7f65b1ffb640 1 -- 172.21.15.86:0/3710340791 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 755383150 0 0) 0x7f65b415b180 con 0x7f65b41443c0 2024-04-25T12:22:03.345 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.322+0000 7f65b1ffb640 1 -- 172.21.15.86:0/3710340791 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65a0003530 con 0x7f65b41443c0 2024-04-25T12:22:03.345 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.322+0000 7f65b27fc640 1 -- 172.21.15.86:0/3710340791 >> v2:172.21.15.134:3300/0 conn(0x7f65b406df10 msgr2=0x7f65b4070820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:03.345 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.322+0000 7f65b27fc640 1 --2- 172.21.15.86:0/3710340791 >> v2:172.21.15.134:3300/0 conn(0x7f65b406df10 0x7f65b4070820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:03.345 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.322+0000 7f65b27fc640 1 -- 172.21.15.86:0/3710340791 >> v1:172.21.15.134:6789/0 conn(0x7f65b41443c0 legacy=0x7f65b4072ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:03.345 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.322+0000 7f65b27fc640 1 -- 172.21.15.86:0/3710340791 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65b415b700 con 0x7f65b406daf0 2024-04-25T12:22:03.345 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.322+0000 7f65b27fc640 1 --2- 172.21.15.86:0/3710340791 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f65b406daf0 0x7f65b40702e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f659c0097c0 tx=0x7f659c01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b916ee4f3c965c87 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:03.345 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.322+0000 7f65b1ffb640 1 -- 172.21.15.86:0/3710340791 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f659c0b0070 con 0x7f65b406daf0 2024-04-25T12:22:03.346 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.322+0000 7f65b1ffb640 1 -- 172.21.15.86:0/3710340791 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f659c0ab600 con 0x7f65b406daf0 2024-04-25T12:22:03.346 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.322+0000 7f65b1ffb640 1 -- 172.21.15.86:0/3710340791 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f659c0ab9b0 con 0x7f65b406daf0 2024-04-25T12:22:03.346 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.326+0000 7f65b94d9640 1 -- 172.21.15.86:0/3710340791 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f65b406daf0 msgr2=0x7f65b40702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:03.346 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.326+0000 7f65b94d9640 1 --2- 172.21.15.86:0/3710340791 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f65b406daf0 0x7f65b40702e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f659c0097c0 tx=0x7f659c01c4a0 comp rx=0 tx=0).stop 2024-04-25T12:22:03.346 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.326+0000 7f65b94d9640 1 -- 172.21.15.86:0/3710340791 shutdown_connections 2024-04-25T12:22:03.346 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.326+0000 7f65b94d9640 1 --2- 172.21.15.86:0/3710340791 >> v2:172.21.15.134:3300/0 conn(0x7f65b406df10 0x7f65b4070820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:03.346 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.326+0000 7f65b94d9640 1 --2- 172.21.15.86:0/3710340791 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f65b406daf0 0x7f65b40702e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:03.346 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.326+0000 7f65b94d9640 1 -- 172.21.15.86:0/3710340791 >> 172.21.15.86:0/3710340791 conn(0x7f65b406f7c0 msgr2=0x7f65b406fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:03.346 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.326+0000 7f65b94d9640 1 -- 172.21.15.86:0/3710340791 shutdown_connections 2024-04-25T12:22:03.346 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.326+0000 7f65b94d9640 1 -- 172.21.15.86:0/3710340791 wait complete. 2024-04-25T12:22:03.347 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.326+0000 7f65b94d9640 1 Processor -- start 2024-04-25T12:22:03.347 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.326+0000 7f65b94d9640 1 -- start start 2024-04-25T12:22:03.347 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.326+0000 7f65b94d9640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65b406daf0 0x7f65b415cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:03.347 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.326+0000 7f65b94d9640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f65b406df10 0x7f65b41397e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:03.347 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.326+0000 7f65b94d9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65b41443c0 0x7f65b4139d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:03.347 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.326+0000 7f65b94d9640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f65b4167b80 con 0x7f65b406daf0 2024-04-25T12:22:03.347 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.326+0000 7f65b94d9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f65b4167a00 con 0x7f65b41443c0 2024-04-25T12:22:03.347 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.326+0000 7f65b94d9640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f65b4167d00 con 0x7f65b406df10 2024-04-25T12:22:03.347 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.326+0000 7f65b2ffd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65b406daf0 0x7f65b415cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:03.347 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.326+0000 7f65b2ffd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65b406daf0 0x7f65b415cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60216/0 (socket says 172.21.15.86:60216) 2024-04-25T12:22:03.347 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.326+0000 7f65b2ffd640 1 -- 172.21.15.86:0/3371793020 learned_addr learned my addr 172.21.15.86:0/3371793020 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:03.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.326+0000 7f65b27fc640 1 --2- 172.21.15.86:0/3371793020 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f65b406df10 0x7f65b41397e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:03.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.326+0000 7f65b37fe640 1 --2- 172.21.15.86:0/3371793020 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65b41443c0 0x7f65b4139d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:03.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.326+0000 7f65b2ffd640 1 -- 172.21.15.86:0/3371793020 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f65b406df10 msgr2=0x7f65b41397e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:03.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.326+0000 7f65b2ffd640 1 --2- 172.21.15.86:0/3371793020 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f65b406df10 0x7f65b41397e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:03.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.326+0000 7f65b2ffd640 1 -- 172.21.15.86:0/3371793020 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65b41443c0 msgr2=0x7f65b4139d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:03.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.326+0000 7f65b2ffd640 1 --2- 172.21.15.86:0/3371793020 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65b41443c0 0x7f65b4139d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:03.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.326+0000 7f65b2ffd640 1 -- 172.21.15.86:0/3371793020 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65b415c540 con 0x7f65b406daf0 2024-04-25T12:22:03.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.326+0000 7f65b2ffd640 1 --2- 172.21.15.86:0/3371793020 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65b406daf0 0x7f65b415cd90 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f65ac00c3c0 tx=0x7f65ac00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:03.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.330+0000 7f65ab7fe640 1 -- 172.21.15.86:0/3371793020 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ac017070 con 0x7f65b406daf0 2024-04-25T12:22:03.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.330+0000 7f65ab7fe640 1 -- 172.21.15.86:0/3371793020 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65ac005cf0 con 0x7f65b406daf0 2024-04-25T12:22:03.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.330+0000 7f65ab7fe640 1 -- 172.21.15.86:0/3371793020 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ac0072f0 con 0x7f65b406daf0 2024-04-25T12:22:03.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.330+0000 7f65b94d9640 1 -- 172.21.15.86:0/3371793020 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65b41f8030 con 0x7f65b406daf0 2024-04-25T12:22:03.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.330+0000 7f65b94d9640 1 -- 172.21.15.86:0/3371793020 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65b41f7270 con 0x7f65b406daf0 2024-04-25T12:22:03.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.330+0000 7f65b94d9640 1 -- 172.21.15.86:0/3371793020 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65b4075df0 con 0x7f65b406daf0 2024-04-25T12:22:03.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.330+0000 7f65ab7fe640 1 -- 172.21.15.86:0/3371793020 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f65ac01a070 con 0x7f65b406daf0 2024-04-25T12:22:03.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.330+0000 7f65ab7fe640 1 --2- 172.21.15.86:0/3371793020 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f6594068380 0x7f659406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:03.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.334+0000 7f65ab7fe640 1 -- 172.21.15.86:0/3371793020 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f65ac085f80 con 0x7f65b406daf0 2024-04-25T12:22:03.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.334+0000 7f65b27fc640 1 --2- 172.21.15.86:0/3371793020 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f6594068380 0x7f659406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:03.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.334+0000 7f65b27fc640 1 --2- 172.21.15.86:0/3371793020 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f6594068380 0x7f659406a840 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f659c0ad000 tx=0x7f659c0a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:03.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.342+0000 7f65ab7fe640 1 -- 172.21.15.86:0/3371793020 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f65ac055c40 con 0x7f65b406daf0 2024-04-25T12:22:03.535 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.530+0000 7f65b94d9640 1 -- 172.21.15.86:0/3371793020 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f65b4075370 con 0x7f65b406daf0 2024-04-25T12:22:03.535 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.530+0000 7f65ab7fe640 1 -- 172.21.15.86:0/3371793020 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+196 (secure 0 0 0) 0x7f65ac059f40 con 0x7f65b406daf0 2024-04-25T12:22:03.536 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:22:03.536 INFO:teuthology.orchestra.run.smithi086.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2024-04-25T12:22:03.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.530+0000 7f65b94d9640 1 -- 172.21.15.86:0/3371793020 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f6594068380 msgr2=0x7f659406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:03.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.530+0000 7f65b94d9640 1 --2- 172.21.15.86:0/3371793020 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f6594068380 0x7f659406a840 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f659c0ad000 tx=0x7f659c0a6000 comp rx=0 tx=0).stop 2024-04-25T12:22:03.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.530+0000 7f65b94d9640 1 -- 172.21.15.86:0/3371793020 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65b406daf0 msgr2=0x7f65b415cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:03.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.530+0000 7f65b94d9640 1 --2- 172.21.15.86:0/3371793020 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65b406daf0 0x7f65b415cd90 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f65ac00c3c0 tx=0x7f65ac00c880 comp rx=0 tx=0).stop 2024-04-25T12:22:03.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.530+0000 7f65b94d9640 1 -- 172.21.15.86:0/3371793020 shutdown_connections 2024-04-25T12:22:03.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.530+0000 7f65b94d9640 1 --2- 172.21.15.86:0/3371793020 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65b41443c0 0x7f65b4139d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:03.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.530+0000 7f65b94d9640 1 --2- 172.21.15.86:0/3371793020 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f65b406df10 0x7f65b41397e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:03.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.530+0000 7f65b94d9640 1 --2- 172.21.15.86:0/3371793020 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f6594068380 0x7f659406a840 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:03.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.530+0000 7f65b94d9640 1 --2- 172.21.15.86:0/3371793020 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65b406daf0 0x7f65b415cd90 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:03.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.530+0000 7f65b94d9640 1 -- 172.21.15.86:0/3371793020 >> 172.21.15.86:0/3371793020 conn(0x7f65b406f7c0 msgr2=0x7f65b415a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:03.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.530+0000 7f65b94d9640 1 -- 172.21.15.86:0/3371793020 shutdown_connections 2024-04-25T12:22:03.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:03.530+0000 7f65b94d9640 1 -- 172.21.15.86:0/3371793020 wait complete. 2024-04-25T12:22:06.553 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T12:22:06.682 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.674+0000 7f8d4c621640 1 Processor -- start 2024-04-25T12:22:06.682 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.674+0000 7f8d4c621640 1 -- start start 2024-04-25T12:22:06.683 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.678+0000 7f8d4c621640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8d4414fbc0 0x7f8d4406f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:06.683 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.678+0000 7f8d4c621640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8d44074100 0x7f8d440c7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:06.684 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.678+0000 7f8d4c621640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d440c5d70 con 0x7f8d4414ffa0 2024-04-25T12:22:06.684 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.678+0000 7f8d4c621640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f8d440c6050 con 0x7f8d44074100 2024-04-25T12:22:06.684 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.678+0000 7f8d4c621640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f8d440c6330 con 0x7f8d4414fbc0 2024-04-25T12:22:06.684 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.678+0000 7f8d49bbc640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f8d4414ffa0 0x7f8d440c8220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:58462/0 (socket says 172.21.15.86:58462) 2024-04-25T12:22:06.684 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.678+0000 7f8d49bbc640 1 -- 172.21.15.86:0/3526858432 learned_addr learned my addr 172.21.15.86:0/3526858432 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-04-25T12:22:06.684 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.678+0000 7f8d4a3bd640 1 --2- 172.21.15.86:0/3526858432 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8d4414fbc0 0x7f8d4406f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:06.684 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.678+0000 7f8d4abbe640 1 --2- 172.21.15.86:0/3526858432 >> v2:172.21.15.134:3300/0 conn(0x7f8d44074100 0x7f8d440c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:06.684 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.678+0000 7f8d493bb640 1 -- 172.21.15.86:0/3526858432 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3887507220 0 0) 0x7f8d440c5d70 con 0x7f8d4414ffa0 2024-04-25T12:22:06.684 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.678+0000 7f8d493bb640 1 -- 172.21.15.86:0/3526858432 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d30003530 con 0x7f8d4414ffa0 2024-04-25T12:22:06.685 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.678+0000 7f8d493bb640 1 -- 172.21.15.86:0/3526858432 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3544220595 0 0) 0x7f8d30003530 con 0x7f8d4414ffa0 2024-04-25T12:22:06.685 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.678+0000 7f8d493bb640 1 -- 172.21.15.86:0/3526858432 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8d4414fbc0 msgr2=0x7f8d4406f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:06.685 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.678+0000 7f8d493bb640 1 --2- 172.21.15.86:0/3526858432 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8d4414fbc0 0x7f8d4406f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:06.685 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.678+0000 7f8d493bb640 1 -- 172.21.15.86:0/3526858432 >> v2:172.21.15.134:3300/0 conn(0x7f8d44074100 msgr2=0x7f8d440c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:06.685 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.678+0000 7f8d493bb640 1 --2- 172.21.15.86:0/3526858432 >> v2:172.21.15.134:3300/0 conn(0x7f8d44074100 0x7f8d440c7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:06.686 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.678+0000 7f8d493bb640 1 -- 172.21.15.86:0/3526858432 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d440c6610 con 0x7f8d4414ffa0 2024-04-25T12:22:06.686 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.678+0000 7f8d493bb640 1 -- 172.21.15.86:0/3526858432 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1387950573 0 0) 0x7f8d34001680 con 0x7f8d4414ffa0 2024-04-25T12:22:06.686 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.678+0000 7f8d493bb640 1 -- 172.21.15.86:0/3526858432 >> v1:172.21.15.86:6789/0 conn(0x7f8d4414ffa0 legacy=0x7f8d440c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:06.686 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.678+0000 7f8d493bb640 1 --2- 172.21.15.86:0/3526858432 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8d300039c0 0x7f8d30003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:06.686 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.678+0000 7f8d493bb640 1 --2- 172.21.15.86:0/3526858432 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8d4414fbc0 0x7f8d30004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:06.686 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.678+0000 7f8d493bb640 1 --2- 172.21.15.86:0/3526858432 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d30004d50 0x7f8d300051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:06.686 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.678+0000 7f8d493bb640 1 -- 172.21.15.86:0/3526858432 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f8d440c6050 con 0x7f8d300039c0 2024-04-25T12:22:06.686 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.678+0000 7f8d493bb640 1 -- 172.21.15.86:0/3526858432 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8d440c6330 con 0x7f8d30004d50 2024-04-25T12:22:06.686 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.678+0000 7f8d493bb640 1 -- 172.21.15.86:0/3526858432 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f8d3000b9d0 con 0x7f8d4414fbc0 2024-04-25T12:22:06.686 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.678+0000 7f8d4a3bd640 1 --2- 172.21.15.86:0/3526858432 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8d300039c0 0x7f8d30003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:06.686 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.678+0000 7f8d4abbe640 1 --2- 172.21.15.86:0/3526858432 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d30004d50 0x7f8d300051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:06.686 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.678+0000 7f8d49bbc640 1 --2- 172.21.15.86:0/3526858432 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8d4414fbc0 0x7f8d30004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:06.686 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.678+0000 7f8d4a3bd640 1 -- 172.21.15.86:0/3526858432 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8d4414fbc0 msgr2=0x7f8d30004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:06.686 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.678+0000 7f8d4a3bd640 1 --2- 172.21.15.86:0/3526858432 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8d4414fbc0 0x7f8d30004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:06.686 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.678+0000 7f8d4a3bd640 1 -- 172.21.15.86:0/3526858432 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d30004d50 msgr2=0x7f8d300051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:06.687 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.678+0000 7f8d4a3bd640 1 --2- 172.21.15.86:0/3526858432 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d30004d50 0x7f8d300051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:06.687 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.678+0000 7f8d4a3bd640 1 -- 172.21.15.86:0/3526858432 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d30003530 con 0x7f8d300039c0 2024-04-25T12:22:06.688 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.678+0000 7f8d4a3bd640 1 --2- 172.21.15.86:0/3526858432 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8d300039c0 0x7f8d30003de0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8d40009ae0 tx=0x7f8d4001ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d964aee25c9be474 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:06.688 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.678+0000 7f8d493bb640 1 -- 172.21.15.86:0/3526858432 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d400b2070 con 0x7f8d300039c0 2024-04-25T12:22:06.688 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.678+0000 7f8d493bb640 1 -- 172.21.15.86:0/3526858432 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d400a5660 con 0x7f8d300039c0 2024-04-25T12:22:06.688 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.678+0000 7f8d493bb640 1 -- 172.21.15.86:0/3526858432 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d400096b0 con 0x7f8d300039c0 2024-04-25T12:22:06.688 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.682+0000 7f8d4c621640 1 -- 172.21.15.86:0/3526858432 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8d300039c0 msgr2=0x7f8d30003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:06.688 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.682+0000 7f8d4c621640 1 --2- 172.21.15.86:0/3526858432 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8d300039c0 0x7f8d30003de0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8d40009ae0 tx=0x7f8d4001ca70 comp rx=0 tx=0).stop 2024-04-25T12:22:06.688 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.682+0000 7f8d4abbe640 1 -- 172.21.15.86:0/3526858432 reap_dead start 2024-04-25T12:22:06.688 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.682+0000 7f8d4c621640 1 -- 172.21.15.86:0/3526858432 shutdown_connections 2024-04-25T12:22:06.688 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.682+0000 7f8d4c621640 1 -- 172.21.15.86:0/3526858432 >> 172.21.15.86:0/3526858432 conn(0x7f8d4406b9d0 msgr2=0x7f8d4406bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:06.688 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.682+0000 7f8d4c621640 1 -- 172.21.15.86:0/3526858432 shutdown_connections 2024-04-25T12:22:06.688 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.682+0000 7f8d4c621640 1 -- 172.21.15.86:0/3526858432 wait complete. 2024-04-25T12:22:06.689 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.682+0000 7f8d4c621640 1 Processor -- start 2024-04-25T12:22:06.689 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.682+0000 7f8d4c621640 1 -- start start 2024-04-25T12:22:06.691 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.682+0000 7f8d4c621640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8d300039c0 0x7f8d44145360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:06.691 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.682+0000 7f8d4c621640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8d44159bc0 0x7f8d44160990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:06.691 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.682+0000 7f8d4c621640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d44161280 0x7f8d4413fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:06.691 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.682+0000 7f8d4c621640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f8d440c8930 con 0x7f8d44159bc0 2024-04-25T12:22:06.691 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.682+0000 7f8d4c621640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8d4406fb10 con 0x7f8d44161280 2024-04-25T12:22:06.691 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.682+0000 7f8d4c621640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f8d440c8ab0 con 0x7f8d300039c0 2024-04-25T12:22:06.691 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.682+0000 7f8d49bbc640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8d44159bc0 0x7f8d44160990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:06.691 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.682+0000 7f8d49bbc640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8d44159bc0 0x7f8d44160990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60244/0 (socket says 172.21.15.86:60244) 2024-04-25T12:22:06.691 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.682+0000 7f8d49bbc640 1 -- 172.21.15.86:0/640630837 learned_addr learned my addr 172.21.15.86:0/640630837 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:06.691 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.682+0000 7f8d4a3bd640 1 --2- 172.21.15.86:0/640630837 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8d300039c0 0x7f8d44145360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:06.691 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.682+0000 7f8d4abbe640 1 --2- 172.21.15.86:0/640630837 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d44161280 0x7f8d4413fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:06.691 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.682+0000 7f8d49bbc640 1 -- 172.21.15.86:0/640630837 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8d300039c0 msgr2=0x7f8d44145360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:06.691 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.682+0000 7f8d49bbc640 1 --2- 172.21.15.86:0/640630837 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8d300039c0 0x7f8d44145360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:06.691 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.682+0000 7f8d49bbc640 1 -- 172.21.15.86:0/640630837 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d44161280 msgr2=0x7f8d4413fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:06.692 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.682+0000 7f8d49bbc640 1 --2- 172.21.15.86:0/640630837 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d44161280 0x7f8d4413fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:06.692 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.682+0000 7f8d49bbc640 1 -- 172.21.15.86:0/640630837 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d44152f80 con 0x7f8d44159bc0 2024-04-25T12:22:06.692 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.682+0000 7f8d4a3bd640 1 --2- 172.21.15.86:0/640630837 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8d300039c0 0x7f8d44145360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:22:06.692 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.682+0000 7f8d4abbe640 1 --2- 172.21.15.86:0/640630837 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d44161280 0x7f8d4413fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:22:06.692 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.682+0000 7f8d49bbc640 1 --2- 172.21.15.86:0/640630837 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8d44159bc0 0x7f8d44160990 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8d3400e850 tx=0x7f8d3400ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:06.692 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.682+0000 7f8d3affd640 1 -- 172.21.15.86:0/640630837 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d3400c870 con 0x7f8d44159bc0 2024-04-25T12:22:06.692 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.682+0000 7f8d3affd640 1 -- 172.21.15.86:0/640630837 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d34018070 con 0x7f8d44159bc0 2024-04-25T12:22:06.692 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.682+0000 7f8d4c621640 1 -- 172.21.15.86:0/640630837 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d44162500 con 0x7f8d44159bc0 2024-04-25T12:22:06.692 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.682+0000 7f8d3affd640 1 -- 172.21.15.86:0/640630837 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d3400cc50 con 0x7f8d44159bc0 2024-04-25T12:22:06.692 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.682+0000 7f8d4c621640 1 -- 172.21.15.86:0/640630837 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d4415fbd0 con 0x7f8d44159bc0 2024-04-25T12:22:06.693 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.686+0000 7f8d4c621640 1 -- 172.21.15.86:0/640630837 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d44075df0 con 0x7f8d44159bc0 2024-04-25T12:22:06.693 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.686+0000 7f8d3affd640 1 -- 172.21.15.86:0/640630837 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8d3401d460 con 0x7f8d44159bc0 2024-04-25T12:22:06.693 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.686+0000 7f8d3affd640 1 --2- 172.21.15.86:0/640630837 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f8d28068380 0x7f8d2806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:06.693 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.686+0000 7f8d3affd640 1 -- 172.21.15.86:0/640630837 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f8d34086ca0 con 0x7f8d44159bc0 2024-04-25T12:22:06.693 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.686+0000 7f8d4a3bd640 1 --2- 172.21.15.86:0/640630837 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f8d28068380 0x7f8d2806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:06.693 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.686+0000 7f8d4a3bd640 1 --2- 172.21.15.86:0/640630837 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f8d28068380 0x7f8d2806a840 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8d400af000 tx=0x7f8d400046d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:06.696 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.690+0000 7f8d3affd640 1 -- 172.21.15.86:0/640630837 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8d34056e60 con 0x7f8d44159bc0 2024-04-25T12:22:06.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.886+0000 7f8d4c621640 1 -- 172.21.15.86:0/640630837 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f8d440c7df0 con 0x7f8d44159bc0 2024-04-25T12:22:06.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.890+0000 7f8d3affd640 1 -- 172.21.15.86:0/640630837 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+196 (secure 0 0 0) 0x7f8d34056760 con 0x7f8d44159bc0 2024-04-25T12:22:06.895 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:22:06.895 INFO:teuthology.orchestra.run.smithi086.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2024-04-25T12:22:06.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.890+0000 7f8d4c621640 1 -- 172.21.15.86:0/640630837 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f8d28068380 msgr2=0x7f8d2806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:06.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.890+0000 7f8d4c621640 1 --2- 172.21.15.86:0/640630837 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f8d28068380 0x7f8d2806a840 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8d400af000 tx=0x7f8d400046d0 comp rx=0 tx=0).stop 2024-04-25T12:22:06.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.890+0000 7f8d4c621640 1 -- 172.21.15.86:0/640630837 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8d44159bc0 msgr2=0x7f8d44160990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:06.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.890+0000 7f8d4c621640 1 --2- 172.21.15.86:0/640630837 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8d44159bc0 0x7f8d44160990 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8d3400e850 tx=0x7f8d3400ed10 comp rx=0 tx=0).stop 2024-04-25T12:22:06.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.890+0000 7f8d4c621640 1 -- 172.21.15.86:0/640630837 shutdown_connections 2024-04-25T12:22:06.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.890+0000 7f8d4c621640 1 --2- 172.21.15.86:0/640630837 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d44161280 0x7f8d4413fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:06.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.890+0000 7f8d4c621640 1 --2- 172.21.15.86:0/640630837 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f8d28068380 0x7f8d2806a840 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:06.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.890+0000 7f8d4c621640 1 --2- 172.21.15.86:0/640630837 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8d44159bc0 0x7f8d44160990 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:06.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.890+0000 7f8d4c621640 1 --2- 172.21.15.86:0/640630837 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8d300039c0 0x7f8d44145360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:06.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.890+0000 7f8d4c621640 1 -- 172.21.15.86:0/640630837 >> 172.21.15.86:0/640630837 conn(0x7f8d4406b9d0 msgr2=0x7f8d4414e950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:06.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.890+0000 7f8d4c621640 1 -- 172.21.15.86:0/640630837 shutdown_connections 2024-04-25T12:22:06.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:06.890+0000 7f8d4c621640 1 -- 172.21.15.86:0/640630837 wait complete. 2024-04-25T12:22:09.916 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T12:22:10.049 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.042+0000 7f8736ddd640 1 Processor -- start 2024-04-25T12:22:10.049 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.042+0000 7f8736ddd640 1 -- start start 2024-04-25T12:22:10.050 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.042+0000 7f8736ddd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f873014ffa0 0x7f873006f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:10.050 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.042+0000 7f8736ddd640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8730074100 0x7f87300c7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:10.051 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.042+0000 7f8736ddd640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87300c5d70 con 0x7f873014fbc0 2024-04-25T12:22:10.051 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.042+0000 7f8736ddd640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f87300c6050 con 0x7f873014ffa0 2024-04-25T12:22:10.051 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.042+0000 7f8736ddd640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f87300c6330 con 0x7f8730074100 2024-04-25T12:22:10.051 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.042+0000 7f872ffff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f873014ffa0 0x7f873006f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:10.052 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.042+0000 7f8734b79640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f873014fbc0 0x7f87300c8220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:58472/0 (socket says 172.21.15.86:58472) 2024-04-25T12:22:10.052 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.042+0000 7f8734b79640 1 -- 172.21.15.86:0/3903992874 learned_addr learned my addr 172.21.15.86:0/3903992874 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-04-25T12:22:10.052 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.046+0000 7f873537a640 1 --2- 172.21.15.86:0/3903992874 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8730074100 0x7f87300c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:10.052 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.046+0000 7f872ffff640 1 -- 172.21.15.86:0/3903992874 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8730074100 msgr2=0x7f87300c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:10.052 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.046+0000 7f872ffff640 1 --2- 172.21.15.86:0/3903992874 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8730074100 0x7f87300c7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:10.052 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.046+0000 7f872ffff640 1 -- 172.21.15.86:0/3903992874 >> v1:172.21.15.86:6789/0 conn(0x7f873014fbc0 legacy=0x7f87300c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:10.052 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.046+0000 7f872f7fe640 1 -- 172.21.15.86:0/3903992874 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1152365253 0 0) 0x7f87300c5d70 con 0x7f873014fbc0 2024-04-25T12:22:10.052 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.046+0000 7f872ffff640 1 -- 172.21.15.86:0/3903992874 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87300c6610 con 0x7f873014ffa0 2024-04-25T12:22:10.053 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.046+0000 7f872ffff640 1 --2- 172.21.15.86:0/3903992874 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f873014ffa0 0x7f873006f700 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f87240097c0 tx=0x7f872401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa1ced4579c9e246 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:10.054 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.046+0000 7f872f7fe640 1 -- 172.21.15.86:0/3903992874 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87240aa620 con 0x7f873014ffa0 2024-04-25T12:22:10.054 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.046+0000 7f872f7fe640 1 -- 172.21.15.86:0/3903992874 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87240af070 con 0x7f873014ffa0 2024-04-25T12:22:10.054 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.046+0000 7f872f7fe640 1 -- 172.21.15.86:0/3903992874 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87240aa9e0 con 0x7f873014ffa0 2024-04-25T12:22:10.055 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.046+0000 7f8736ddd640 1 -- 172.21.15.86:0/3903992874 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f873014ffa0 msgr2=0x7f873006f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:10.055 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.046+0000 7f8736ddd640 1 --2- 172.21.15.86:0/3903992874 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f873014ffa0 0x7f873006f700 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f87240097c0 tx=0x7f872401c4a0 comp rx=0 tx=0).stop 2024-04-25T12:22:10.055 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.046+0000 7f8736ddd640 1 -- 172.21.15.86:0/3903992874 shutdown_connections 2024-04-25T12:22:10.055 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.046+0000 7f8736ddd640 1 --2- 172.21.15.86:0/3903992874 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8730074100 0x7f87300c7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:10.055 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.046+0000 7f8736ddd640 1 --2- 172.21.15.86:0/3903992874 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f873014ffa0 0x7f873006f700 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:10.055 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.046+0000 7f8736ddd640 1 -- 172.21.15.86:0/3903992874 >> 172.21.15.86:0/3903992874 conn(0x7f873006b9d0 msgr2=0x7f873006bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:10.055 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.046+0000 7f8736ddd640 1 -- 172.21.15.86:0/3903992874 shutdown_connections 2024-04-25T12:22:10.055 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.046+0000 7f8736ddd640 1 -- 172.21.15.86:0/3903992874 wait complete. 2024-04-25T12:22:10.056 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.050+0000 7f8736ddd640 1 Processor -- start 2024-04-25T12:22:10.056 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.050+0000 7f8736ddd640 1 -- start start 2024-04-25T12:22:10.058 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.050+0000 7f8736ddd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8730074100 0x7f87301eb720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:10.058 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.050+0000 7f8736ddd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f873014fbc0 0x7f8730142c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:10.058 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.050+0000 7f8736ddd640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f873014ffa0 0x7f87301431d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:10.058 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.050+0000 7f8736ddd640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f87300c8ab0 con 0x7f873014fbc0 2024-04-25T12:22:10.058 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.050+0000 7f8736ddd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f87300c8930 con 0x7f8730074100 2024-04-25T12:22:10.058 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.050+0000 7f8736ddd640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f8730166090 con 0x7f873014ffa0 2024-04-25T12:22:10.059 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.050+0000 7f872ffff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f873014fbc0 0x7f8730142c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:10.059 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.050+0000 7f873537a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f873014ffa0 0x7f87301431d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:10.059 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.050+0000 7f872ffff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f873014fbc0 0x7f8730142c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60248/0 (socket says 172.21.15.86:60248) 2024-04-25T12:22:10.059 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.050+0000 7f872ffff640 1 -- 172.21.15.86:0/679031337 learned_addr learned my addr 172.21.15.86:0/679031337 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:10.059 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.050+0000 7f8734b79640 1 --2- 172.21.15.86:0/679031337 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8730074100 0x7f87301eb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:10.059 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.050+0000 7f872ffff640 1 -- 172.21.15.86:0/679031337 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f873014ffa0 msgr2=0x7f87301431d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:10.059 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.050+0000 7f872ffff640 1 --2- 172.21.15.86:0/679031337 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f873014ffa0 0x7f87301431d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:10.059 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.050+0000 7f872ffff640 1 -- 172.21.15.86:0/679031337 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8730074100 msgr2=0x7f87301eb720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:10.059 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.050+0000 7f872ffff640 1 --2- 172.21.15.86:0/679031337 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8730074100 0x7f87301eb720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:10.059 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.050+0000 7f872ffff640 1 -- 172.21.15.86:0/679031337 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8730143710 con 0x7f873014fbc0 2024-04-25T12:22:10.059 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.050+0000 7f872ffff640 1 --2- 172.21.15.86:0/679031337 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f873014fbc0 0x7f8730142c90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f872401a0d0 tx=0x7f8724019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:10.059 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.050+0000 7f872d7fa640 1 -- 172.21.15.86:0/679031337 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87240aac20 con 0x7f873014fbc0 2024-04-25T12:22:10.059 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.050+0000 7f872d7fa640 1 -- 172.21.15.86:0/679031337 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87240aadc0 con 0x7f873014fbc0 2024-04-25T12:22:10.059 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.050+0000 7f8736ddd640 1 -- 172.21.15.86:0/679031337 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f873015d070 con 0x7f873014fbc0 2024-04-25T12:22:10.059 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.050+0000 7f872d7fa640 1 -- 172.21.15.86:0/679031337 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87240be690 con 0x7f873014fbc0 2024-04-25T12:22:10.060 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.050+0000 7f8736ddd640 1 -- 172.21.15.86:0/679031337 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8730150660 con 0x7f873014fbc0 2024-04-25T12:22:10.060 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.054+0000 7f8736ddd640 1 -- 172.21.15.86:0/679031337 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8730075df0 con 0x7f873014fbc0 2024-04-25T12:22:10.060 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.054+0000 7f872d7fa640 1 -- 172.21.15.86:0/679031337 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f87240be830 con 0x7f873014fbc0 2024-04-25T12:22:10.060 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.054+0000 7f872d7fa640 1 --2- 172.21.15.86:0/679031337 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f871c068380 0x7f871c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:10.060 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.054+0000 7f8734b79640 1 --2- 172.21.15.86:0/679031337 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f871c068380 0x7f871c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:10.060 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.054+0000 7f872d7fa640 1 -- 172.21.15.86:0/679031337 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f87241216b0 con 0x7f873014fbc0 2024-04-25T12:22:10.061 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.054+0000 7f8734b79640 1 --2- 172.21.15.86:0/679031337 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f871c068380 0x7f871c06a840 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8720007fd0 tx=0x7f8720007d60 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:10.066 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.058+0000 7f872d7fa640 1 -- 172.21.15.86:0/679031337 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f87240c3060 con 0x7f873014fbc0 2024-04-25T12:22:10.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.254+0000 7f8736ddd640 1 -- 172.21.15.86:0/679031337 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f873014e910 con 0x7f873014fbc0 2024-04-25T12:22:10.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.254+0000 7f872d7fa640 1 -- 172.21.15.86:0/679031337 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f8724016090 con 0x7f873014fbc0 2024-04-25T12:22:10.262 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:22:10.262 INFO:teuthology.orchestra.run.smithi086.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-25T12:22:10.265 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.258+0000 7f8736ddd640 1 -- 172.21.15.86:0/679031337 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f871c068380 msgr2=0x7f871c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:10.265 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.258+0000 7f8736ddd640 1 --2- 172.21.15.86:0/679031337 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f871c068380 0x7f871c06a840 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8720007fd0 tx=0x7f8720007d60 comp rx=0 tx=0).stop 2024-04-25T12:22:10.265 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.258+0000 7f8736ddd640 1 -- 172.21.15.86:0/679031337 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f873014fbc0 msgr2=0x7f8730142c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:10.265 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.258+0000 7f8736ddd640 1 --2- 172.21.15.86:0/679031337 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f873014fbc0 0x7f8730142c90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f872401a0d0 tx=0x7f8724019240 comp rx=0 tx=0).stop 2024-04-25T12:22:10.265 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.258+0000 7f8736ddd640 1 -- 172.21.15.86:0/679031337 shutdown_connections 2024-04-25T12:22:10.265 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.258+0000 7f8736ddd640 1 --2- 172.21.15.86:0/679031337 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f873014ffa0 0x7f87301431d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:10.265 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.258+0000 7f8736ddd640 1 --2- 172.21.15.86:0/679031337 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f871c068380 0x7f871c06a840 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:10.265 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.258+0000 7f8736ddd640 1 --2- 172.21.15.86:0/679031337 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f873014fbc0 0x7f8730142c90 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:10.265 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.258+0000 7f8736ddd640 1 --2- 172.21.15.86:0/679031337 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8730074100 0x7f87301eb720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:10.265 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.258+0000 7f8736ddd640 1 -- 172.21.15.86:0/679031337 >> 172.21.15.86:0/679031337 conn(0x7f873006b9d0 msgr2=0x7f873014b470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:10.265 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.258+0000 7f8736ddd640 1 -- 172.21.15.86:0/679031337 shutdown_connections 2024-04-25T12:22:10.265 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.258+0000 7f8736ddd640 1 -- 172.21.15.86:0/679031337 wait complete. 2024-04-25T12:22:10.280 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-25T12:22:10.280 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T12:22:10.403 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.394+0000 7f1b8bbb7640 1 Processor -- start 2024-04-25T12:22:10.403 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.394+0000 7f1b8bbb7640 1 -- start start 2024-04-25T12:22:10.404 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.398+0000 7f1b8bbb7640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f1b84152fe0 0x7f1b8415c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:10.404 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.398+0000 7f1b8bbb7640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1b840c6af0 0x7f1b840c3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:10.404 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.398+0000 7f1b8bbb7640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1b840c3710 0x7f1b840c42e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:10.404 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.398+0000 7f1b8bbb7640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f1b8415c890 con 0x7f1b840c6af0 2024-04-25T12:22:10.404 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.398+0000 7f1b8bbb7640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f1b840c7440 con 0x7f1b84152fe0 2024-04-25T12:22:10.405 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.398+0000 7f1b8bbb7640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f1b840c7720 con 0x7f1b840c3710 2024-04-25T12:22:10.405 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.398+0000 7f1b89152640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1b840c6af0 0x7f1b840c3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:10.405 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.398+0000 7f1b89152640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1b840c6af0 0x7f1b840c3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60250/0 (socket says 172.21.15.86:60250) 2024-04-25T12:22:10.405 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.398+0000 7f1b89152640 1 -- 172.21.15.86:0/2269822356 learned_addr learned my addr 172.21.15.86:0/2269822356 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:10.405 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.398+0000 7f1b89953640 1 --2- 172.21.15.86:0/2269822356 >> v2:172.21.15.134:3300/0 conn(0x7f1b84152fe0 0x7f1b8415c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:10.405 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.398+0000 7f1b8a154640 1 --2- 172.21.15.86:0/2269822356 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1b840c3710 0x7f1b840c42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:10.405 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.398+0000 7f1b89152640 1 -- 172.21.15.86:0/2269822356 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1b840c3710 msgr2=0x7f1b840c42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:10.405 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.398+0000 7f1b89152640 1 --2- 172.21.15.86:0/2269822356 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1b840c3710 0x7f1b840c42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:10.405 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.398+0000 7f1b89152640 1 -- 172.21.15.86:0/2269822356 >> v2:172.21.15.134:3300/0 conn(0x7f1b84152fe0 msgr2=0x7f1b8415c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:10.405 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.398+0000 7f1b89152640 1 --2- 172.21.15.86:0/2269822356 >> v2:172.21.15.134:3300/0 conn(0x7f1b84152fe0 0x7f1b8415c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:10.405 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.398+0000 7f1b89152640 1 -- 172.21.15.86:0/2269822356 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b840c6010 con 0x7f1b840c6af0 2024-04-25T12:22:10.407 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.398+0000 7f1b89152640 1 --2- 172.21.15.86:0/2269822356 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b840c6af0 0x7f1b840c3da0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1b840710d0 tx=0x7f1b7401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa6df21ea6b3789 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:10.407 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.402+0000 7f1b88951640 1 -- 172.21.15.86:0/2269822356 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b740b5070 con 0x7f1b840c6af0 2024-04-25T12:22:10.407 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.402+0000 7f1b88951640 1 -- 172.21.15.86:0/2269822356 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b740a89d0 con 0x7f1b840c6af0 2024-04-25T12:22:10.407 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.402+0000 7f1b88951640 1 -- 172.21.15.86:0/2269822356 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b740a8da0 con 0x7f1b840c6af0 2024-04-25T12:22:10.408 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.402+0000 7f1b8bbb7640 1 -- 172.21.15.86:0/2269822356 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b840c6af0 msgr2=0x7f1b840c3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:10.408 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.402+0000 7f1b8bbb7640 1 --2- 172.21.15.86:0/2269822356 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b840c6af0 0x7f1b840c3da0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1b840710d0 tx=0x7f1b7401ed10 comp rx=0 tx=0).stop 2024-04-25T12:22:10.408 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.402+0000 7f1b8bbb7640 1 -- 172.21.15.86:0/2269822356 shutdown_connections 2024-04-25T12:22:10.408 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.402+0000 7f1b8bbb7640 1 --2- 172.21.15.86:0/2269822356 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1b840c3710 0x7f1b840c42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:10.408 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.402+0000 7f1b8bbb7640 1 --2- 172.21.15.86:0/2269822356 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b840c6af0 0x7f1b840c3da0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:10.408 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.402+0000 7f1b8bbb7640 1 --2- 172.21.15.86:0/2269822356 >> v2:172.21.15.134:3300/0 conn(0x7f1b84152fe0 0x7f1b8415c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:10.408 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.402+0000 7f1b8bbb7640 1 -- 172.21.15.86:0/2269822356 >> 172.21.15.86:0/2269822356 conn(0x7f1b8406b9d0 msgr2=0x7f1b8406bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:10.408 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.402+0000 7f1b8bbb7640 1 -- 172.21.15.86:0/2269822356 shutdown_connections 2024-04-25T12:22:10.409 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.402+0000 7f1b8bbb7640 1 -- 172.21.15.86:0/2269822356 wait complete. 2024-04-25T12:22:10.409 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.402+0000 7f1b8bbb7640 1 Processor -- start 2024-04-25T12:22:10.409 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.402+0000 7f1b8bbb7640 1 -- start start 2024-04-25T12:22:10.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.402+0000 7f1b8bbb7640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1b840c3710 0x7f1b841f1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:10.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.402+0000 7f1b8bbb7640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b840c6af0 0x7f1b841ef2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:10.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.402+0000 7f1b8bbb7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b84152fe0 0x7f1b84151ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:10.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.402+0000 7f1b8bbb7640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1b84074080 con 0x7f1b840c6af0 2024-04-25T12:22:10.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.402+0000 7f1b8bbb7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1b840c65d0 con 0x7f1b84152fe0 2024-04-25T12:22:10.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.402+0000 7f1b8bbb7640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f1b8406c4f0 con 0x7f1b840c3710 2024-04-25T12:22:10.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.402+0000 7f1b89152640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b840c6af0 0x7f1b841ef2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:10.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.402+0000 7f1b89152640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b840c6af0 0x7f1b841ef2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60264/0 (socket says 172.21.15.86:60264) 2024-04-25T12:22:10.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.402+0000 7f1b89152640 1 -- 172.21.15.86:0/2929282477 learned_addr learned my addr 172.21.15.86:0/2929282477 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:10.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.402+0000 7f1b8a154640 1 --2- 172.21.15.86:0/2929282477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b84152fe0 0x7f1b84151ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:10.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.402+0000 7f1b89953640 1 --2- 172.21.15.86:0/2929282477 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1b840c3710 0x7f1b841f1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:10.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.402+0000 7f1b89152640 1 -- 172.21.15.86:0/2929282477 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1b840c3710 msgr2=0x7f1b841f1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:10.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.402+0000 7f1b89152640 1 --2- 172.21.15.86:0/2929282477 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1b840c3710 0x7f1b841f1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:10.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.402+0000 7f1b89152640 1 -- 172.21.15.86:0/2929282477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b84152fe0 msgr2=0x7f1b84151ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:10.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.402+0000 7f1b89152640 1 --2- 172.21.15.86:0/2929282477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b84152fe0 0x7f1b84151ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:10.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.402+0000 7f1b89152640 1 -- 172.21.15.86:0/2929282477 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b841f2db0 con 0x7f1b840c6af0 2024-04-25T12:22:10.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.402+0000 7f1b89152640 1 --2- 172.21.15.86:0/2929282477 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b840c6af0 0x7f1b841ef2b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1b7401d3c0 tx=0x7f1b7401bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:10.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.402+0000 7f1b7a7fc640 1 -- 172.21.15.86:0/2929282477 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b740b5070 con 0x7f1b840c6af0 2024-04-25T12:22:10.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.402+0000 7f1b7a7fc640 1 -- 172.21.15.86:0/2929282477 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b740b09d0 con 0x7f1b840c6af0 2024-04-25T12:22:10.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.402+0000 7f1b7a7fc640 1 -- 172.21.15.86:0/2929282477 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b740b0dc0 con 0x7f1b840c6af0 2024-04-25T12:22:10.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.402+0000 7f1b8bbb7640 1 -- 172.21.15.86:0/2929282477 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b841f2510 con 0x7f1b840c6af0 2024-04-25T12:22:10.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.402+0000 7f1b8bbb7640 1 -- 172.21.15.86:0/2929282477 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b841f2ad0 con 0x7f1b840c6af0 2024-04-25T12:22:10.414 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.406+0000 7f1b8bbb7640 1 -- 172.21.15.86:0/2929282477 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b84075df0 con 0x7f1b840c6af0 2024-04-25T12:22:10.414 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.406+0000 7f1b7a7fc640 1 -- 172.21.15.86:0/2929282477 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1b740c2060 con 0x7f1b840c6af0 2024-04-25T12:22:10.414 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.406+0000 7f1b7a7fc640 1 --2- 172.21.15.86:0/2929282477 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f1b68068380 0x7f1b6806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:10.414 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.406+0000 7f1b7a7fc640 1 -- 172.21.15.86:0/2929282477 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f1b74123e40 con 0x7f1b840c6af0 2024-04-25T12:22:10.414 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.406+0000 7f1b89953640 1 --2- 172.21.15.86:0/2929282477 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f1b68068380 0x7f1b6806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:10.414 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.406+0000 7f1b89953640 1 --2- 172.21.15.86:0/2929282477 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f1b68068380 0x7f1b6806a840 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1b800073f0 tx=0x7f1b8000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:10.417 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.410+0000 7f1b7a7fc640 1 -- 172.21.15.86:0/2929282477 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1b74018870 con 0x7f1b840c6af0 2024-04-25T12:22:10.566 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.558+0000 7f1b8bbb7640 1 -- 172.21.15.86:0/2929282477 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1b840c4830 con 0x7f1b840c6af0 2024-04-25T12:22:10.569 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.562+0000 7f1b7a7fc640 1 -- 172.21.15.86:0/2929282477 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18905 (secure 0 0 0) 0x7f1b740f4000 con 0x7f1b840c6af0 2024-04-25T12:22:10.569 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:22:10.569 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":26,"fsid":"f2ef5c0c-9576-4650-b4f7-6cb14247f62a","created":"2024-04-25T12:20:59.241733+0000","modified":"2024-04-25T12:22:04.877793+0000","last_up_change":"2024-04-25T12:21:10.939617+0000","last_in_change":"2024-04-25T12:21:01.534145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T12:21:11.839922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T12:21:21.854040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T12:21:22.406060+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T12:21:26.152386+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1f713f00-ef9f-4a6f-a620-38a8a1f8a822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6801","nonce":2812764579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6803","nonce":2812764579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6807","nonce":2812764579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6805","nonce":2812764579}]},"public_addr":"172.21.15.86:6801/2812764579","cluster_addr":"172.21.15.86:6803/2812764579","heartbeat_back_addr":"172.21.15.86:6807/2812764579","heartbeat_front_addr":"172.21.15.86:6805/2812764579","state":["exists","up"]},{"osd":1,"uuid":"baf6606d-a556-4fbe-a930-855e04ff1534","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6809","nonce":467966038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6811","nonce":467966038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6815","nonce":467966038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6813","nonce":467966038}]},"public_addr":"172.21.15.86:6809/467966038","cluster_addr":"172.21.15.86:6811/467966038","heartbeat_back_addr":"172.21.15.86:6815/467966038","heartbeat_front_addr":"172.21.15.86:6813/467966038","state":["exists","up"]},{"osd":2,"uuid":"c983d68e-6d60-434f-aed6-108420c5dd09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6817","nonce":3279762843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6820","nonce":3279762843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6825","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6827","nonce":3279762843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6824","nonce":3279762843}]},"public_addr":"172.21.15.86:6817/3279762843","cluster_addr":"172.21.15.86:6820/3279762843","heartbeat_back_addr":"172.21.15.86:6827/3279762843","heartbeat_front_addr":"172.21.15.86:6824/3279762843","state":["exists","up"]},{"osd":3,"uuid":"e77657bb-45aa-43bf-ab41-c7377eb495ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6821","nonce":2861354413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6826","nonce":2861354413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6831","nonce":2861354413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6829","nonce":2861354413}]},"public_addr":"172.21.15.86:6821/2861354413","cluster_addr":"172.21.15.86:6826/2861354413","heartbeat_back_addr":"172.21.15.86:6831/2861354413","heartbeat_front_addr":"172.21.15.86:6829/2861354413","state":["exists","up"]},{"osd":4,"uuid":"252bd300-d75a-4b00-be4b-27e6b51de4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6802","nonce":1872913602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6805","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6808","nonce":1872913602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6815","nonce":1872913602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6813","nonce":1872913602}]},"public_addr":"172.21.15.134:6802/1872913602","cluster_addr":"172.21.15.134:6808/1872913602","heartbeat_back_addr":"172.21.15.134:6815/1872913602","heartbeat_front_addr":"172.21.15.134:6813/1872913602","state":["exists","up"]},{"osd":5,"uuid":"4135da3f-7427-4409-a48e-78bd8a7b46ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6801","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6803","nonce":2261413981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6806","nonce":2261413981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6812","nonce":2261413981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6809","nonce":2261413981}]},"public_addr":"172.21.15.134:6803/2261413981","cluster_addr":"172.21.15.134:6806/2261413981","heartbeat_back_addr":"172.21.15.134:6812/2261413981","heartbeat_front_addr":"172.21.15.134:6809/2261413981","state":["exists","up"]},{"osd":6,"uuid":"b6e7a5f1-fa7e-497d-abac-a19994d26820","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6825","nonce":2841082767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6827","nonce":2841082767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6831","nonce":2841082767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6829","nonce":2841082767}]},"public_addr":"172.21.15.134:6825/2841082767","cluster_addr":"172.21.15.134:6827/2841082767","heartbeat_back_addr":"172.21.15.134:6831/2841082767","heartbeat_front_addr":"172.21.15.134:6829/2841082767","state":["exists","up"]},{"osd":7,"uuid":"c5597e50-1962-4103-9124-dd7bceb8ac97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6817","nonce":1277404274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6819","nonce":1277404274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6823","nonce":1277404274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6821","nonce":1277404274}]},"public_addr":"172.21.15.134:6817/1277404274","cluster_addr":"172.21.15.134:6819/1277404274","heartbeat_back_addr":"172.21.15.134:6823/1277404274","heartbeat_front_addr":"172.21.15.134:6821/1277404274","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.018125+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.157958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.113619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.136904+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.844514+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.872629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.775339+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.822867+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":7,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.33","mappings":[{"from":3,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T12:22:10.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.566+0000 7f1b8bbb7640 1 -- 172.21.15.86:0/2929282477 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f1b68068380 msgr2=0x7f1b6806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:10.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.566+0000 7f1b8bbb7640 1 --2- 172.21.15.86:0/2929282477 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f1b68068380 0x7f1b6806a840 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1b800073f0 tx=0x7f1b8000b040 comp rx=0 tx=0).stop 2024-04-25T12:22:10.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.566+0000 7f1b8bbb7640 1 -- 172.21.15.86:0/2929282477 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b840c6af0 msgr2=0x7f1b841ef2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:10.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.566+0000 7f1b8bbb7640 1 --2- 172.21.15.86:0/2929282477 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b840c6af0 0x7f1b841ef2b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1b7401d3c0 tx=0x7f1b7401bab0 comp rx=0 tx=0).stop 2024-04-25T12:22:10.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.566+0000 7f1b8bbb7640 1 -- 172.21.15.86:0/2929282477 shutdown_connections 2024-04-25T12:22:10.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.566+0000 7f1b8bbb7640 1 --2- 172.21.15.86:0/2929282477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b84152fe0 0x7f1b84151ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:10.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.566+0000 7f1b8bbb7640 1 --2- 172.21.15.86:0/2929282477 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f1b68068380 0x7f1b6806a840 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:10.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.566+0000 7f1b8bbb7640 1 --2- 172.21.15.86:0/2929282477 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b840c6af0 0x7f1b841ef2b0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:10.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.566+0000 7f1b8bbb7640 1 --2- 172.21.15.86:0/2929282477 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1b840c3710 0x7f1b841f1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:10.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.566+0000 7f1b8bbb7640 1 -- 172.21.15.86:0/2929282477 >> 172.21.15.86:0/2929282477 conn(0x7f1b8406b9d0 msgr2=0x7f1b8415bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:10.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.566+0000 7f1b8bbb7640 1 -- 172.21.15.86:0/2929282477 shutdown_connections 2024-04-25T12:22:10.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.566+0000 7f1b8bbb7640 1 -- 172.21.15.86:0/2929282477 wait complete. 2024-04-25T12:22:10.588 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T12:21:11.839922+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T12:21:21.854040+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T12:21:22.406060+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T12:21:26.152386+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T12:22:10.588 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T12:22:10.708 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.702+0000 7f5cdcb6e640 1 Processor -- start 2024-04-25T12:22:10.708 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.702+0000 7f5cdcb6e640 1 -- start start 2024-04-25T12:22:10.711 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.702+0000 7f5cdcb6e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5cd81598a0 0x7f5cd806da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:10.711 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.702+0000 7f5cdcb6e640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cd8067ae0 con 0x7f5cd806e870 2024-04-25T12:22:10.711 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.702+0000 7f5cdcb6e640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cd80c2b40 con 0x7f5cd815fdb0 2024-04-25T12:22:10.711 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.702+0000 7f5cdcb6e640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f5cd8159c80 con 0x7f5cd81598a0 2024-04-25T12:22:10.711 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.702+0000 7f5cd5d9b640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f5cd806e870 0x7f5cd815f6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:58476/0 (socket says 172.21.15.86:58476) 2024-04-25T12:22:10.711 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.702+0000 7f5cd5d9b640 1 -- 172.21.15.86:0/3407253284 learned_addr learned my addr 172.21.15.86:0/3407253284 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-04-25T12:22:10.711 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.702+0000 7f5cd659c640 1 --2- 172.21.15.86:0/3407253284 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5cd81598a0 0x7f5cd806da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:10.711 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.702+0000 7f5cd559a640 1 -- 172.21.15.86:0/3407253284 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2986498140 0 0) 0x7f5cd8067ae0 con 0x7f5cd806e870 2024-04-25T12:22:10.712 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.702+0000 7f5cd559a640 1 -- 172.21.15.86:0/3407253284 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5cc0003530 con 0x7f5cd806e870 2024-04-25T12:22:10.712 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.702+0000 7f5cd559a640 1 -- 172.21.15.86:0/3407253284 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1348375462 0 0) 0x7f5cd80c2b40 con 0x7f5cd815fdb0 2024-04-25T12:22:10.712 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.702+0000 7f5cd559a640 1 -- 172.21.15.86:0/3407253284 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5cd8067ae0 con 0x7f5cd815fdb0 2024-04-25T12:22:10.712 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.702+0000 7f5cd559a640 1 -- 172.21.15.86:0/3407253284 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2321903049 0 0) 0x7f5cc0003530 con 0x7f5cd806e870 2024-04-25T12:22:10.712 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.702+0000 7f5cd559a640 1 -- 172.21.15.86:0/3407253284 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5cd81598a0 msgr2=0x7f5cd806da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:10.712 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.702+0000 7f5cd559a640 1 --2- 172.21.15.86:0/3407253284 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5cd81598a0 0x7f5cd806da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:10.712 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.702+0000 7f5cd559a640 1 -- 172.21.15.86:0/3407253284 >> v1:172.21.15.134:6789/0 conn(0x7f5cd815fdb0 legacy=0x7f5cd8169d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:10.712 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.702+0000 7f5cd559a640 1 -- 172.21.15.86:0/3407253284 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cd80c2e20 con 0x7f5cd806e870 2024-04-25T12:22:10.712 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.702+0000 7f5cd559a640 1 -- 172.21.15.86:0/3407253284 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1387950573 0 0) 0x7f5ccc001680 con 0x7f5cd806e870 2024-04-25T12:22:10.712 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.702+0000 7f5cd559a640 1 -- 172.21.15.86:0/3407253284 >> v1:172.21.15.86:6789/0 conn(0x7f5cd806e870 legacy=0x7f5cd815f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:10.712 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.702+0000 7f5cd559a640 1 --2- 172.21.15.86:0/3407253284 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5cc0003b80 0x7f5cc0003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:10.712 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.702+0000 7f5cd559a640 1 --2- 172.21.15.86:0/3407253284 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5cc0004810 0x7f5cc0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:10.712 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.702+0000 7f5cd559a640 1 --2- 172.21.15.86:0/3407253284 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5cd81598a0 0x7f5cc00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:10.712 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.702+0000 7f5cd559a640 1 -- 172.21.15.86:0/3407253284 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f5cd8159c80 con 0x7f5cc0004810 2024-04-25T12:22:10.712 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.702+0000 7f5cd559a640 1 -- 172.21.15.86:0/3407253284 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5cc000ba80 con 0x7f5cc0003b80 2024-04-25T12:22:10.713 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.702+0000 7f5cd559a640 1 -- 172.21.15.86:0/3407253284 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f5cc000bc50 con 0x7f5cd81598a0 2024-04-25T12:22:10.713 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.702+0000 7f5cd5d9b640 1 --2- 172.21.15.86:0/3407253284 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5cc0004810 0x7f5cc0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:10.713 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.702+0000 7f5cd659c640 1 --2- 172.21.15.86:0/3407253284 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5cc0003b80 0x7f5cc0003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:10.713 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.702+0000 7f5cd6d9d640 1 --2- 172.21.15.86:0/3407253284 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5cd81598a0 0x7f5cc00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:10.713 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.702+0000 7f5cd5d9b640 1 -- 172.21.15.86:0/3407253284 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5cd81598a0 msgr2=0x7f5cc00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:10.713 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.702+0000 7f5cd5d9b640 1 --2- 172.21.15.86:0/3407253284 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5cd81598a0 0x7f5cc00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:10.713 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.702+0000 7f5cd5d9b640 1 -- 172.21.15.86:0/3407253284 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5cc0003b80 msgr2=0x7f5cc0003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:10.713 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.702+0000 7f5cd5d9b640 1 --2- 172.21.15.86:0/3407253284 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5cc0003b80 0x7f5cc0003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:10.713 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.702+0000 7f5cd5d9b640 1 -- 172.21.15.86:0/3407253284 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cc0003530 con 0x7f5cc0004810 2024-04-25T12:22:10.715 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.706+0000 7f5cd5d9b640 1 --2- 172.21.15.86:0/3407253284 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5cc0004810 0x7f5cc0004c90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc00c190 tx=0x7f5ccc01f2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42f3439ad5eae56e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:10.715 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.706+0000 7f5cd559a640 1 -- 172.21.15.86:0/3407253284 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc007cf0 con 0x7f5cc0004810 2024-04-25T12:22:10.715 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.706+0000 7f5cd559a640 1 -- 172.21.15.86:0/3407253284 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ccc0ac020 con 0x7f5cc0004810 2024-04-25T12:22:10.715 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.706+0000 7f5cd559a640 1 -- 172.21.15.86:0/3407253284 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc0058e0 con 0x7f5cc0004810 2024-04-25T12:22:10.715 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.706+0000 7f5cdcb6e640 1 -- 172.21.15.86:0/3407253284 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5cc0004810 msgr2=0x7f5cc0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:10.715 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.706+0000 7f5cdcb6e640 1 --2- 172.21.15.86:0/3407253284 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5cc0004810 0x7f5cc0004c90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc00c190 tx=0x7f5ccc01f2d0 comp rx=0 tx=0).stop 2024-04-25T12:22:10.715 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.706+0000 7f5cd6d9d640 1 -- 172.21.15.86:0/3407253284 reap_dead start 2024-04-25T12:22:10.715 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.706+0000 7f5cdcb6e640 1 -- 172.21.15.86:0/3407253284 shutdown_connections 2024-04-25T12:22:10.715 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.706+0000 7f5cdcb6e640 1 -- 172.21.15.86:0/3407253284 >> 172.21.15.86:0/3407253284 conn(0x7f5cd80c9a70 msgr2=0x7f5cd80c9e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:10.715 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.706+0000 7f5cdcb6e640 1 -- 172.21.15.86:0/3407253284 shutdown_connections 2024-04-25T12:22:10.715 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.706+0000 7f5cdcb6e640 1 -- 172.21.15.86:0/3407253284 wait complete. 2024-04-25T12:22:10.715 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.706+0000 7f5cdcb6e640 1 Processor -- start 2024-04-25T12:22:10.715 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.706+0000 7f5cdcb6e640 1 -- start start 2024-04-25T12:22:10.717 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.710+0000 7f5cdcb6e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5cc0004810 0x7f5cd80c6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:10.717 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.710+0000 7f5cdcb6e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5cd81f5800 0x7f5cd80c4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:10.718 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.710+0000 7f5cdcb6e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5cd81f8b60 0x7f5cd8072400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:10.718 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.710+0000 7f5cdcb6e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f5cd80ca6e0 con 0x7f5cd81f8b60 2024-04-25T12:22:10.718 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.710+0000 7f5cdcb6e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5cd80c3470 con 0x7f5cc0004810 2024-04-25T12:22:10.718 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.710+0000 7f5cdcb6e640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f5cd80676a0 con 0x7f5cd81f5800 2024-04-25T12:22:10.718 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.710+0000 7f5cd6d9d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5cd81f8b60 0x7f5cd8072400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:10.718 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.710+0000 7f5cd6d9d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5cd81f8b60 0x7f5cd8072400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60282/0 (socket says 172.21.15.86:60282) 2024-04-25T12:22:10.718 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.710+0000 7f5cd6d9d640 1 -- 172.21.15.86:0/2507547509 learned_addr learned my addr 172.21.15.86:0/2507547509 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:10.718 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.710+0000 7f5cd659c640 1 --2- 172.21.15.86:0/2507547509 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5cc0004810 0x7f5cd80c6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:10.718 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.710+0000 7f5cd5d9b640 1 --2- 172.21.15.86:0/2507547509 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5cd81f5800 0x7f5cd80c4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:10.718 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.710+0000 7f5cd6d9d640 1 -- 172.21.15.86:0/2507547509 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5cd81f5800 msgr2=0x7f5cd80c4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:10.718 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.710+0000 7f5cd6d9d640 1 --2- 172.21.15.86:0/2507547509 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5cd81f5800 0x7f5cd80c4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:10.718 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.710+0000 7f5cd6d9d640 1 -- 172.21.15.86:0/2507547509 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5cc0004810 msgr2=0x7f5cd80c6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:10.719 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.710+0000 7f5cd6d9d640 1 --2- 172.21.15.86:0/2507547509 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5cc0004810 0x7f5cd80c6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:10.719 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.710+0000 7f5cd6d9d640 1 -- 172.21.15.86:0/2507547509 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cd80c6c70 con 0x7f5cd81f8b60 2024-04-25T12:22:10.719 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.710+0000 7f5cd6d9d640 1 --2- 172.21.15.86:0/2507547509 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5cd81f8b60 0x7f5cd8072400 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5cd8160210 tx=0x7f5cc800fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:10.719 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.710+0000 7f5cc6ffd640 1 -- 172.21.15.86:0/2507547509 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cc8019070 con 0x7f5cd81f8b60 2024-04-25T12:22:10.719 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.710+0000 7f5cc6ffd640 1 -- 172.21.15.86:0/2507547509 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cc80050d0 con 0x7f5cd81f8b60 2024-04-25T12:22:10.719 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.710+0000 7f5cdcb6e640 1 -- 172.21.15.86:0/2507547509 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cd80c6f10 con 0x7f5cd81f8b60 2024-04-25T12:22:10.719 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.710+0000 7f5cc6ffd640 1 -- 172.21.15.86:0/2507547509 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cc80067e0 con 0x7f5cd81f8b60 2024-04-25T12:22:10.719 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.710+0000 7f5cdcb6e640 1 -- 172.21.15.86:0/2507547509 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cd81f5000 con 0x7f5cd81f8b60 2024-04-25T12:22:10.719 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.710+0000 7f5cdcb6e640 1 -- 172.21.15.86:0/2507547509 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cd8075df0 con 0x7f5cd81f8b60 2024-04-25T12:22:10.719 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.710+0000 7f5cc6ffd640 1 -- 172.21.15.86:0/2507547509 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5cc801c070 con 0x7f5cd81f8b60 2024-04-25T12:22:10.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.710+0000 7f5cc6ffd640 1 --2- 172.21.15.86:0/2507547509 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f5cb8068380 0x7f5cb806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:10.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.710+0000 7f5cd659c640 1 --2- 172.21.15.86:0/2507547509 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f5cb8068380 0x7f5cb806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:10.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.710+0000 7f5cc6ffd640 1 -- 172.21.15.86:0/2507547509 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f5cc8085cc0 con 0x7f5cd81f8b60 2024-04-25T12:22:10.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.710+0000 7f5cd659c640 1 --2- 172.21.15.86:0/2507547509 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f5cb8068380 0x7f5cb806a840 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5cd0014370 tx=0x7f5cd000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:10.722 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.714+0000 7f5cc6ffd640 1 -- 172.21.15.86:0/2507547509 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5cc80558c0 con 0x7f5cd81f8b60 2024-04-25T12:22:10.884 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.878+0000 7f5cdcb6e640 1 -- 172.21.15.86:0/2507547509 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5cd80c3810 con 0x7f5cd81f8b60 2024-04-25T12:22:10.885 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.878+0000 7f5cc6ffd640 1 -- 172.21.15.86:0/2507547509 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7f5cc8059bc0 con 0x7f5cd81f8b60 2024-04-25T12:22:10.885 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 1 2024-04-25T12:22:10.887 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.882+0000 7f5cdcb6e640 1 -- 172.21.15.86:0/2507547509 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f5cb8068380 msgr2=0x7f5cb806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:10.887 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.882+0000 7f5cdcb6e640 1 --2- 172.21.15.86:0/2507547509 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f5cb8068380 0x7f5cb806a840 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5cd0014370 tx=0x7f5cd000b040 comp rx=0 tx=0).stop 2024-04-25T12:22:10.888 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.882+0000 7f5cdcb6e640 1 -- 172.21.15.86:0/2507547509 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5cd81f8b60 msgr2=0x7f5cd8072400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:10.888 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.882+0000 7f5cdcb6e640 1 --2- 172.21.15.86:0/2507547509 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5cd81f8b60 0x7f5cd8072400 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5cd8160210 tx=0x7f5cc800fc00 comp rx=0 tx=0).stop 2024-04-25T12:22:10.888 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.882+0000 7f5cdcb6e640 1 -- 172.21.15.86:0/2507547509 shutdown_connections 2024-04-25T12:22:10.888 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.882+0000 7f5cdcb6e640 1 --2- 172.21.15.86:0/2507547509 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f5cb8068380 0x7f5cb806a840 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:10.888 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.882+0000 7f5cdcb6e640 1 --2- 172.21.15.86:0/2507547509 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5cd81f8b60 0x7f5cd8072400 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:10.888 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.882+0000 7f5cdcb6e640 1 --2- 172.21.15.86:0/2507547509 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5cd81f5800 0x7f5cd80c4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:10.888 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.882+0000 7f5cdcb6e640 1 --2- 172.21.15.86:0/2507547509 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5cc0004810 0x7f5cd80c6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:10.888 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.882+0000 7f5cdcb6e640 1 -- 172.21.15.86:0/2507547509 >> 172.21.15.86:0/2507547509 conn(0x7f5cd80c9a70 msgr2=0x7f5cd8157bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:10.888 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.882+0000 7f5cdcb6e640 1 -- 172.21.15.86:0/2507547509 shutdown_connections 2024-04-25T12:22:10.888 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:10.882+0000 7f5cdcb6e640 1 -- 172.21.15.86:0/2507547509 wait complete. 2024-04-25T12:22:10.904 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T12:22:11.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.018+0000 7f84fc842640 1 Processor -- start 2024-04-25T12:22:11.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.018+0000 7f84fc842640 1 -- start start 2024-04-25T12:22:11.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.018+0000 7f84fc842640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f84f8151f40 0x7f84f80c9630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:11.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.018+0000 7f84fc842640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f84f806cfd0 0x7f84f806d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:11.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.018+0000 7f84fc842640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84f8157da0 con 0x7f84f8072ae0 2024-04-25T12:22:11.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.018+0000 7f84fc842640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f84f80c89e0 con 0x7f84f806cfd0 2024-04-25T12:22:11.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.018+0000 7f84fc842640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f84f80c8c80 con 0x7f84f8151f40 2024-04-25T12:22:11.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.018+0000 7f84effff640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f84f8072ae0 0x7f84f815b390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:58490/0 (socket says 172.21.15.86:58490) 2024-04-25T12:22:11.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.018+0000 7f84effff640 1 -- 172.21.15.86:0/1830669833 learned_addr learned my addr 172.21.15.86:0/1830669833 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-04-25T12:22:11.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.018+0000 7f84f659c640 1 --2- 172.21.15.86:0/1830669833 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f84f8151f40 0x7f84f80c9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:11.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.018+0000 7f84f6d9d640 1 --2- 172.21.15.86:0/1830669833 >> v2:172.21.15.134:3300/0 conn(0x7f84f806cfd0 0x7f84f806d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:11.027 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.018+0000 7f84f5d9b640 1 -- 172.21.15.86:0/1830669833 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1040385765 0 0) 0x7f84e0001120 con 0x7f84f8072ae0 2024-04-25T12:22:11.027 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.018+0000 7f84f5d9b640 1 -- 172.21.15.86:0/1830669833 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f84e4003530 con 0x7f84f8072ae0 2024-04-25T12:22:11.027 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.018+0000 7f84f5d9b640 1 -- 172.21.15.86:0/1830669833 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3149977140 0 0) 0x7f84e4003530 con 0x7f84f8072ae0 2024-04-25T12:22:11.027 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.018+0000 7f84f5d9b640 1 -- 172.21.15.86:0/1830669833 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f84f8151f40 msgr2=0x7f84f80c9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:11.027 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.018+0000 7f84f5d9b640 1 --2- 172.21.15.86:0/1830669833 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f84f8151f40 0x7f84f80c9630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:11.027 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.018+0000 7f84f5d9b640 1 -- 172.21.15.86:0/1830669833 >> v2:172.21.15.134:3300/0 conn(0x7f84f806cfd0 msgr2=0x7f84f806d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:11.027 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.018+0000 7f84f5d9b640 1 --2- 172.21.15.86:0/1830669833 >> v2:172.21.15.134:3300/0 conn(0x7f84f806cfd0 0x7f84f806d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:11.027 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.018+0000 7f84f5d9b640 1 -- 172.21.15.86:0/1830669833 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84f8158020 con 0x7f84f8072ae0 2024-04-25T12:22:11.027 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.018+0000 7f84f5d9b640 1 -- 172.21.15.86:0/1830669833 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1387950573 0 0) 0x7f84e0001850 con 0x7f84f8072ae0 2024-04-25T12:22:11.027 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.018+0000 7f84f5d9b640 1 -- 172.21.15.86:0/1830669833 >> v1:172.21.15.86:6789/0 conn(0x7f84f8072ae0 legacy=0x7f84f815b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:11.027 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.018+0000 7f84f5d9b640 1 --2- 172.21.15.86:0/1830669833 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84e40039c0 0x7f84e4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:11.027 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.018+0000 7f84f5d9b640 1 --2- 172.21.15.86:0/1830669833 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f84f8151f40 0x7f84e4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:11.027 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.018+0000 7f84f5d9b640 1 --2- 172.21.15.86:0/1830669833 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84e4004d50 0x7f84e40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:11.027 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.018+0000 7f84f5d9b640 1 -- 172.21.15.86:0/1830669833 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f84f80c89e0 con 0x7f84e4004d50 2024-04-25T12:22:11.027 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.018+0000 7f84f5d9b640 1 -- 172.21.15.86:0/1830669833 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f84f80c8c80 con 0x7f84e40039c0 2024-04-25T12:22:11.027 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.018+0000 7f84f5d9b640 1 -- 172.21.15.86:0/1830669833 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f84e400b9d0 con 0x7f84f8151f40 2024-04-25T12:22:11.027 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.018+0000 7f84f6d9d640 1 --2- 172.21.15.86:0/1830669833 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84e4004d50 0x7f84e40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:11.028 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.018+0000 7f84effff640 1 --2- 172.21.15.86:0/1830669833 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f84f8151f40 0x7f84e4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:11.028 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.018+0000 7f84f659c640 1 --2- 172.21.15.86:0/1830669833 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84e40039c0 0x7f84e4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:11.028 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.018+0000 7f84f6d9d640 1 -- 172.21.15.86:0/1830669833 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f84f8151f40 msgr2=0x7f84e4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:11.028 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.018+0000 7f84f6d9d640 1 --2- 172.21.15.86:0/1830669833 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f84f8151f40 0x7f84e4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:11.028 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.018+0000 7f84f6d9d640 1 -- 172.21.15.86:0/1830669833 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84e40039c0 msgr2=0x7f84e4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:11.028 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.018+0000 7f84f6d9d640 1 --2- 172.21.15.86:0/1830669833 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84e40039c0 0x7f84e4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:11.028 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.018+0000 7f84f6d9d640 1 -- 172.21.15.86:0/1830669833 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84e4003530 con 0x7f84e4004d50 2024-04-25T12:22:11.029 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.022+0000 7f84f6d9d640 1 --2- 172.21.15.86:0/1830669833 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84e4004d50 0x7f84e40051d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f84f0009fc0 tx=0x7f84f001ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbd86b002b534f95 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:11.029 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.022+0000 7f84f5d9b640 1 -- 172.21.15.86:0/1830669833 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f00b2070 con 0x7f84e4004d50 2024-04-25T12:22:11.029 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.022+0000 7f84f5d9b640 1 -- 172.21.15.86:0/1830669833 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84f00a5cd0 con 0x7f84e4004d50 2024-04-25T12:22:11.029 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.022+0000 7f84f5d9b640 1 -- 172.21.15.86:0/1830669833 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f0009c10 con 0x7f84e4004d50 2024-04-25T12:22:11.030 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.022+0000 7f84fc842640 1 -- 172.21.15.86:0/1830669833 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84e4004d50 msgr2=0x7f84e40051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:11.030 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.022+0000 7f84fc842640 1 --2- 172.21.15.86:0/1830669833 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84e4004d50 0x7f84e40051d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f84f0009fc0 tx=0x7f84f001ccc0 comp rx=0 tx=0).stop 2024-04-25T12:22:11.030 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.022+0000 7f84f6d9d640 1 -- 172.21.15.86:0/1830669833 reap_dead start 2024-04-25T12:22:11.030 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.022+0000 7f84fc842640 1 -- 172.21.15.86:0/1830669833 shutdown_connections 2024-04-25T12:22:11.030 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.022+0000 7f84fc842640 1 -- 172.21.15.86:0/1830669833 >> 172.21.15.86:0/1830669833 conn(0x7f84f80ca540 msgr2=0x7f84f80ca950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:11.030 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.022+0000 7f84fc842640 1 -- 172.21.15.86:0/1830669833 shutdown_connections 2024-04-25T12:22:11.030 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.022+0000 7f84fc842640 1 -- 172.21.15.86:0/1830669833 wait complete. 2024-04-25T12:22:11.030 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.022+0000 7f84fc842640 1 Processor -- start 2024-04-25T12:22:11.030 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.022+0000 7f84fc842640 1 -- start start 2024-04-25T12:22:11.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.022+0000 7f84fc842640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84e4004d50 0x7f84f80cb440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:11.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.022+0000 7f84fc842640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84f81508f0 0x7f84f8147250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:11.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.022+0000 7f84fc842640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f84f8151070 0x7f84f81f42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:11.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.022+0000 7f84fc842640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f84f80c9170 con 0x7f84f81508f0 2024-04-25T12:22:11.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.022+0000 7f84fc842640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f84f81585e0 con 0x7f84e4004d50 2024-04-25T12:22:11.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.022+0000 7f84fc842640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f84f8152320 con 0x7f84f8151070 2024-04-25T12:22:11.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.022+0000 7f84effff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84f81508f0 0x7f84f8147250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:11.033 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.022+0000 7f84effff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84f81508f0 0x7f84f8147250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60294/0 (socket says 172.21.15.86:60294) 2024-04-25T12:22:11.033 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.022+0000 7f84effff640 1 -- 172.21.15.86:0/1422950250 learned_addr learned my addr 172.21.15.86:0/1422950250 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:11.033 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.022+0000 7f84f6d9d640 1 --2- 172.21.15.86:0/1422950250 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f84f8151070 0x7f84f81f42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:11.033 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.022+0000 7f84f659c640 1 --2- 172.21.15.86:0/1422950250 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84e4004d50 0x7f84f80cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:11.033 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.022+0000 7f84effff640 1 -- 172.21.15.86:0/1422950250 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f84f8151070 msgr2=0x7f84f81f42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:11.033 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.022+0000 7f84effff640 1 --2- 172.21.15.86:0/1422950250 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f84f8151070 0x7f84f81f42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:11.033 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.022+0000 7f84effff640 1 -- 172.21.15.86:0/1422950250 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84e4004d50 msgr2=0x7f84f80cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:11.033 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.022+0000 7f84effff640 1 --2- 172.21.15.86:0/1422950250 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84e4004d50 0x7f84f80cb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:11.033 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.022+0000 7f84effff640 1 -- 172.21.15.86:0/1422950250 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84f81f1900 con 0x7f84f81508f0 2024-04-25T12:22:11.033 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.022+0000 7f84f6d9d640 1 --2- 172.21.15.86:0/1422950250 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f84f8151070 0x7f84f81f42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:22:11.033 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.022+0000 7f84effff640 1 --2- 172.21.15.86:0/1422950250 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84f81508f0 0x7f84f8147250 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f84e00013e0 tx=0x7f84e0007710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:11.033 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.022+0000 7f84eeffd640 1 -- 172.21.15.86:0/1422950250 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e000e950 con 0x7f84f81508f0 2024-04-25T12:22:11.033 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.022+0000 7f84eeffd640 1 -- 172.21.15.86:0/1422950250 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84e0018070 con 0x7f84f81508f0 2024-04-25T12:22:11.034 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.022+0000 7f84eeffd640 1 -- 172.21.15.86:0/1422950250 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e000ed50 con 0x7f84f81508f0 2024-04-25T12:22:11.034 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.026+0000 7f84fc842640 1 -- 172.21.15.86:0/1422950250 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84f814fb30 con 0x7f84f81508f0 2024-04-25T12:22:11.034 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.026+0000 7f84fc842640 1 -- 172.21.15.86:0/1422950250 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84f81500f0 con 0x7f84f81508f0 2024-04-25T12:22:11.034 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.026+0000 7f84fc842640 1 -- 172.21.15.86:0/1422950250 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84f8075df0 con 0x7f84f81508f0 2024-04-25T12:22:11.034 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.026+0000 7f84eeffd640 1 -- 172.21.15.86:0/1422950250 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f84e001d460 con 0x7f84f81508f0 2024-04-25T12:22:11.034 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.026+0000 7f84eeffd640 1 --2- 172.21.15.86:0/1422950250 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f84d8068380 0x7f84d806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:11.035 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.026+0000 7f84eeffd640 1 -- 172.21.15.86:0/1422950250 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f84e0086e80 con 0x7f84f81508f0 2024-04-25T12:22:11.035 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.026+0000 7f84f659c640 1 --2- 172.21.15.86:0/1422950250 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f84d8068380 0x7f84d806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:11.035 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.026+0000 7f84f659c640 1 --2- 172.21.15.86:0/1422950250 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f84d8068380 0x7f84d806a840 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f84e80099b0 tx=0x7f84e8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:11.037 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.030+0000 7f84eeffd640 1 -- 172.21.15.86:0/1422950250 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f84f8157da0 con 0x7f84f81508f0 2024-04-25T12:22:11.199 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.190+0000 7f84fc842640 1 -- 172.21.15.86:0/1422950250 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f84f814e5d0 con 0x7f84f81508f0 2024-04-25T12:22:11.199 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.194+0000 7f84eeffd640 1 -- 172.21.15.86:0/1422950250 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f84e0057030 con 0x7f84f81508f0 2024-04-25T12:22:11.199 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 32 2024-04-25T12:22:11.201 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.194+0000 7f84fc842640 1 -- 172.21.15.86:0/1422950250 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f84d8068380 msgr2=0x7f84d806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:11.202 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.194+0000 7f84fc842640 1 --2- 172.21.15.86:0/1422950250 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f84d8068380 0x7f84d806a840 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f84e80099b0 tx=0x7f84e8008040 comp rx=0 tx=0).stop 2024-04-25T12:22:11.202 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.194+0000 7f84fc842640 1 -- 172.21.15.86:0/1422950250 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84f81508f0 msgr2=0x7f84f8147250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:11.202 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.194+0000 7f84fc842640 1 --2- 172.21.15.86:0/1422950250 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84f81508f0 0x7f84f8147250 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f84e00013e0 tx=0x7f84e0007710 comp rx=0 tx=0).stop 2024-04-25T12:22:11.202 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.194+0000 7f84fc842640 1 -- 172.21.15.86:0/1422950250 shutdown_connections 2024-04-25T12:22:11.202 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.194+0000 7f84fc842640 1 --2- 172.21.15.86:0/1422950250 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f84f8151070 0x7f84f81f42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:11.202 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.194+0000 7f84fc842640 1 --2- 172.21.15.86:0/1422950250 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f84d8068380 0x7f84d806a840 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:11.202 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.194+0000 7f84fc842640 1 --2- 172.21.15.86:0/1422950250 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84f81508f0 0x7f84f8147250 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:11.202 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.194+0000 7f84fc842640 1 --2- 172.21.15.86:0/1422950250 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84e4004d50 0x7f84f80cb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:11.202 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.194+0000 7f84fc842640 1 -- 172.21.15.86:0/1422950250 >> 172.21.15.86:0/1422950250 conn(0x7f84f80ca540 msgr2=0x7f84f806f5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:11.202 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.194+0000 7f84fc842640 1 -- 172.21.15.86:0/1422950250 shutdown_connections 2024-04-25T12:22:11.202 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.194+0000 7f84fc842640 1 -- 172.21.15.86:0/1422950250 wait complete. 2024-04-25T12:22:11.217 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T12:22:11.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.334+0000 7fec2964c640 1 Processor -- start 2024-04-25T12:22:11.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.334+0000 7fec2964c640 1 -- start start 2024-04-25T12:22:11.343 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.334+0000 7fec2964c640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fec2414ffa0 0x7fec2406f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:11.343 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.334+0000 7fec2964c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fec24074100 0x7fec240c7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:11.343 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.334+0000 7fec2964c640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec240c5d70 con 0x7fec2414fbc0 2024-04-25T12:22:11.343 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.334+0000 7fec2964c640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7fec240c6050 con 0x7fec2414ffa0 2024-04-25T12:22:11.343 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.334+0000 7fec2964c640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fec240c6330 con 0x7fec24074100 2024-04-25T12:22:11.343 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.334+0000 7fec1a7fc640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fec2414ffa0 0x7fec2406f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:11.343 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.334+0000 7fec1a7fc640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fec2414ffa0 0x7fec2406f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60304/0 (socket says 172.21.15.86:60304) 2024-04-25T12:22:11.344 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.334+0000 7fec1a7fc640 1 -- 172.21.15.86:0/354249125 learned_addr learned my addr 172.21.15.86:0/354249125 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:11.344 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.338+0000 7fec237fe640 1 --2- 172.21.15.86:0/354249125 >> v2:172.21.15.134:3300/0 conn(0x7fec24074100 0x7fec240c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:11.344 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.338+0000 7fec1a7fc640 1 -- 172.21.15.86:0/354249125 >> v2:172.21.15.134:3300/0 conn(0x7fec24074100 msgr2=0x7fec240c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:11.344 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.338+0000 7fec1a7fc640 1 --2- 172.21.15.86:0/354249125 >> v2:172.21.15.134:3300/0 conn(0x7fec24074100 0x7fec240c7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:11.344 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.338+0000 7fec1a7fc640 1 -- 172.21.15.86:0/354249125 >> v1:172.21.15.134:6789/0 conn(0x7fec2414fbc0 legacy=0x7fec240c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:11.344 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.338+0000 7fec1a7fc640 1 -- 172.21.15.86:0/354249125 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec240c6610 con 0x7fec2414ffa0 2024-04-25T12:22:11.345 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.338+0000 7fec1a7fc640 1 --2- 172.21.15.86:0/354249125 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fec2414ffa0 0x7fec2406f700 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fec0c009870 tx=0x7fec0c01c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4c2dc1756f619d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:11.345 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.338+0000 7fec227fc640 1 -- 172.21.15.86:0/354249125 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec0c0aa660 con 0x7fec2414ffa0 2024-04-25T12:22:11.345 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.338+0000 7fec227fc640 1 -- 172.21.15.86:0/354249125 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec0c0af070 con 0x7fec2414ffa0 2024-04-25T12:22:11.346 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.338+0000 7fec227fc640 1 -- 172.21.15.86:0/354249125 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec0c0aaa20 con 0x7fec2414ffa0 2024-04-25T12:22:11.346 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.338+0000 7fec2964c640 1 -- 172.21.15.86:0/354249125 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fec2414ffa0 msgr2=0x7fec2406f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:11.346 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.338+0000 7fec2964c640 1 --2- 172.21.15.86:0/354249125 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fec2414ffa0 0x7fec2406f700 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fec0c009870 tx=0x7fec0c01c4e0 comp rx=0 tx=0).stop 2024-04-25T12:22:11.346 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.338+0000 7fec2964c640 1 -- 172.21.15.86:0/354249125 shutdown_connections 2024-04-25T12:22:11.347 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.338+0000 7fec2964c640 1 --2- 172.21.15.86:0/354249125 >> v2:172.21.15.134:3300/0 conn(0x7fec24074100 0x7fec240c7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:11.347 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.338+0000 7fec2964c640 1 --2- 172.21.15.86:0/354249125 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fec2414ffa0 0x7fec2406f700 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:11.347 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.338+0000 7fec2964c640 1 -- 172.21.15.86:0/354249125 >> 172.21.15.86:0/354249125 conn(0x7fec2406b9d0 msgr2=0x7fec2406bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:11.347 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.338+0000 7fec2964c640 1 -- 172.21.15.86:0/354249125 shutdown_connections 2024-04-25T12:22:11.347 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.338+0000 7fec2964c640 1 -- 172.21.15.86:0/354249125 wait complete. 2024-04-25T12:22:11.347 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.342+0000 7fec2964c640 1 Processor -- start 2024-04-25T12:22:11.347 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.342+0000 7fec2964c640 1 -- start start 2024-04-25T12:22:11.350 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.342+0000 7fec2964c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fec24074100 0x7fec240cbb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:11.350 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.342+0000 7fec2964c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fec2414fbc0 0x7fec241f75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:11.350 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.342+0000 7fec2964c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec2414ffa0 0x7fec241f7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:11.350 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.342+0000 7fec2964c640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fec240c8ab0 con 0x7fec24074100 2024-04-25T12:22:11.350 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.342+0000 7fec2964c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fec240c8930 con 0x7fec2414ffa0 2024-04-25T12:22:11.350 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.342+0000 7fec2964c640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fec24166090 con 0x7fec2414fbc0 2024-04-25T12:22:11.350 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.342+0000 7fec22ffd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fec24074100 0x7fec240cbb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:11.350 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.342+0000 7fec22ffd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fec24074100 0x7fec240cbb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60320/0 (socket says 172.21.15.86:60320) 2024-04-25T12:22:11.350 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.342+0000 7fec22ffd640 1 -- 172.21.15.86:0/3697371899 learned_addr learned my addr 172.21.15.86:0/3697371899 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:11.350 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.342+0000 7fec237fe640 1 --2- 172.21.15.86:0/3697371899 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec2414ffa0 0x7fec241f7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:11.350 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.342+0000 7fec1a7fc640 1 --2- 172.21.15.86:0/3697371899 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fec2414fbc0 0x7fec241f75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:11.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.342+0000 7fec22ffd640 1 -- 172.21.15.86:0/3697371899 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fec2414fbc0 msgr2=0x7fec241f75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:11.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.342+0000 7fec22ffd640 1 --2- 172.21.15.86:0/3697371899 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fec2414fbc0 0x7fec241f75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:11.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.342+0000 7fec22ffd640 1 -- 172.21.15.86:0/3697371899 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec2414ffa0 msgr2=0x7fec241f7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:11.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.342+0000 7fec22ffd640 1 --2- 172.21.15.86:0/3697371899 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec2414ffa0 0x7fec241f7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:11.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.342+0000 7fec22ffd640 1 -- 172.21.15.86:0/3697371899 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec240c5590 con 0x7fec24074100 2024-04-25T12:22:11.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.342+0000 7fec22ffd640 1 --2- 172.21.15.86:0/3697371899 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fec24074100 0x7fec240cbb30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fec1400c450 tx=0x7fec1400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:11.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.342+0000 7fec1bfff640 1 -- 172.21.15.86:0/3697371899 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec14012830 con 0x7fec24074100 2024-04-25T12:22:11.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.342+0000 7fec1bfff640 1 -- 172.21.15.86:0/3697371899 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec14017070 con 0x7fec24074100 2024-04-25T12:22:11.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.342+0000 7fec2964c640 1 -- 172.21.15.86:0/3697371899 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec240c5870 con 0x7fec24074100 2024-04-25T12:22:11.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.342+0000 7fec1bfff640 1 -- 172.21.15.86:0/3697371899 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec14012c30 con 0x7fec24074100 2024-04-25T12:22:11.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.342+0000 7fec2964c640 1 -- 172.21.15.86:0/3697371899 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec24162fc0 con 0x7fec24074100 2024-04-25T12:22:11.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.342+0000 7fec2964c640 1 -- 172.21.15.86:0/3697371899 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec24075df0 con 0x7fec24074100 2024-04-25T12:22:11.352 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.342+0000 7fec1bfff640 1 -- 172.21.15.86:0/3697371899 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fec1401c460 con 0x7fec24074100 2024-04-25T12:22:11.352 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.342+0000 7fec1bfff640 1 --2- 172.21.15.86:0/3697371899 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fec04068380 0x7fec0406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:11.352 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.346+0000 7fec1bfff640 1 -- 172.21.15.86:0/3697371899 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fec14086a60 con 0x7fec24074100 2024-04-25T12:22:11.352 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.346+0000 7fec1a7fc640 1 --2- 172.21.15.86:0/3697371899 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fec04068380 0x7fec0406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:11.352 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.346+0000 7fec1a7fc640 1 --2- 172.21.15.86:0/3697371899 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fec04068380 0x7fec0406a840 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fec0c0ae000 tx=0x7fec0c0a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:11.355 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.350+0000 7fec1bfff640 1 -- 172.21.15.86:0/3697371899 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fec14056540 con 0x7fec24074100 2024-04-25T12:22:11.504 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.498+0000 7fec2964c640 1 -- 172.21.15.86:0/3697371899 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fec2415d3f0 con 0x7fec24074100 2024-04-25T12:22:11.505 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.498+0000 7fec1bfff640 1 -- 172.21.15.86:0/3697371899 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7fec1405a840 con 0x7fec24074100 2024-04-25T12:22:11.505 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 64 2024-04-25T12:22:11.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.502+0000 7fec2964c640 1 -- 172.21.15.86:0/3697371899 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fec04068380 msgr2=0x7fec0406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:11.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.502+0000 7fec2964c640 1 --2- 172.21.15.86:0/3697371899 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fec04068380 0x7fec0406a840 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fec0c0ae000 tx=0x7fec0c0a7000 comp rx=0 tx=0).stop 2024-04-25T12:22:11.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.502+0000 7fec2964c640 1 -- 172.21.15.86:0/3697371899 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fec24074100 msgr2=0x7fec240cbb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:11.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.502+0000 7fec2964c640 1 --2- 172.21.15.86:0/3697371899 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fec24074100 0x7fec240cbb30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fec1400c450 tx=0x7fec1400c910 comp rx=0 tx=0).stop 2024-04-25T12:22:11.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.502+0000 7fec2964c640 1 -- 172.21.15.86:0/3697371899 shutdown_connections 2024-04-25T12:22:11.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.502+0000 7fec2964c640 1 --2- 172.21.15.86:0/3697371899 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec2414ffa0 0x7fec241f7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:11.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.502+0000 7fec2964c640 1 --2- 172.21.15.86:0/3697371899 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fec2414fbc0 0x7fec241f75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:11.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.502+0000 7fec2964c640 1 --2- 172.21.15.86:0/3697371899 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fec04068380 0x7fec0406a840 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:11.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.502+0000 7fec2964c640 1 --2- 172.21.15.86:0/3697371899 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fec24074100 0x7fec240cbb30 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:11.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.502+0000 7fec2964c640 1 -- 172.21.15.86:0/3697371899 >> 172.21.15.86:0/3697371899 conn(0x7fec2406b9d0 msgr2=0x7fec2414dfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:11.509 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.502+0000 7fec2964c640 1 -- 172.21.15.86:0/3697371899 shutdown_connections 2024-04-25T12:22:11.509 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.502+0000 7fec2964c640 1 -- 172.21.15.86:0/3697371899 wait complete. 2024-04-25T12:22:11.523 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T12:22:11.640 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.634+0000 7f78c4bc6640 1 Processor -- start 2024-04-25T12:22:11.640 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.634+0000 7f78c4bc6640 1 -- start start 2024-04-25T12:22:11.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.634+0000 7f78c4bc6640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f78c0074100 0x7f78c006f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:11.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.634+0000 7f78c4bc6640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78c00c5d70 con 0x7f78c014ffa0 2024-04-25T12:22:11.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.634+0000 7f78c4bc6640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78c00c6050 con 0x7f78c014fbc0 2024-04-25T12:22:11.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.634+0000 7f78c4bc6640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f78c00c6330 con 0x7f78c0074100 2024-04-25T12:22:11.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.634+0000 7f78bdd9b640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f78c014ffa0 0x7f78c00c7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:58500/0 (socket says 172.21.15.86:58500) 2024-04-25T12:22:11.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.634+0000 7f78bdd9b640 1 -- 172.21.15.86:0/1915984352 learned_addr learned my addr 172.21.15.86:0/1915984352 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-04-25T12:22:11.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.634+0000 7f78bed9d640 1 --2- 172.21.15.86:0/1915984352 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f78c0074100 0x7f78c006f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:11.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.634+0000 7f78bd59a640 1 -- 172.21.15.86:0/1915984352 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2617356849 0 0) 0x7f78c00c5d70 con 0x7f78c014ffa0 2024-04-25T12:22:11.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.634+0000 7f78bd59a640 1 -- 172.21.15.86:0/1915984352 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78ac003530 con 0x7f78c014ffa0 2024-04-25T12:22:11.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.634+0000 7f78bd59a640 1 -- 172.21.15.86:0/1915984352 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3926723309 0 0) 0x7f78c00c6050 con 0x7f78c014fbc0 2024-04-25T12:22:11.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.634+0000 7f78bd59a640 1 -- 172.21.15.86:0/1915984352 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78c00c5d70 con 0x7f78c014fbc0 2024-04-25T12:22:11.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.634+0000 7f78bed9d640 1 -- 172.21.15.86:0/1915984352 >> v1:172.21.15.134:6789/0 conn(0x7f78c014fbc0 legacy=0x7f78c00c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:11.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.634+0000 7f78bed9d640 1 -- 172.21.15.86:0/1915984352 >> v1:172.21.15.86:6789/0 conn(0x7f78c014ffa0 legacy=0x7f78c00c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:11.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.634+0000 7f78bed9d640 1 -- 172.21.15.86:0/1915984352 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78c00c6610 con 0x7f78c0074100 2024-04-25T12:22:11.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.638+0000 7f78bed9d640 1 --2- 172.21.15.86:0/1915984352 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f78c0074100 0x7f78c006f700 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f78b0009dc0 tx=0x7f78b001c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88542c0afae0b390 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:11.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.638+0000 7f78bd59a640 1 -- 172.21.15.86:0/1915984352 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b00b2070 con 0x7f78c0074100 2024-04-25T12:22:11.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.638+0000 7f78bd59a640 1 -- 172.21.15.86:0/1915984352 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78b00a5a70 con 0x7f78c0074100 2024-04-25T12:22:11.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.638+0000 7f78bd59a640 1 -- 172.21.15.86:0/1915984352 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b00a5e20 con 0x7f78c0074100 2024-04-25T12:22:11.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.638+0000 7f78c4bc6640 1 -- 172.21.15.86:0/1915984352 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f78c0074100 msgr2=0x7f78c006f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:11.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.638+0000 7f78c4bc6640 1 --2- 172.21.15.86:0/1915984352 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f78c0074100 0x7f78c006f700 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f78b0009dc0 tx=0x7f78b001c990 comp rx=0 tx=0).stop 2024-04-25T12:22:11.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.638+0000 7f78c4bc6640 1 -- 172.21.15.86:0/1915984352 shutdown_connections 2024-04-25T12:22:11.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.638+0000 7f78c4bc6640 1 --2- 172.21.15.86:0/1915984352 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f78c0074100 0x7f78c006f700 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:11.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.638+0000 7f78c4bc6640 1 -- 172.21.15.86:0/1915984352 >> 172.21.15.86:0/1915984352 conn(0x7f78c006b9d0 msgr2=0x7f78c006bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:11.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.638+0000 7f78c4bc6640 1 -- 172.21.15.86:0/1915984352 shutdown_connections 2024-04-25T12:22:11.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.638+0000 7f78c4bc6640 1 -- 172.21.15.86:0/1915984352 wait complete. 2024-04-25T12:22:11.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.638+0000 7f78c4bc6640 1 Processor -- start 2024-04-25T12:22:11.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.638+0000 7f78c4bc6640 1 -- start start 2024-04-25T12:22:11.648 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.642+0000 7f78c4bc6640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f78c0074100 0x7f78c01503c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:11.649 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.642+0000 7f78c4bc6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78c014fbc0 0x7f78c0152010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:11.649 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.642+0000 7f78c4bc6640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78c014ffa0 0x7f78c015a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:11.649 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.642+0000 7f78c4bc6640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f78c0167630 con 0x7f78c014ffa0 2024-04-25T12:22:11.649 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.642+0000 7f78c4bc6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f78c01674b0 con 0x7f78c014fbc0 2024-04-25T12:22:11.649 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.642+0000 7f78c4bc6640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f78c01677b0 con 0x7f78c0074100 2024-04-25T12:22:11.649 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.642+0000 7f78bed9d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78c014ffa0 0x7f78c015a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:11.649 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.642+0000 7f78bed9d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78c014ffa0 0x7f78c015a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60336/0 (socket says 172.21.15.86:60336) 2024-04-25T12:22:11.649 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.642+0000 7f78bed9d640 1 -- 172.21.15.86:0/648418545 learned_addr learned my addr 172.21.15.86:0/648418545 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:11.649 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.642+0000 7f78bdd9b640 1 --2- 172.21.15.86:0/648418545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78c014fbc0 0x7f78c0152010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:11.649 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.642+0000 7f78be59c640 1 --2- 172.21.15.86:0/648418545 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f78c0074100 0x7f78c01503c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:11.649 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.642+0000 7f78bed9d640 1 -- 172.21.15.86:0/648418545 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f78c0074100 msgr2=0x7f78c01503c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:11.649 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.642+0000 7f78bed9d640 1 --2- 172.21.15.86:0/648418545 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f78c0074100 0x7f78c01503c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:11.649 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.642+0000 7f78bed9d640 1 -- 172.21.15.86:0/648418545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78c014fbc0 msgr2=0x7f78c0152010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:11.649 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.642+0000 7f78bed9d640 1 --2- 172.21.15.86:0/648418545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78c014fbc0 0x7f78c0152010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:11.650 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.642+0000 7f78bed9d640 1 -- 172.21.15.86:0/648418545 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78c0151a70 con 0x7f78c014ffa0 2024-04-25T12:22:11.650 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.642+0000 7f78bed9d640 1 --2- 172.21.15.86:0/648418545 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78c014ffa0 0x7f78c015a080 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f78b00195a0 tx=0x7f78b0019730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:11.650 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.642+0000 7f78b6ffd640 1 -- 172.21.15.86:0/648418545 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b00b2050 con 0x7f78c014ffa0 2024-04-25T12:22:11.650 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.642+0000 7f78b6ffd640 1 -- 172.21.15.86:0/648418545 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78b00be070 con 0x7f78c014ffa0 2024-04-25T12:22:11.650 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.642+0000 7f78c4bc6640 1 -- 172.21.15.86:0/648418545 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78c015c850 con 0x7f78c014ffa0 2024-04-25T12:22:11.650 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.642+0000 7f78b6ffd640 1 -- 172.21.15.86:0/648418545 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b0004040 con 0x7f78c014ffa0 2024-04-25T12:22:11.650 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.642+0000 7f78c4bc6640 1 -- 172.21.15.86:0/648418545 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78c014e140 con 0x7f78c014ffa0 2024-04-25T12:22:11.650 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.642+0000 7f78c4bc6640 1 -- 172.21.15.86:0/648418545 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78c0075df0 con 0x7f78c014ffa0 2024-04-25T12:22:11.651 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.642+0000 7f78b6ffd640 1 -- 172.21.15.86:0/648418545 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f78b00041e0 con 0x7f78c014ffa0 2024-04-25T12:22:11.651 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.642+0000 7f78b6ffd640 1 --2- 172.21.15.86:0/648418545 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f78a0068380 0x7f78a006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:11.651 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.642+0000 7f78b6ffd640 1 -- 172.21.15.86:0/648418545 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f78b0121d70 con 0x7f78c014ffa0 2024-04-25T12:22:11.651 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.642+0000 7f78be59c640 1 --2- 172.21.15.86:0/648418545 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f78a0068380 0x7f78a006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:11.651 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.642+0000 7f78be59c640 1 --2- 172.21.15.86:0/648418545 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f78a0068380 0x7f78a006a840 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f78b8007fd0 tx=0x7f78b8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:11.654 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.646+0000 7f78b6ffd640 1 -- 172.21.15.86:0/648418545 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f78b00c8020 con 0x7f78c014ffa0 2024-04-25T12:22:11.801 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.794+0000 7f78c4bc6640 1 -- 172.21.15.86:0/648418545 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f78c00c7df0 con 0x7f78c014ffa0 2024-04-25T12:22:11.802 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.794+0000 7f78b6ffd640 1 -- 172.21.15.86:0/648418545 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f78b0016580 con 0x7f78c014ffa0 2024-04-25T12:22:11.802 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 32 2024-04-25T12:22:11.804 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.798+0000 7f78c4bc6640 1 -- 172.21.15.86:0/648418545 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f78a0068380 msgr2=0x7f78a006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:11.805 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.798+0000 7f78c4bc6640 1 --2- 172.21.15.86:0/648418545 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f78a0068380 0x7f78a006a840 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f78b8007fd0 tx=0x7f78b8009040 comp rx=0 tx=0).stop 2024-04-25T12:22:11.805 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.798+0000 7f78c4bc6640 1 -- 172.21.15.86:0/648418545 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78c014ffa0 msgr2=0x7f78c015a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:11.805 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.798+0000 7f78c4bc6640 1 --2- 172.21.15.86:0/648418545 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78c014ffa0 0x7f78c015a080 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f78b00195a0 tx=0x7f78b0019730 comp rx=0 tx=0).stop 2024-04-25T12:22:11.805 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.798+0000 7f78c4bc6640 1 -- 172.21.15.86:0/648418545 shutdown_connections 2024-04-25T12:22:11.805 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.798+0000 7f78c4bc6640 1 --2- 172.21.15.86:0/648418545 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f78a0068380 0x7f78a006a840 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:11.805 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.798+0000 7f78c4bc6640 1 --2- 172.21.15.86:0/648418545 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78c014ffa0 0x7f78c015a080 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:11.805 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.798+0000 7f78c4bc6640 1 --2- 172.21.15.86:0/648418545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78c014fbc0 0x7f78c0152010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:11.805 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.798+0000 7f78c4bc6640 1 --2- 172.21.15.86:0/648418545 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f78c0074100 0x7f78c01503c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:11.805 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.798+0000 7f78c4bc6640 1 -- 172.21.15.86:0/648418545 >> 172.21.15.86:0/648418545 conn(0x7f78c006b9d0 msgr2=0x7f78c006c410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:11.805 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.798+0000 7f78c4bc6640 1 -- 172.21.15.86:0/648418545 shutdown_connections 2024-04-25T12:22:11.805 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.798+0000 7f78c4bc6640 1 -- 172.21.15.86:0/648418545 wait complete. 2024-04-25T12:22:11.820 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T12:22:11.936 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.930+0000 7f31a09e5640 1 Processor -- start 2024-04-25T12:22:11.936 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.930+0000 7f31a09e5640 1 -- start start 2024-04-25T12:22:11.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.930+0000 7f31a09e5640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f319c0c8630 0x7f319c151b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:11.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.930+0000 7f31a09e5640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f319c0c8a70 0x7f319c152080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:11.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.930+0000 7f31a09e5640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f319c15b740 con 0x7f319c0c8250 2024-04-25T12:22:11.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.930+0000 7f31a09e5640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f319c0c6490 con 0x7f319c0c8630 2024-04-25T12:22:11.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.930+0000 7f31a09e5640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f319c1525c0 con 0x7f319c0c8a70 2024-04-25T12:22:11.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.930+0000 7f319a59c640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f319c0c8250 0x7f319c0c39e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:58510/0 (socket says 172.21.15.86:58510) 2024-04-25T12:22:11.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.930+0000 7f319a59c640 1 -- 172.21.15.86:0/3741655194 learned_addr learned my addr 172.21.15.86:0/3741655194 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-04-25T12:22:11.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.930+0000 7f319ad9d640 1 --2- 172.21.15.86:0/3741655194 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f319c0c8a70 0x7f319c152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:11.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.930+0000 7f3191d9b640 1 --2- 172.21.15.86:0/3741655194 >> v2:172.21.15.134:3300/0 conn(0x7f319c0c8630 0x7f319c151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:11.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.930+0000 7f3199d9b640 1 -- 172.21.15.86:0/3741655194 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3613728652 0 0) 0x7f319c15b740 con 0x7f319c0c8250 2024-04-25T12:22:11.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.930+0000 7f3199d9b640 1 -- 172.21.15.86:0/3741655194 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3188003530 con 0x7f319c0c8250 2024-04-25T12:22:11.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.930+0000 7f3199d9b640 1 -- 172.21.15.86:0/3741655194 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1108148389 0 0) 0x7f3188003530 con 0x7f319c0c8250 2024-04-25T12:22:11.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.930+0000 7f3199d9b640 1 -- 172.21.15.86:0/3741655194 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f319c0c8a70 msgr2=0x7f319c152080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:11.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.930+0000 7f3199d9b640 1 --2- 172.21.15.86:0/3741655194 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f319c0c8a70 0x7f319c152080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:11.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.930+0000 7f3199d9b640 1 -- 172.21.15.86:0/3741655194 >> v2:172.21.15.134:3300/0 conn(0x7f319c0c8630 msgr2=0x7f319c151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:11.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.930+0000 7f3199d9b640 1 --2- 172.21.15.86:0/3741655194 >> v2:172.21.15.134:3300/0 conn(0x7f319c0c8630 0x7f319c151b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:11.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.930+0000 7f3199d9b640 1 -- 172.21.15.86:0/3741655194 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f319c0c40f0 con 0x7f319c0c8250 2024-04-25T12:22:11.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.930+0000 7f3199d9b640 1 -- 172.21.15.86:0/3741655194 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1387950573 0 0) 0x7f318c001680 con 0x7f319c0c8250 2024-04-25T12:22:11.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.930+0000 7f3199d9b640 1 -- 172.21.15.86:0/3741655194 >> v1:172.21.15.86:6789/0 conn(0x7f319c0c8250 legacy=0x7f319c0c39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:11.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.930+0000 7f3199d9b640 1 --2- 172.21.15.86:0/3741655194 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f31880039c0 0x7f3188003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:11.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.930+0000 7f3199d9b640 1 --2- 172.21.15.86:0/3741655194 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f319c0c8a70 0x7f3188004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:11.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.930+0000 7f3199d9b640 1 --2- 172.21.15.86:0/3741655194 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3188004d50 0x7f31880051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:11.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.930+0000 7f3199d9b640 1 -- 172.21.15.86:0/3741655194 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f319c0c6490 con 0x7f3188004d50 2024-04-25T12:22:11.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.930+0000 7f3199d9b640 1 -- 172.21.15.86:0/3741655194 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f319c1525c0 con 0x7f31880039c0 2024-04-25T12:22:11.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.930+0000 7f3199d9b640 1 -- 172.21.15.86:0/3741655194 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f318800b9d0 con 0x7f319c0c8a70 2024-04-25T12:22:11.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.930+0000 7f319ad9d640 1 --2- 172.21.15.86:0/3741655194 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3188004d50 0x7f31880051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:11.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.930+0000 7f319a59c640 1 --2- 172.21.15.86:0/3741655194 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f31880039c0 0x7f3188003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:11.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.930+0000 7f3191d9b640 1 --2- 172.21.15.86:0/3741655194 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f319c0c8a70 0x7f3188004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:11.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.930+0000 7f319ad9d640 1 -- 172.21.15.86:0/3741655194 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f319c0c8a70 msgr2=0x7f3188004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:11.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.930+0000 7f319ad9d640 1 --2- 172.21.15.86:0/3741655194 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f319c0c8a70 0x7f3188004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:11.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.930+0000 7f319ad9d640 1 -- 172.21.15.86:0/3741655194 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f31880039c0 msgr2=0x7f3188003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:11.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.930+0000 7f319ad9d640 1 --2- 172.21.15.86:0/3741655194 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f31880039c0 0x7f3188003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:11.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.930+0000 7f319ad9d640 1 -- 172.21.15.86:0/3741655194 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3188003530 con 0x7f3188004d50 2024-04-25T12:22:11.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.930+0000 7f3191d9b640 1 --2- 172.21.15.86:0/3741655194 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f319c0c8a70 0x7f3188004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:22:11.942 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.934+0000 7f319ad9d640 1 --2- 172.21.15.86:0/3741655194 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3188004d50 0x7f31880051d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3194009fc0 tx=0x7f319401cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49416256a23a023e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:11.942 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.934+0000 7f3199d9b640 1 -- 172.21.15.86:0/3741655194 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31940b2070 con 0x7f3188004d50 2024-04-25T12:22:11.942 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.934+0000 7f3199d9b640 1 -- 172.21.15.86:0/3741655194 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31940a5b80 con 0x7f3188004d50 2024-04-25T12:22:11.942 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.934+0000 7f3199d9b640 1 -- 172.21.15.86:0/3741655194 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3194009c10 con 0x7f3188004d50 2024-04-25T12:22:11.943 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.934+0000 7f31a09e5640 1 -- 172.21.15.86:0/3741655194 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3188004d50 msgr2=0x7f31880051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:11.943 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.934+0000 7f31a09e5640 1 --2- 172.21.15.86:0/3741655194 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3188004d50 0x7f31880051d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3194009fc0 tx=0x7f319401cc80 comp rx=0 tx=0).stop 2024-04-25T12:22:11.943 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.934+0000 7f319ad9d640 1 -- 172.21.15.86:0/3741655194 reap_dead start 2024-04-25T12:22:11.943 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.934+0000 7f31a09e5640 1 -- 172.21.15.86:0/3741655194 shutdown_connections 2024-04-25T12:22:11.943 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.934+0000 7f31a09e5640 1 -- 172.21.15.86:0/3741655194 >> 172.21.15.86:0/3741655194 conn(0x7f319c06b9d0 msgr2=0x7f319c06bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:11.943 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.934+0000 7f31a09e5640 1 -- 172.21.15.86:0/3741655194 shutdown_connections 2024-04-25T12:22:11.943 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.934+0000 7f31a09e5640 1 -- 172.21.15.86:0/3741655194 wait complete. 2024-04-25T12:22:11.944 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.938+0000 7f31a09e5640 1 Processor -- start 2024-04-25T12:22:11.944 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.938+0000 7f31a09e5640 1 -- start start 2024-04-25T12:22:11.946 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.938+0000 7f31a09e5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3188004d50 0x7f319c1f2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:11.947 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.938+0000 7f31a09e5640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f319c1ef4c0 0x7f319c14c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:11.947 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.938+0000 7f31a09e5640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f319c0cbdd0 0x7f319c1428b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:11.947 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.938+0000 7f31a09e5640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f319c0c5e40 con 0x7f319c1ef4c0 2024-04-25T12:22:11.947 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.938+0000 7f31a09e5640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f319c0c58c0 con 0x7f3188004d50 2024-04-25T12:22:11.947 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.938+0000 7f31a09e5640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f319c0c6120 con 0x7f319c0cbdd0 2024-04-25T12:22:11.947 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.938+0000 7f3191d9b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f319c1ef4c0 0x7f319c14c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:11.947 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.938+0000 7f3191d9b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f319c1ef4c0 0x7f319c14c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60348/0 (socket says 172.21.15.86:60348) 2024-04-25T12:22:11.947 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.938+0000 7f3191d9b640 1 -- 172.21.15.86:0/200641579 learned_addr learned my addr 172.21.15.86:0/200641579 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:11.947 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.938+0000 7f319ad9d640 1 --2- 172.21.15.86:0/200641579 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f319c0cbdd0 0x7f319c1428b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:11.947 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.938+0000 7f319a59c640 1 --2- 172.21.15.86:0/200641579 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3188004d50 0x7f319c1f2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:11.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.938+0000 7f3191d9b640 1 -- 172.21.15.86:0/200641579 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f319c0cbdd0 msgr2=0x7f319c1428b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:11.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.938+0000 7f3191d9b640 1 --2- 172.21.15.86:0/200641579 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f319c0cbdd0 0x7f319c1428b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:11.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.938+0000 7f3191d9b640 1 -- 172.21.15.86:0/200641579 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3188004d50 msgr2=0x7f319c1f2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:11.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.938+0000 7f3191d9b640 1 --2- 172.21.15.86:0/200641579 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3188004d50 0x7f319c1f2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:11.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.938+0000 7f3191d9b640 1 -- 172.21.15.86:0/200641579 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f319c072660 con 0x7f319c1ef4c0 2024-04-25T12:22:11.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.938+0000 7f3191d9b640 1 --2- 172.21.15.86:0/200641579 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f319c1ef4c0 0x7f319c14c050 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f31840109b0 tx=0x7f3184010e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:11.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.938+0000 7f31937fe640 1 -- 172.21.15.86:0/200641579 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f318400f040 con 0x7f319c1ef4c0 2024-04-25T12:22:11.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.938+0000 7f31937fe640 1 -- 172.21.15.86:0/200641579 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f318400ec20 con 0x7f319c1ef4c0 2024-04-25T12:22:11.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.938+0000 7f31a09e5640 1 -- 172.21.15.86:0/200641579 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f319c072900 con 0x7f319c1ef4c0 2024-04-25T12:22:11.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.938+0000 7f31937fe640 1 -- 172.21.15.86:0/200641579 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3184004020 con 0x7f319c1ef4c0 2024-04-25T12:22:11.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.938+0000 7f31a09e5640 1 -- 172.21.15.86:0/200641579 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f319c1eecc0 con 0x7f319c1ef4c0 2024-04-25T12:22:11.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.942+0000 7f31a09e5640 1 -- 172.21.15.86:0/200641579 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f319c1ee7d0 con 0x7f319c1ef4c0 2024-04-25T12:22:11.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.942+0000 7f31937fe640 1 -- 172.21.15.86:0/200641579 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f31840041c0 con 0x7f319c1ef4c0 2024-04-25T12:22:11.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.942+0000 7f31937fe640 1 --2- 172.21.15.86:0/200641579 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f317c068380 0x7f317c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:11.950 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.942+0000 7f31937fe640 1 -- 172.21.15.86:0/200641579 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f3184087260 con 0x7f319c1ef4c0 2024-04-25T12:22:11.950 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.942+0000 7f319a59c640 1 --2- 172.21.15.86:0/200641579 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f317c068380 0x7f317c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:11.950 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.942+0000 7f319a59c640 1 --2- 172.21.15.86:0/200641579 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f317c068380 0x7f317c06a840 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f318c000c10 tx=0x7f318c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:11.952 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:11.946+0000 7f31937fe640 1 -- 172.21.15.86:0/200641579 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3184018030 con 0x7f319c1ef4c0 2024-04-25T12:22:12.151 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.142+0000 7f31a09e5640 1 -- 172.21.15.86:0/200641579 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f319c075df0 con 0x7f319c1ef4c0 2024-04-25T12:22:12.151 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.146+0000 7f31937fe640 1 -- 172.21.15.86:0/200641579 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6917 (secure 0 0 0) 0x7f31840044b0 con 0x7f319c1ef4c0 2024-04-25T12:22:12.152 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:22:12.152 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/1969068022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1969068022},{"type":"v1","addr":"172.21.15.86:6835","nonce":1969068022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T12:21:23.459093+0000","modified":"2024-04-25T12:22:09.931071+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4294,"mds_1":4262,"mds_2":4245,"mds_3":4239,"mds_4":4236},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4236":{"gid":4236,"name":"a","rank":4,"incarnation":18,"state":"up:creating","state_seq":1,"addr":"172.21.15.86:6838/3213562806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":3213562806},{"type":"v1","addr":"172.21.15.86:6838","nonce":3213562806}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4239":{"gid":4239,"name":"c","rank":3,"incarnation":16,"state":"up:active","state_seq":14,"addr":"172.21.15.86:6839/4002713597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6837","nonce":4002713597},{"type":"v1","addr":"172.21.15.86:6839","nonce":4002713597}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4245":{"gid":4245,"name":"d","rank":2,"incarnation":14,"state":"up:active","state_seq":13,"addr":"172.21.15.134:6833/3114005030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3114005030},{"type":"v1","addr":"172.21.15.134:6833","nonce":3114005030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4262":{"gid":4262,"name":"b","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.134:6837/1079608447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":1079608447},{"type":"v1","addr":"172.21.15.134:6837","nonce":1079608447}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4294":{"gid":4294,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6836/3044511437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3044511437},{"type":"v1","addr":"172.21.15.134:6836","nonce":3044511437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4294,4262,4245,4239]},"id":1}]} 2024-04-25T12:22:12.152 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 18 2024-04-25T12:22:12.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.146+0000 7f31a09e5640 1 -- 172.21.15.86:0/200641579 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f317c068380 msgr2=0x7f317c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:12.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.146+0000 7f31a09e5640 1 --2- 172.21.15.86:0/200641579 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f317c068380 0x7f317c06a840 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f318c000c10 tx=0x7f318c009040 comp rx=0 tx=0).stop 2024-04-25T12:22:12.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.146+0000 7f31a09e5640 1 -- 172.21.15.86:0/200641579 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f319c1ef4c0 msgr2=0x7f319c14c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:12.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.146+0000 7f31a09e5640 1 --2- 172.21.15.86:0/200641579 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f319c1ef4c0 0x7f319c14c050 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f31840109b0 tx=0x7f3184010e70 comp rx=0 tx=0).stop 2024-04-25T12:22:12.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.146+0000 7f31a09e5640 1 -- 172.21.15.86:0/200641579 shutdown_connections 2024-04-25T12:22:12.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.146+0000 7f31a09e5640 1 --2- 172.21.15.86:0/200641579 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f319c0cbdd0 0x7f319c1428b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:12.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.146+0000 7f31a09e5640 1 --2- 172.21.15.86:0/200641579 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f317c068380 0x7f317c06a840 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:12.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.146+0000 7f31a09e5640 1 --2- 172.21.15.86:0/200641579 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f319c1ef4c0 0x7f319c14c050 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:12.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.146+0000 7f31a09e5640 1 --2- 172.21.15.86:0/200641579 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3188004d50 0x7f319c1f2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:12.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.146+0000 7f31a09e5640 1 -- 172.21.15.86:0/200641579 >> 172.21.15.86:0/200641579 conn(0x7f319c06b9d0 msgr2=0x7f319c14f330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:12.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.146+0000 7f31a09e5640 1 -- 172.21.15.86:0/200641579 shutdown_connections 2024-04-25T12:22:12.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.146+0000 7f31a09e5640 1 -- 172.21.15.86:0/200641579 wait complete. 2024-04-25T12:22:12.172 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T12:22:12.287 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.278+0000 7f9465430640 1 Processor -- start 2024-04-25T12:22:12.287 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.282+0000 7f9465430640 1 -- start start 2024-04-25T12:22:12.288 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.282+0000 7f9465430640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9460155300 0x7f94600c3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:12.289 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.282+0000 7f9465430640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f946006f700 0x7f946015e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:12.289 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.282+0000 7f9465430640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94600c4e80 con 0x7f946015ec50 2024-04-25T12:22:12.289 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.282+0000 7f9465430640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f94600c4230 con 0x7f9460155300 2024-04-25T12:22:12.289 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.282+0000 7f9465430640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f946015f0e0 con 0x7f946006f700 2024-04-25T12:22:12.289 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.282+0000 7f945effd640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9460155300 0x7f94600c3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:12.289 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.282+0000 7f945f7fe640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f946015ec50 0x7f94600c6f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:58526/0 (socket says 172.21.15.86:58526) 2024-04-25T12:22:12.289 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.282+0000 7f945f7fe640 1 -- 172.21.15.86:0/3816899993 learned_addr learned my addr 172.21.15.86:0/3816899993 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-04-25T12:22:12.289 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.282+0000 7f945e7fc640 1 --2- 172.21.15.86:0/3816899993 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f946006f700 0x7f946015e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:12.289 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.282+0000 7f945effd640 1 -- 172.21.15.86:0/3816899993 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f946006f700 msgr2=0x7f946015e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:12.289 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.282+0000 7f945effd640 1 --2- 172.21.15.86:0/3816899993 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f946006f700 0x7f946015e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:12.289 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.282+0000 7f945effd640 1 -- 172.21.15.86:0/3816899993 >> v1:172.21.15.86:6789/0 conn(0x7f946015ec50 legacy=0x7f94600c6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:12.289 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.282+0000 7f945dffb640 1 -- 172.21.15.86:0/3816899993 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4039451816 0 0) 0x7f94600c4e80 con 0x7f946015ec50 2024-04-25T12:22:12.289 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.282+0000 7f945effd640 1 -- 172.21.15.86:0/3816899993 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f946015f320 con 0x7f9460155300 2024-04-25T12:22:12.291 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.286+0000 7f945effd640 1 --2- 172.21.15.86:0/3816899993 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9460155300 0x7f94600c3cf0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f94500097c0 tx=0x7f945001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b21c0fddd85486 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:12.292 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.286+0000 7f945dffb640 1 -- 172.21.15.86:0/3816899993 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94500b0070 con 0x7f9460155300 2024-04-25T12:22:12.292 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.286+0000 7f945dffb640 1 -- 172.21.15.86:0/3816899993 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94500ab600 con 0x7f9460155300 2024-04-25T12:22:12.292 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.286+0000 7f945dffb640 1 -- 172.21.15.86:0/3816899993 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94500ab9d0 con 0x7f9460155300 2024-04-25T12:22:12.293 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.286+0000 7f9465430640 1 -- 172.21.15.86:0/3816899993 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9460155300 msgr2=0x7f94600c3cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:12.293 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.286+0000 7f9465430640 1 --2- 172.21.15.86:0/3816899993 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9460155300 0x7f94600c3cf0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f94500097c0 tx=0x7f945001c4a0 comp rx=0 tx=0).stop 2024-04-25T12:22:12.293 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.286+0000 7f9465430640 1 -- 172.21.15.86:0/3816899993 shutdown_connections 2024-04-25T12:22:12.293 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.286+0000 7f9465430640 1 --2- 172.21.15.86:0/3816899993 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f946006f700 0x7f946015e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:12.293 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.286+0000 7f9465430640 1 --2- 172.21.15.86:0/3816899993 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9460155300 0x7f94600c3cf0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:12.293 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.286+0000 7f9465430640 1 -- 172.21.15.86:0/3816899993 >> 172.21.15.86:0/3816899993 conn(0x7f946006b9d0 msgr2=0x7f946006bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:12.293 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.286+0000 7f9465430640 1 -- 172.21.15.86:0/3816899993 shutdown_connections 2024-04-25T12:22:12.293 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.286+0000 7f9465430640 1 -- 172.21.15.86:0/3816899993 wait complete. 2024-04-25T12:22:12.293 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.286+0000 7f9465430640 1 Processor -- start 2024-04-25T12:22:12.294 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.286+0000 7f9465430640 1 -- start start 2024-04-25T12:22:12.295 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.286+0000 7f9465430640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f946006f700 0x7f946014db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:12.296 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.286+0000 7f9465430640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9460155300 0x7f946014fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:12.296 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.286+0000 7f9465430640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f946015ec50 0x7f94601502b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:12.296 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.286+0000 7f9465430640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f94600681d0 con 0x7f946006f700 2024-04-25T12:22:12.296 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.286+0000 7f9465430640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f94600c5770 con 0x7f9460155300 2024-04-25T12:22:12.296 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.286+0000 7f9465430640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f9460068350 con 0x7f946015ec50 2024-04-25T12:22:12.296 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.286+0000 7f945effd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f946006f700 0x7f946014db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:12.296 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.286+0000 7f945effd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f946006f700 0x7f946014db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60370/0 (socket says 172.21.15.86:60370) 2024-04-25T12:22:12.296 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.286+0000 7f945effd640 1 -- 172.21.15.86:0/42450122 learned_addr learned my addr 172.21.15.86:0/42450122 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:12.296 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.286+0000 7f945f7fe640 1 --2- 172.21.15.86:0/42450122 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f946015ec50 0x7f94601502b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:12.296 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.286+0000 7f945effd640 1 -- 172.21.15.86:0/42450122 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f946015ec50 msgr2=0x7f94601502b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:12.296 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.286+0000 7f945e7fc640 1 --2- 172.21.15.86:0/42450122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9460155300 0x7f946014fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:12.296 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.286+0000 7f945effd640 1 --2- 172.21.15.86:0/42450122 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f946015ec50 0x7f94601502b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:12.296 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.286+0000 7f945effd640 1 -- 172.21.15.86:0/42450122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9460155300 msgr2=0x7f946014fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:12.297 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.286+0000 7f945effd640 1 --2- 172.21.15.86:0/42450122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9460155300 0x7f946014fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:12.297 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.286+0000 7f945effd640 1 -- 172.21.15.86:0/42450122 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94601f7b30 con 0x7f946006f700 2024-04-25T12:22:12.297 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.286+0000 7f945f7fe640 1 --2- 172.21.15.86:0/42450122 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f946015ec50 0x7f94601502b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:22:12.297 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.290+0000 7f945effd640 1 --2- 172.21.15.86:0/42450122 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f946006f700 0x7f946014db90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f94500ae040 tx=0x7f945001ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:12.297 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.290+0000 7f94477fe640 1 -- 172.21.15.86:0/42450122 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94500bc070 con 0x7f946006f700 2024-04-25T12:22:12.297 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.290+0000 7f94477fe640 1 -- 172.21.15.86:0/42450122 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94500b1040 con 0x7f946006f700 2024-04-25T12:22:12.297 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.290+0000 7f9465430640 1 -- 172.21.15.86:0/42450122 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94600744f0 con 0x7f946006f700 2024-04-25T12:22:12.297 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.290+0000 7f94477fe640 1 -- 172.21.15.86:0/42450122 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94500b0050 con 0x7f946006f700 2024-04-25T12:22:12.297 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.290+0000 7f9465430640 1 -- 172.21.15.86:0/42450122 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94601f7db0 con 0x7f946006f700 2024-04-25T12:22:12.298 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.290+0000 7f9465430640 1 -- 172.21.15.86:0/42450122 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9460075df0 con 0x7f946006f700 2024-04-25T12:22:12.298 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.290+0000 7f94477fe640 1 -- 172.21.15.86:0/42450122 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f94500bf070 con 0x7f946006f700 2024-04-25T12:22:12.298 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.290+0000 7f94477fe640 1 --2- 172.21.15.86:0/42450122 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f944c0683b0 0x7f944c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:12.298 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.290+0000 7f94477fe640 1 -- 172.21.15.86:0/42450122 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f94501208f0 con 0x7f946006f700 2024-04-25T12:22:12.298 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.290+0000 7f945e7fc640 1 --2- 172.21.15.86:0/42450122 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f944c0683b0 0x7f944c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:12.298 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.290+0000 7f945e7fc640 1 --2- 172.21.15.86:0/42450122 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f944c0683b0 0x7f944c06a870 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f94601508f0 tx=0x7f9454008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:12.301 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.294+0000 7f94477fe640 1 -- 172.21.15.86:0/42450122 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f94601f7b30 con 0x7f946006f700 2024-04-25T12:22:12.464 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.458+0000 7f9465430640 1 -- 172.21.15.86:0/42450122 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f94600cc2e0 con 0x7f946006f700 2024-04-25T12:22:12.466 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.458+0000 7f94477fe640 1 -- 172.21.15.86:0/42450122 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18905 (secure 0 0 0) 0x7f9450016090 con 0x7f946006f700 2024-04-25T12:22:12.466 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:22:12.466 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":26,"fsid":"f2ef5c0c-9576-4650-b4f7-6cb14247f62a","created":"2024-04-25T12:20:59.241733+0000","modified":"2024-04-25T12:22:04.877793+0000","last_up_change":"2024-04-25T12:21:10.939617+0000","last_in_change":"2024-04-25T12:21:01.534145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T12:21:11.839922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T12:21:21.854040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T12:21:22.406060+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T12:21:26.152386+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1f713f00-ef9f-4a6f-a620-38a8a1f8a822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6801","nonce":2812764579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6803","nonce":2812764579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6807","nonce":2812764579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6805","nonce":2812764579}]},"public_addr":"172.21.15.86:6801/2812764579","cluster_addr":"172.21.15.86:6803/2812764579","heartbeat_back_addr":"172.21.15.86:6807/2812764579","heartbeat_front_addr":"172.21.15.86:6805/2812764579","state":["exists","up"]},{"osd":1,"uuid":"baf6606d-a556-4fbe-a930-855e04ff1534","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6809","nonce":467966038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6811","nonce":467966038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6815","nonce":467966038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6813","nonce":467966038}]},"public_addr":"172.21.15.86:6809/467966038","cluster_addr":"172.21.15.86:6811/467966038","heartbeat_back_addr":"172.21.15.86:6815/467966038","heartbeat_front_addr":"172.21.15.86:6813/467966038","state":["exists","up"]},{"osd":2,"uuid":"c983d68e-6d60-434f-aed6-108420c5dd09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6817","nonce":3279762843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6820","nonce":3279762843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6825","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6827","nonce":3279762843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6824","nonce":3279762843}]},"public_addr":"172.21.15.86:6817/3279762843","cluster_addr":"172.21.15.86:6820/3279762843","heartbeat_back_addr":"172.21.15.86:6827/3279762843","heartbeat_front_addr":"172.21.15.86:6824/3279762843","state":["exists","up"]},{"osd":3,"uuid":"e77657bb-45aa-43bf-ab41-c7377eb495ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6821","nonce":2861354413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6826","nonce":2861354413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6831","nonce":2861354413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6829","nonce":2861354413}]},"public_addr":"172.21.15.86:6821/2861354413","cluster_addr":"172.21.15.86:6826/2861354413","heartbeat_back_addr":"172.21.15.86:6831/2861354413","heartbeat_front_addr":"172.21.15.86:6829/2861354413","state":["exists","up"]},{"osd":4,"uuid":"252bd300-d75a-4b00-be4b-27e6b51de4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6802","nonce":1872913602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6805","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6808","nonce":1872913602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6815","nonce":1872913602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6813","nonce":1872913602}]},"public_addr":"172.21.15.134:6802/1872913602","cluster_addr":"172.21.15.134:6808/1872913602","heartbeat_back_addr":"172.21.15.134:6815/1872913602","heartbeat_front_addr":"172.21.15.134:6813/1872913602","state":["exists","up"]},{"osd":5,"uuid":"4135da3f-7427-4409-a48e-78bd8a7b46ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6801","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6803","nonce":2261413981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6806","nonce":2261413981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6812","nonce":2261413981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6809","nonce":2261413981}]},"public_addr":"172.21.15.134:6803/2261413981","cluster_addr":"172.21.15.134:6806/2261413981","heartbeat_back_addr":"172.21.15.134:6812/2261413981","heartbeat_front_addr":"172.21.15.134:6809/2261413981","state":["exists","up"]},{"osd":6,"uuid":"b6e7a5f1-fa7e-497d-abac-a19994d26820","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6825","nonce":2841082767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6827","nonce":2841082767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6831","nonce":2841082767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6829","nonce":2841082767}]},"public_addr":"172.21.15.134:6825/2841082767","cluster_addr":"172.21.15.134:6827/2841082767","heartbeat_back_addr":"172.21.15.134:6831/2841082767","heartbeat_front_addr":"172.21.15.134:6829/2841082767","state":["exists","up"]},{"osd":7,"uuid":"c5597e50-1962-4103-9124-dd7bceb8ac97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6817","nonce":1277404274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6819","nonce":1277404274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6823","nonce":1277404274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6821","nonce":1277404274}]},"public_addr":"172.21.15.134:6817/1277404274","cluster_addr":"172.21.15.134:6819/1277404274","heartbeat_back_addr":"172.21.15.134:6823/1277404274","heartbeat_front_addr":"172.21.15.134:6821/1277404274","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.018125+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.157958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.113619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.136904+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.844514+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.872629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.775339+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.822867+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":7,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.33","mappings":[{"from":3,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T12:22:12.468 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.462+0000 7f9465430640 1 -- 172.21.15.86:0/42450122 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f944c0683b0 msgr2=0x7f944c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:12.468 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.462+0000 7f9465430640 1 --2- 172.21.15.86:0/42450122 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f944c0683b0 0x7f944c06a870 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f94601508f0 tx=0x7f9454008040 comp rx=0 tx=0).stop 2024-04-25T12:22:12.468 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.462+0000 7f9465430640 1 -- 172.21.15.86:0/42450122 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f946006f700 msgr2=0x7f946014db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:12.468 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.462+0000 7f9465430640 1 --2- 172.21.15.86:0/42450122 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f946006f700 0x7f946014db90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f94500ae040 tx=0x7f945001ace0 comp rx=0 tx=0).stop 2024-04-25T12:22:12.468 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.462+0000 7f9465430640 1 -- 172.21.15.86:0/42450122 shutdown_connections 2024-04-25T12:22:12.468 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.462+0000 7f9465430640 1 --2- 172.21.15.86:0/42450122 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f946015ec50 0x7f94601502b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:12.468 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.462+0000 7f9465430640 1 --2- 172.21.15.86:0/42450122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9460155300 0x7f946014fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:12.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.462+0000 7f9465430640 1 --2- 172.21.15.86:0/42450122 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f944c0683b0 0x7f944c06a870 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:12.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.462+0000 7f9465430640 1 --2- 172.21.15.86:0/42450122 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f946006f700 0x7f946014db90 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:12.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.462+0000 7f9465430640 1 -- 172.21.15.86:0/42450122 >> 172.21.15.86:0/42450122 conn(0x7f946006b9d0 msgr2=0x7f946015e500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:12.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.462+0000 7f9465430640 1 -- 172.21.15.86:0/42450122 shutdown_connections 2024-04-25T12:22:12.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.462+0000 7f9465430640 1 -- 172.21.15.86:0/42450122 wait complete. 2024-04-25T12:22:12.485 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T12:21:11.839922+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T12:21:21.854040+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T12:21:22.406060+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T12:21:26.152386+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T12:22:12.485 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T12:22:12.607 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.602+0000 7fed72b4a640 1 Processor -- start 2024-04-25T12:22:12.607 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.602+0000 7fed72b4a640 1 -- start start 2024-04-25T12:22:12.610 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.602+0000 7fed72b4a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fed6c14ffa0 0x7fed6c06f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:12.610 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.602+0000 7fed72b4a640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed6c0c5d70 con 0x7fed6c14fbc0 2024-04-25T12:22:12.610 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.602+0000 7fed72b4a640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed6c0c6050 con 0x7fed6c074100 2024-04-25T12:22:12.610 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.602+0000 7fed72b4a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fed6c0c6330 con 0x7fed6c14ffa0 2024-04-25T12:22:12.610 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.602+0000 7fed708e6640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fed6c14fbc0 0x7fed6c0c8220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:43274/0 (socket says 172.21.15.86:43274) 2024-04-25T12:22:12.610 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.602+0000 7fed708e6640 1 -- 172.21.15.86:0/1819152631 learned_addr learned my addr 172.21.15.86:0/1819152631 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-04-25T12:22:12.610 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.602+0000 7fed6bfff640 1 --2- 172.21.15.86:0/1819152631 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fed6c14ffa0 0x7fed6c06f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:12.611 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.602+0000 7fed6b7fe640 1 -- 172.21.15.86:0/1819152631 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 137044895 0 0) 0x7fed6c0c5d70 con 0x7fed6c14fbc0 2024-04-25T12:22:12.611 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.602+0000 7fed6b7fe640 1 -- 172.21.15.86:0/1819152631 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fed54003530 con 0x7fed6c14fbc0 2024-04-25T12:22:12.611 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.602+0000 7fed6b7fe640 1 -- 172.21.15.86:0/1819152631 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1915975119 0 0) 0x7fed54003530 con 0x7fed6c14fbc0 2024-04-25T12:22:12.611 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.602+0000 7fed6b7fe640 1 -- 172.21.15.86:0/1819152631 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fed6c14ffa0 msgr2=0x7fed6c06f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:12.611 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.602+0000 7fed6b7fe640 1 --2- 172.21.15.86:0/1819152631 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fed6c14ffa0 0x7fed6c06f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:12.611 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.602+0000 7fed6b7fe640 1 -- 172.21.15.86:0/1819152631 >> v1:172.21.15.134:6789/0 conn(0x7fed6c074100 legacy=0x7fed6c0c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:12.611 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.602+0000 7fed6b7fe640 1 -- 172.21.15.86:0/1819152631 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed6c0c6610 con 0x7fed6c14fbc0 2024-04-25T12:22:12.611 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.602+0000 7fed6b7fe640 1 -- 172.21.15.86:0/1819152631 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1387950573 0 0) 0x7fed5c001a00 con 0x7fed6c14fbc0 2024-04-25T12:22:12.611 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.602+0000 7fed6b7fe640 1 -- 172.21.15.86:0/1819152631 >> v1:172.21.15.86:6789/0 conn(0x7fed6c14fbc0 legacy=0x7fed6c0c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:12.611 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.602+0000 7fed6b7fe640 1 --2- 172.21.15.86:0/1819152631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed540039f0 0x7fed54003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:12.611 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.602+0000 7fed6b7fe640 1 --2- 172.21.15.86:0/1819152631 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed54004810 0x7fed54004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:12.611 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.602+0000 7fed6b7fe640 1 --2- 172.21.15.86:0/1819152631 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fed6c14ffa0 0x7fed540051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:12.612 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.602+0000 7fed6b7fe640 1 -- 172.21.15.86:0/1819152631 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fed6c0c6330 con 0x7fed54004810 2024-04-25T12:22:12.612 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.602+0000 7fed6b7fe640 1 -- 172.21.15.86:0/1819152631 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fed5400ba80 con 0x7fed540039f0 2024-04-25T12:22:12.612 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.602+0000 7fed6b7fe640 1 -- 172.21.15.86:0/1819152631 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fed5400bc80 con 0x7fed6c14ffa0 2024-04-25T12:22:12.612 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.602+0000 7fed6bfff640 1 --2- 172.21.15.86:0/1819152631 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed54004810 0x7fed54004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:12.612 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.602+0000 7fed708e6640 1 --2- 172.21.15.86:0/1819152631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed540039f0 0x7fed54003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:12.612 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.602+0000 7fed710e7640 1 --2- 172.21.15.86:0/1819152631 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fed6c14ffa0 0x7fed540051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:12.612 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.602+0000 7fed6bfff640 1 -- 172.21.15.86:0/1819152631 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fed6c14ffa0 msgr2=0x7fed540051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:12.612 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.602+0000 7fed6bfff640 1 --2- 172.21.15.86:0/1819152631 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fed6c14ffa0 0x7fed540051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:12.612 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.602+0000 7fed6bfff640 1 -- 172.21.15.86:0/1819152631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed540039f0 msgr2=0x7fed54003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:12.612 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.602+0000 7fed6bfff640 1 --2- 172.21.15.86:0/1819152631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed540039f0 0x7fed54003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:12.612 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.602+0000 7fed6bfff640 1 -- 172.21.15.86:0/1819152631 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed54003530 con 0x7fed54004810 2024-04-25T12:22:12.613 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.606+0000 7fed6bfff640 1 --2- 172.21.15.86:0/1819152631 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed54004810 0x7fed54004c90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fed60009ab0 tx=0x7fed6001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73f8f8176ced7c7f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:12.614 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.606+0000 7fed6b7fe640 1 -- 172.21.15.86:0/1819152631 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed600b2070 con 0x7fed54004810 2024-04-25T12:22:12.614 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.606+0000 7fed6b7fe640 1 -- 172.21.15.86:0/1819152631 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed600a5620 con 0x7fed54004810 2024-04-25T12:22:12.614 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.606+0000 7fed6b7fe640 1 -- 172.21.15.86:0/1819152631 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed600096b0 con 0x7fed54004810 2024-04-25T12:22:12.614 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.606+0000 7fed72b4a640 1 -- 172.21.15.86:0/1819152631 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed54004810 msgr2=0x7fed54004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:12.614 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.606+0000 7fed72b4a640 1 --2- 172.21.15.86:0/1819152631 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed54004810 0x7fed54004c90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fed60009ab0 tx=0x7fed6001ca30 comp rx=0 tx=0).stop 2024-04-25T12:22:12.614 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.606+0000 7fed710e7640 1 -- 172.21.15.86:0/1819152631 reap_dead start 2024-04-25T12:22:12.614 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.606+0000 7fed72b4a640 1 -- 172.21.15.86:0/1819152631 shutdown_connections 2024-04-25T12:22:12.614 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.606+0000 7fed72b4a640 1 -- 172.21.15.86:0/1819152631 >> 172.21.15.86:0/1819152631 conn(0x7fed6c06b9d0 msgr2=0x7fed6c06bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:12.614 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.606+0000 7fed72b4a640 1 -- 172.21.15.86:0/1819152631 shutdown_connections 2024-04-25T12:22:12.614 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.606+0000 7fed72b4a640 1 -- 172.21.15.86:0/1819152631 wait complete. 2024-04-25T12:22:12.614 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.606+0000 7fed72b4a640 1 Processor -- start 2024-04-25T12:22:12.615 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.606+0000 7fed72b4a640 1 -- start start 2024-04-25T12:22:12.617 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.606+0000 7fed72b4a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed54004810 0x7fed6c141a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:12.617 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.606+0000 7fed72b4a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed6c142e50 0x7fed6c0738c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:12.617 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.606+0000 7fed72b4a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fed6c143470 0x7fed6c1eeae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:12.617 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.606+0000 7fed72b4a640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fed6c068350 con 0x7fed54004810 2024-04-25T12:22:12.617 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.606+0000 7fed72b4a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fed6c0681d0 con 0x7fed6c142e50 2024-04-25T12:22:12.617 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.606+0000 7fed72b4a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fed6c0c8930 con 0x7fed6c143470 2024-04-25T12:22:12.617 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.606+0000 7fed708e6640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed54004810 0x7fed6c141a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:12.617 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.606+0000 7fed708e6640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed54004810 0x7fed6c141a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38520/0 (socket says 172.21.15.86:38520) 2024-04-25T12:22:12.617 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.606+0000 7fed708e6640 1 -- 172.21.15.86:0/3295566125 learned_addr learned my addr 172.21.15.86:0/3295566125 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:12.617 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.606+0000 7fed710e7640 1 --2- 172.21.15.86:0/3295566125 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fed6c143470 0x7fed6c1eeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:12.617 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.606+0000 7fed6bfff640 1 --2- 172.21.15.86:0/3295566125 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed6c142e50 0x7fed6c0738c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:12.617 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.610+0000 7fed708e6640 1 -- 172.21.15.86:0/3295566125 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fed6c143470 msgr2=0x7fed6c1eeae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:12.618 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.610+0000 7fed708e6640 1 --2- 172.21.15.86:0/3295566125 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fed6c143470 0x7fed6c1eeae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:12.618 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.610+0000 7fed708e6640 1 -- 172.21.15.86:0/3295566125 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed6c142e50 msgr2=0x7fed6c0738c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:12.618 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.610+0000 7fed708e6640 1 --2- 172.21.15.86:0/3295566125 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed6c142e50 0x7fed6c0738c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:12.618 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.610+0000 7fed708e6640 1 -- 172.21.15.86:0/3295566125 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed6c15cf00 con 0x7fed54004810 2024-04-25T12:22:12.618 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.610+0000 7fed710e7640 1 --2- 172.21.15.86:0/3295566125 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fed6c143470 0x7fed6c1eeae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:22:12.618 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.610+0000 7fed708e6640 1 --2- 172.21.15.86:0/3295566125 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed54004810 0x7fed6c141a90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fed5c0079d0 tx=0x7fed5c0115c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:12.618 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.610+0000 7fed697fa640 1 -- 172.21.15.86:0/3295566125 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed5c01c070 con 0x7fed54004810 2024-04-25T12:22:12.618 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.610+0000 7fed697fa640 1 -- 172.21.15.86:0/3295566125 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed5c004d90 con 0x7fed54004810 2024-04-25T12:22:12.618 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.610+0000 7fed697fa640 1 -- 172.21.15.86:0/3295566125 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed5c010040 con 0x7fed54004810 2024-04-25T12:22:12.618 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.610+0000 7fed72b4a640 1 -- 172.21.15.86:0/3295566125 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed6c15d1e0 con 0x7fed54004810 2024-04-25T12:22:12.618 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.610+0000 7fed72b4a640 1 -- 172.21.15.86:0/3295566125 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed6c1f2540 con 0x7fed54004810 2024-04-25T12:22:12.618 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.610+0000 7fed72b4a640 1 -- 172.21.15.86:0/3295566125 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed6c075df0 con 0x7fed54004810 2024-04-25T12:22:12.618 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.610+0000 7fed697fa640 1 -- 172.21.15.86:0/3295566125 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fed5c01f070 con 0x7fed54004810 2024-04-25T12:22:12.619 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.610+0000 7fed697fa640 1 --2- 172.21.15.86:0/3295566125 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fed580683b0 0x7fed5806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:12.619 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.610+0000 7fed697fa640 1 -- 172.21.15.86:0/3295566125 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fed5c089fc0 con 0x7fed54004810 2024-04-25T12:22:12.619 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.610+0000 7fed6bfff640 1 --2- 172.21.15.86:0/3295566125 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fed580683b0 0x7fed5806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:12.619 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.610+0000 7fed6bfff640 1 --2- 172.21.15.86:0/3295566125 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fed580683b0 0x7fed5806a870 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fed600af000 tx=0x7fed600046d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:12.622 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.614+0000 7fed697fa640 1 -- 172.21.15.86:0/3295566125 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fed5c05a180 con 0x7fed54004810 2024-04-25T12:22:12.774 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.766+0000 7fed72b4a640 1 -- 172.21.15.86:0/3295566125 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fed6c072610 con 0x7fed54004810 2024-04-25T12:22:12.774 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.766+0000 7fed697fa640 1 -- 172.21.15.86:0/3295566125 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7fed5c059a80 con 0x7fed54004810 2024-04-25T12:22:12.775 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 1 2024-04-25T12:22:12.776 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.770+0000 7fed72b4a640 1 -- 172.21.15.86:0/3295566125 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fed580683b0 msgr2=0x7fed5806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:12.776 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.770+0000 7fed72b4a640 1 --2- 172.21.15.86:0/3295566125 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fed580683b0 0x7fed5806a870 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fed600af000 tx=0x7fed600046d0 comp rx=0 tx=0).stop 2024-04-25T12:22:12.776 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.770+0000 7fed72b4a640 1 -- 172.21.15.86:0/3295566125 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed54004810 msgr2=0x7fed6c141a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:12.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.770+0000 7fed72b4a640 1 --2- 172.21.15.86:0/3295566125 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed54004810 0x7fed6c141a90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fed5c0079d0 tx=0x7fed5c0115c0 comp rx=0 tx=0).stop 2024-04-25T12:22:12.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.770+0000 7fed72b4a640 1 -- 172.21.15.86:0/3295566125 shutdown_connections 2024-04-25T12:22:12.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.770+0000 7fed72b4a640 1 --2- 172.21.15.86:0/3295566125 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fed6c143470 0x7fed6c1eeae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:12.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.770+0000 7fed72b4a640 1 --2- 172.21.15.86:0/3295566125 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed6c142e50 0x7fed6c0738c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:12.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.770+0000 7fed72b4a640 1 --2- 172.21.15.86:0/3295566125 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fed580683b0 0x7fed5806a870 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:12.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.770+0000 7fed72b4a640 1 --2- 172.21.15.86:0/3295566125 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed54004810 0x7fed6c141a90 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:12.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.770+0000 7fed72b4a640 1 -- 172.21.15.86:0/3295566125 >> 172.21.15.86:0/3295566125 conn(0x7fed6c06b9d0 msgr2=0x7fed6c06f620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:12.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.770+0000 7fed72b4a640 1 -- 172.21.15.86:0/3295566125 shutdown_connections 2024-04-25T12:22:12.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.770+0000 7fed72b4a640 1 -- 172.21.15.86:0/3295566125 wait complete. 2024-04-25T12:22:12.792 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T12:22:12.902 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.894+0000 7f5adc879640 1 Processor -- start 2024-04-25T12:22:12.903 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.894+0000 7f5adc879640 1 -- start start 2024-04-25T12:22:12.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.898+0000 7f5adc879640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5ad80c8250 0x7f5ad80c39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:12.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.898+0000 7f5adc879640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5ad80c8a70 0x7f5ad8152250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:12.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.898+0000 7f5adc879640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ad815b740 con 0x7f5ad80c8630 2024-04-25T12:22:12.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.898+0000 7f5adc879640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f5ad80c6490 con 0x7f5ad80c8a70 2024-04-25T12:22:12.905 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.898+0000 7f5adc879640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f5ad80c58c0 con 0x7f5ad80c8250 2024-04-25T12:22:12.905 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.898+0000 7f5ad6d9d640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5ad80c8a70 0x7f5ad8152250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:12.905 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.898+0000 7f5acdd9b640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f5ad80c8630 0x7f5ad8151b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:43286/0 (socket says 172.21.15.86:43286) 2024-04-25T12:22:12.905 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.898+0000 7f5ad6d9d640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5ad80c8a70 0x7f5ad8152250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38528/0 (socket says 172.21.15.86:38528) 2024-04-25T12:22:12.905 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.898+0000 7f5acdd9b640 1 -- 172.21.15.86:0/988872515 learned_addr learned my addr 172.21.15.86:0/988872515 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-04-25T12:22:12.905 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.898+0000 7f5ad659c640 1 --2- 172.21.15.86:0/988872515 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5ad80c8250 0x7f5ad80c39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:12.905 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.898+0000 7f5ad6d9d640 1 -- 172.21.15.86:0/988872515 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5ad80c8250 msgr2=0x7f5ad80c39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:12.905 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.898+0000 7f5ad6d9d640 1 --2- 172.21.15.86:0/988872515 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5ad80c8250 0x7f5ad80c39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:12.905 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.898+0000 7f5ad6d9d640 1 -- 172.21.15.86:0/988872515 >> v1:172.21.15.86:6789/0 conn(0x7f5ad80c8630 legacy=0x7f5ad8151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:12.905 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.898+0000 7f5ad5d9b640 1 -- 172.21.15.86:0/988872515 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2046598228 0 0) 0x7f5ad815b740 con 0x7f5ad80c8630 2024-04-25T12:22:12.905 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.898+0000 7f5ad6d9d640 1 -- 172.21.15.86:0/988872515 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ad80c5b60 con 0x7f5ad80c8a70 2024-04-25T12:22:12.905 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.898+0000 7f5ad659c640 1 --2- 172.21.15.86:0/988872515 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5ad80c8250 0x7f5ad80c39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:22:12.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.898+0000 7f5ad6d9d640 1 --2- 172.21.15.86:0/988872515 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ad80c8a70 0x7f5ad8152250 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5ad000bfd0 tx=0x7f5ad001eac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=251e4fc93d9aa85 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:12.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.898+0000 7f5ad5d9b640 1 -- 172.21.15.86:0/988872515 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad000b2d0 con 0x7f5ad80c8a70 2024-04-25T12:22:12.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.898+0000 7f5ad5d9b640 1 -- 172.21.15.86:0/988872515 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ad00a7780 con 0x7f5ad80c8a70 2024-04-25T12:22:12.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.898+0000 7f5ad5d9b640 1 -- 172.21.15.86:0/988872515 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad00a7b50 con 0x7f5ad80c8a70 2024-04-25T12:22:12.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.898+0000 7f5adc879640 1 -- 172.21.15.86:0/988872515 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ad80c8a70 msgr2=0x7f5ad8152250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:12.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.898+0000 7f5adc879640 1 --2- 172.21.15.86:0/988872515 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ad80c8a70 0x7f5ad8152250 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5ad000bfd0 tx=0x7f5ad001eac0 comp rx=0 tx=0).stop 2024-04-25T12:22:12.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.898+0000 7f5adc879640 1 -- 172.21.15.86:0/988872515 shutdown_connections 2024-04-25T12:22:12.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.898+0000 7f5adc879640 1 --2- 172.21.15.86:0/988872515 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ad80c8a70 0x7f5ad8152250 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:12.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.898+0000 7f5adc879640 1 --2- 172.21.15.86:0/988872515 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5ad80c8250 0x7f5ad80c39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:12.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.898+0000 7f5adc879640 1 -- 172.21.15.86:0/988872515 >> 172.21.15.86:0/988872515 conn(0x7f5ad806b9d0 msgr2=0x7f5ad806bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:12.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.898+0000 7f5adc879640 1 -- 172.21.15.86:0/988872515 shutdown_connections 2024-04-25T12:22:12.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.898+0000 7f5adc879640 1 -- 172.21.15.86:0/988872515 wait complete. 2024-04-25T12:22:12.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.902+0000 7f5adc879640 1 Processor -- start 2024-04-25T12:22:12.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.902+0000 7f5adc879640 1 -- start start 2024-04-25T12:22:12.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.902+0000 7f5adc879640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ad80c8250 0x7f5ad81544b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:12.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.902+0000 7f5adc879640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5ad80c8630 0x7f5ad8143b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:12.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.902+0000 7f5adc879640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ad80c8a70 0x7f5ad81440c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:12.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.902+0000 7f5adc879640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad80c6900 con 0x7f5ad80c8a70 2024-04-25T12:22:12.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.902+0000 7f5adc879640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad815b400 con 0x7f5ad80c8250 2024-04-25T12:22:12.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.902+0000 7f5adc879640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f5ad80681d0 con 0x7f5ad80c8630 2024-04-25T12:22:12.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.902+0000 7f5ad6d9d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ad80c8a70 0x7f5ad81440c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:12.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.902+0000 7f5ad6d9d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ad80c8a70 0x7f5ad81440c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38534/0 (socket says 172.21.15.86:38534) 2024-04-25T12:22:12.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.902+0000 7f5ad6d9d640 1 -- 172.21.15.86:0/3710665596 learned_addr learned my addr 172.21.15.86:0/3710665596 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:12.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.902+0000 7f5ad6d9d640 1 -- 172.21.15.86:0/3710665596 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5ad80c8630 msgr2=0x7f5ad8143b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:12.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.902+0000 7f5acdd9b640 1 --2- 172.21.15.86:0/3710665596 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5ad80c8630 0x7f5ad8143b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:12.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.902+0000 7f5ad659c640 1 --2- 172.21.15.86:0/3710665596 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ad80c8250 0x7f5ad81544b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:12.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.902+0000 7f5ad6d9d640 1 --2- 172.21.15.86:0/3710665596 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5ad80c8630 0x7f5ad8143b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:12.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.902+0000 7f5ad6d9d640 1 -- 172.21.15.86:0/3710665596 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ad80c8250 msgr2=0x7f5ad81544b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:12.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.902+0000 7f5ad6d9d640 1 --2- 172.21.15.86:0/3710665596 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ad80c8250 0x7f5ad81544b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:12.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.902+0000 7f5ad6d9d640 1 -- 172.21.15.86:0/3710665596 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ad81556f0 con 0x7f5ad80c8a70 2024-04-25T12:22:12.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.902+0000 7f5ad6d9d640 1 --2- 172.21.15.86:0/3710665596 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ad80c8a70 0x7f5ad81440c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5ad001c6f0 tx=0x7f5ad001b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:12.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.902+0000 7f5acf7fe640 1 -- 172.21.15.86:0/3710665596 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad00bc020 con 0x7f5ad80c8a70 2024-04-25T12:22:12.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.902+0000 7f5acf7fe640 1 -- 172.21.15.86:0/3710665596 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ad0009740 con 0x7f5ad80c8a70 2024-04-25T12:22:12.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.902+0000 7f5adc879640 1 -- 172.21.15.86:0/3710665596 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ad8153b50 con 0x7f5ad80c8a70 2024-04-25T12:22:12.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.902+0000 7f5acf7fe640 1 -- 172.21.15.86:0/3710665596 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad0009af0 con 0x7f5ad80c8a70 2024-04-25T12:22:12.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.902+0000 7f5adc879640 1 -- 172.21.15.86:0/3710665596 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ad8152a60 con 0x7f5ad80c8a70 2024-04-25T12:22:12.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.902+0000 7f5adc879640 1 -- 172.21.15.86:0/3710665596 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ad8075df0 con 0x7f5ad80c8a70 2024-04-25T12:22:12.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.902+0000 7f5acf7fe640 1 -- 172.21.15.86:0/3710665596 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5ad00bf020 con 0x7f5ad80c8a70 2024-04-25T12:22:12.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.906+0000 7f5acf7fe640 1 --2- 172.21.15.86:0/3710665596 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f5ab8068380 0x7f5ab806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:12.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.906+0000 7f5acf7fe640 1 -- 172.21.15.86:0/3710665596 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f5ad01239e0 con 0x7f5ad80c8a70 2024-04-25T12:22:12.913 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.906+0000 7f5ad659c640 1 --2- 172.21.15.86:0/3710665596 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f5ab8068380 0x7f5ab806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:12.913 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.906+0000 7f5ad659c640 1 --2- 172.21.15.86:0/3710665596 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f5ab8068380 0x7f5ab806a840 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5ac800d8b0 tx=0x7f5ac8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:12.915 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:12.910+0000 7f5acf7fe640 1 -- 172.21.15.86:0/3710665596 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5ad00c6030 con 0x7f5ad80c8a70 2024-04-25T12:22:13.066 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.058+0000 7f5adc879640 1 -- 172.21.15.86:0/3710665596 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f5ad8071e50 con 0x7f5ad80c8a70 2024-04-25T12:22:13.067 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.058+0000 7f5acf7fe640 1 -- 172.21.15.86:0/3710665596 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f5ad0018740 con 0x7f5ad80c8a70 2024-04-25T12:22:13.067 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 32 2024-04-25T12:22:13.069 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.062+0000 7f5adc879640 1 -- 172.21.15.86:0/3710665596 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f5ab8068380 msgr2=0x7f5ab806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:13.069 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.062+0000 7f5adc879640 1 --2- 172.21.15.86:0/3710665596 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f5ab8068380 0x7f5ab806a840 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5ac800d8b0 tx=0x7f5ac8008040 comp rx=0 tx=0).stop 2024-04-25T12:22:13.069 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.062+0000 7f5adc879640 1 -- 172.21.15.86:0/3710665596 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ad80c8a70 msgr2=0x7f5ad81440c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:13.070 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.062+0000 7f5adc879640 1 --2- 172.21.15.86:0/3710665596 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ad80c8a70 0x7f5ad81440c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5ad001c6f0 tx=0x7f5ad001b860 comp rx=0 tx=0).stop 2024-04-25T12:22:13.070 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.062+0000 7f5adc879640 1 -- 172.21.15.86:0/3710665596 shutdown_connections 2024-04-25T12:22:13.070 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.062+0000 7f5adc879640 1 --2- 172.21.15.86:0/3710665596 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f5ab8068380 0x7f5ab806a840 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:13.070 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.062+0000 7f5adc879640 1 --2- 172.21.15.86:0/3710665596 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ad80c8a70 0x7f5ad81440c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:13.070 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.062+0000 7f5adc879640 1 --2- 172.21.15.86:0/3710665596 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5ad80c8630 0x7f5ad8143b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:13.070 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.062+0000 7f5adc879640 1 --2- 172.21.15.86:0/3710665596 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ad80c8250 0x7f5ad81544b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:13.070 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.062+0000 7f5adc879640 1 -- 172.21.15.86:0/3710665596 >> 172.21.15.86:0/3710665596 conn(0x7f5ad806b9d0 msgr2=0x7f5ad8072650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:13.070 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.062+0000 7f5adc879640 1 -- 172.21.15.86:0/3710665596 shutdown_connections 2024-04-25T12:22:13.070 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.062+0000 7f5adc879640 1 -- 172.21.15.86:0/3710665596 wait complete. 2024-04-25T12:22:13.084 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T12:22:13.207 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.198+0000 7fda566f5640 1 Processor -- start 2024-04-25T12:22:13.207 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.198+0000 7fda566f5640 1 -- start start 2024-04-25T12:22:13.209 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.202+0000 7fda566f5640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fda500c8250 0x7fda500c39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:13.209 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.202+0000 7fda566f5640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fda500c8630 0x7fda50151b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:13.209 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.202+0000 7fda566f5640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fda500c8a70 0x7fda50152080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:13.209 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.202+0000 7fda566f5640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7fda500c6490 con 0x7fda500c8630 2024-04-25T12:22:13.209 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.202+0000 7fda566f5640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fda5015b740 con 0x7fda500c8250 2024-04-25T12:22:13.209 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.202+0000 7fda566f5640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fda501525c0 con 0x7fda500c8a70 2024-04-25T12:22:13.209 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.202+0000 7fda4f7fe640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fda500c8630 0x7fda50151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:13.209 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.202+0000 7fda4f7fe640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fda500c8630 0x7fda50151b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38550/0 (socket says 172.21.15.86:38550) 2024-04-25T12:22:13.209 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.202+0000 7fda4f7fe640 1 -- 172.21.15.86:0/1168753627 learned_addr learned my addr 172.21.15.86:0/1168753627 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:13.209 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.202+0000 7fda54c92640 1 --2- 172.21.15.86:0/1168753627 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fda500c8a70 0x7fda50152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:13.209 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.202+0000 7fda4ffff640 1 --2- 172.21.15.86:0/1168753627 >> v2:172.21.15.134:3300/0 conn(0x7fda500c8250 0x7fda500c39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:13.209 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.202+0000 7fda4f7fe640 1 -- 172.21.15.86:0/1168753627 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fda500c8a70 msgr2=0x7fda50152080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:13.210 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.202+0000 7fda4f7fe640 1 --2- 172.21.15.86:0/1168753627 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fda500c8a70 0x7fda50152080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:13.210 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.202+0000 7fda4f7fe640 1 -- 172.21.15.86:0/1168753627 >> v2:172.21.15.134:3300/0 conn(0x7fda500c8250 msgr2=0x7fda500c39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:13.210 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.202+0000 7fda4f7fe640 1 --2- 172.21.15.86:0/1168753627 >> v2:172.21.15.134:3300/0 conn(0x7fda500c8250 0x7fda500c39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:13.210 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.202+0000 7fda4f7fe640 1 -- 172.21.15.86:0/1168753627 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda500c58c0 con 0x7fda500c8630 2024-04-25T12:22:13.211 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.202+0000 7fda4f7fe640 1 --2- 172.21.15.86:0/1168753627 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda500c8630 0x7fda50151b40 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fda50152770 tx=0x7fda3801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6be96e79a53822e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:13.211 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.202+0000 7fda4effd640 1 -- 172.21.15.86:0/1168753627 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda380b0070 con 0x7fda500c8630 2024-04-25T12:22:13.211 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.202+0000 7fda4effd640 1 -- 172.21.15.86:0/1168753627 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda380ab600 con 0x7fda500c8630 2024-04-25T12:22:13.211 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.202+0000 7fda4effd640 1 -- 172.21.15.86:0/1168753627 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda380ab9d0 con 0x7fda500c8630 2024-04-25T12:22:13.212 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.206+0000 7fda566f5640 1 -- 172.21.15.86:0/1168753627 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda500c8630 msgr2=0x7fda50151b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:13.212 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.206+0000 7fda566f5640 1 --2- 172.21.15.86:0/1168753627 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda500c8630 0x7fda50151b40 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fda50152770 tx=0x7fda3801c490 comp rx=0 tx=0).stop 2024-04-25T12:22:13.212 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.206+0000 7fda566f5640 1 -- 172.21.15.86:0/1168753627 shutdown_connections 2024-04-25T12:22:13.212 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.206+0000 7fda566f5640 1 --2- 172.21.15.86:0/1168753627 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fda500c8a70 0x7fda50152080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:13.212 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.206+0000 7fda566f5640 1 --2- 172.21.15.86:0/1168753627 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda500c8630 0x7fda50151b40 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:13.212 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.206+0000 7fda566f5640 1 --2- 172.21.15.86:0/1168753627 >> v2:172.21.15.134:3300/0 conn(0x7fda500c8250 0x7fda500c39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:13.212 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.206+0000 7fda566f5640 1 -- 172.21.15.86:0/1168753627 >> 172.21.15.86:0/1168753627 conn(0x7fda5006b9d0 msgr2=0x7fda5006bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:13.212 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.206+0000 7fda566f5640 1 -- 172.21.15.86:0/1168753627 shutdown_connections 2024-04-25T12:22:13.212 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.206+0000 7fda566f5640 1 -- 172.21.15.86:0/1168753627 wait complete. 2024-04-25T12:22:13.215 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.206+0000 7fda566f5640 1 Processor -- start 2024-04-25T12:22:13.215 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.206+0000 7fda566f5640 1 -- start start 2024-04-25T12:22:13.215 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.206+0000 7fda566f5640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fda500c8250 0x7fda50073d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:13.215 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.206+0000 7fda566f5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda500c8630 0x7fda50159d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:13.215 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.206+0000 7fda566f5640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda500c8a70 0x7fda50072650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:13.215 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.206+0000 7fda566f5640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fda5015b400 con 0x7fda500c8a70 2024-04-25T12:22:13.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.206+0000 7fda566f5640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fda500721a0 con 0x7fda500c8630 2024-04-25T12:22:13.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.206+0000 7fda566f5640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fda500c6900 con 0x7fda500c8250 2024-04-25T12:22:13.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.206+0000 7fda54c92640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda500c8a70 0x7fda50072650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:13.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.206+0000 7fda54c92640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda500c8a70 0x7fda50072650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38558/0 (socket says 172.21.15.86:38558) 2024-04-25T12:22:13.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.206+0000 7fda54c92640 1 -- 172.21.15.86:0/2743061902 learned_addr learned my addr 172.21.15.86:0/2743061902 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:13.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.206+0000 7fda4ffff640 1 --2- 172.21.15.86:0/2743061902 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fda500c8250 0x7fda50073d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:13.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.206+0000 7fda4f7fe640 1 --2- 172.21.15.86:0/2743061902 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda500c8630 0x7fda50159d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:13.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.206+0000 7fda54c92640 1 -- 172.21.15.86:0/2743061902 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fda500c8250 msgr2=0x7fda50073d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:13.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.206+0000 7fda54c92640 1 --2- 172.21.15.86:0/2743061902 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fda500c8250 0x7fda50073d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:13.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.206+0000 7fda54c92640 1 -- 172.21.15.86:0/2743061902 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda500c8630 msgr2=0x7fda50159d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:13.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.206+0000 7fda54c92640 1 --2- 172.21.15.86:0/2743061902 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda500c8630 0x7fda50159d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:13.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.206+0000 7fda54c92640 1 -- 172.21.15.86:0/2743061902 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda501511f0 con 0x7fda500c8a70 2024-04-25T12:22:13.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.206+0000 7fda54c92640 1 --2- 172.21.15.86:0/2743061902 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda500c8a70 0x7fda50072650 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fda40007e60 tx=0x7fda4000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:13.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.206+0000 7fda4cff9640 1 -- 172.21.15.86:0/2743061902 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda40014420 con 0x7fda500c8a70 2024-04-25T12:22:13.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.206+0000 7fda4cff9640 1 -- 172.21.15.86:0/2743061902 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda40019070 con 0x7fda500c8a70 2024-04-25T12:22:13.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.206+0000 7fda566f5640 1 -- 172.21.15.86:0/2743061902 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda501514b0 con 0x7fda500c8a70 2024-04-25T12:22:13.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.206+0000 7fda4cff9640 1 -- 172.21.15.86:0/2743061902 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda40014820 con 0x7fda500c8a70 2024-04-25T12:22:13.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.206+0000 7fda566f5640 1 -- 172.21.15.86:0/2743061902 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda501592b0 con 0x7fda500c8a70 2024-04-25T12:22:13.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.210+0000 7fda566f5640 1 -- 172.21.15.86:0/2743061902 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda50075df0 con 0x7fda500c8a70 2024-04-25T12:22:13.218 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.210+0000 7fda4cff9640 1 -- 172.21.15.86:0/2743061902 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fda400149c0 con 0x7fda500c8a70 2024-04-25T12:22:13.218 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.210+0000 7fda4cff9640 1 --2- 172.21.15.86:0/2743061902 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fda300683b0 0x7fda3006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:13.218 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.210+0000 7fda4ffff640 1 --2- 172.21.15.86:0/2743061902 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fda300683b0 0x7fda3006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:13.218 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.210+0000 7fda4cff9640 1 -- 172.21.15.86:0/2743061902 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fda40087580 con 0x7fda500c8a70 2024-04-25T12:22:13.218 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.210+0000 7fda4ffff640 1 --2- 172.21.15.86:0/2743061902 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fda300683b0 0x7fda3006a870 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fda4800ba30 tx=0x7fda48008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:13.221 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.214+0000 7fda4cff9640 1 -- 172.21.15.86:0/2743061902 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fda400577d0 con 0x7fda500c8a70 2024-04-25T12:22:13.369 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.362+0000 7fda566f5640 1 -- 172.21.15.86:0/2743061902 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fda50071e50 con 0x7fda500c8a70 2024-04-25T12:22:13.369 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.362+0000 7fda4cff9640 1 -- 172.21.15.86:0/2743061902 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7fda400570d0 con 0x7fda500c8a70 2024-04-25T12:22:13.369 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 64 2024-04-25T12:22:13.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.366+0000 7fda566f5640 1 -- 172.21.15.86:0/2743061902 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fda300683b0 msgr2=0x7fda3006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:13.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.366+0000 7fda566f5640 1 --2- 172.21.15.86:0/2743061902 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fda300683b0 0x7fda3006a870 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fda4800ba30 tx=0x7fda48008040 comp rx=0 tx=0).stop 2024-04-25T12:22:13.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.366+0000 7fda566f5640 1 -- 172.21.15.86:0/2743061902 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda500c8a70 msgr2=0x7fda50072650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:13.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.366+0000 7fda566f5640 1 --2- 172.21.15.86:0/2743061902 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda500c8a70 0x7fda50072650 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fda40007e60 tx=0x7fda4000e4b0 comp rx=0 tx=0).stop 2024-04-25T12:22:13.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.366+0000 7fda566f5640 1 -- 172.21.15.86:0/2743061902 shutdown_connections 2024-04-25T12:22:13.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.366+0000 7fda566f5640 1 --2- 172.21.15.86:0/2743061902 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fda300683b0 0x7fda3006a870 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:13.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.366+0000 7fda566f5640 1 --2- 172.21.15.86:0/2743061902 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda500c8a70 0x7fda50072650 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:13.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.366+0000 7fda566f5640 1 --2- 172.21.15.86:0/2743061902 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda500c8630 0x7fda50159d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:13.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.366+0000 7fda566f5640 1 --2- 172.21.15.86:0/2743061902 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fda500c8250 0x7fda50073d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:13.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.366+0000 7fda566f5640 1 -- 172.21.15.86:0/2743061902 >> 172.21.15.86:0/2743061902 conn(0x7fda5006b9d0 msgr2=0x7fda5015b910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:13.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.366+0000 7fda566f5640 1 -- 172.21.15.86:0/2743061902 shutdown_connections 2024-04-25T12:22:13.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.366+0000 7fda566f5640 1 -- 172.21.15.86:0/2743061902 wait complete. 2024-04-25T12:22:13.387 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T12:22:13.511 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.506+0000 7fa153e14640 1 Processor -- start 2024-04-25T12:22:13.512 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.506+0000 7fa153e14640 1 -- start start 2024-04-25T12:22:13.513 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.506+0000 7fa153e14640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa14c0c8800 0x7fa14c0c39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:13.513 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.506+0000 7fa153e14640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa14c0c5e90 0x7fa14c0c3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:13.513 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.506+0000 7fa153e14640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa14c0c8be0 con 0x7fa14c0c4b40 2024-04-25T12:22:13.513 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.506+0000 7fa153e14640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fa14c158090 con 0x7fa14c0c5e90 2024-04-25T12:22:13.513 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.506+0000 7fa153e14640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fa14c1585c0 con 0x7fa14c0c8800 2024-04-25T12:22:13.513 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.506+0000 7fa151bb0640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa14c0c8800 0x7fa14c0c39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:13.513 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.506+0000 7fa1523b1640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa14c0c5e90 0x7fa14c0c3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:13.513 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.506+0000 7fa151bb0640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa14c0c8800 0x7fa14c0c39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.86:36430/0 (socket says 172.21.15.86:36430) 2024-04-25T12:22:13.513 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.506+0000 7fa151bb0640 1 -- 172.21.15.86:0/842101555 learned_addr learned my addr 172.21.15.86:0/842101555 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:13.514 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.506+0000 7fa1523b1640 1 -- 172.21.15.86:0/842101555 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa14c0c8800 msgr2=0x7fa14c0c39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:13.514 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.506+0000 7fa1523b1640 1 --2- 172.21.15.86:0/842101555 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa14c0c8800 0x7fa14c0c39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:13.514 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.506+0000 7fa1523b1640 1 -- 172.21.15.86:0/842101555 >> v1:172.21.15.134:6789/0 conn(0x7fa14c0c4b40 legacy=0x7fa14c0c5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:13.515 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.506+0000 7fa1523b1640 1 -- 172.21.15.86:0/842101555 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa14c0c4790 con 0x7fa14c0c5e90 2024-04-25T12:22:13.515 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.506+0000 7fa151bb0640 1 --2- 172.21.15.86:0/842101555 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa14c0c8800 0x7fa14c0c39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T12:22:13.516 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.510+0000 7fa1523b1640 1 --2- 172.21.15.86:0/842101555 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa14c0c5e90 0x7fa14c0c3f20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa144009d90 tx=0x7fa14401c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42f32891480d382f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:13.516 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.510+0000 7fa150bae640 1 -- 172.21.15.86:0/842101555 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1440b2070 con 0x7fa14c0c5e90 2024-04-25T12:22:13.516 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.510+0000 7fa150bae640 1 -- 172.21.15.86:0/842101555 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1440a57a0 con 0x7fa14c0c5e90 2024-04-25T12:22:13.516 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.510+0000 7fa150bae640 1 -- 172.21.15.86:0/842101555 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1440a5b70 con 0x7fa14c0c5e90 2024-04-25T12:22:13.517 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.510+0000 7fa153e14640 1 -- 172.21.15.86:0/842101555 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa14c0c5e90 msgr2=0x7fa14c0c3f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:13.517 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.510+0000 7fa153e14640 1 --2- 172.21.15.86:0/842101555 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa14c0c5e90 0x7fa14c0c3f20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa144009d90 tx=0x7fa14401c850 comp rx=0 tx=0).stop 2024-04-25T12:22:13.517 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.510+0000 7fa153e14640 1 -- 172.21.15.86:0/842101555 shutdown_connections 2024-04-25T12:22:13.517 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.510+0000 7fa153e14640 1 --2- 172.21.15.86:0/842101555 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa14c0c5e90 0x7fa14c0c3f20 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:13.517 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.510+0000 7fa153e14640 1 --2- 172.21.15.86:0/842101555 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa14c0c8800 0x7fa14c0c39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:13.517 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.510+0000 7fa153e14640 1 -- 172.21.15.86:0/842101555 >> 172.21.15.86:0/842101555 conn(0x7fa14c06b9d0 msgr2=0x7fa14c06bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:13.518 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.510+0000 7fa153e14640 1 -- 172.21.15.86:0/842101555 shutdown_connections 2024-04-25T12:22:13.518 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.510+0000 7fa153e14640 1 -- 172.21.15.86:0/842101555 wait complete. 2024-04-25T12:22:13.520 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.510+0000 7fa153e14640 1 Processor -- start 2024-04-25T12:22:13.521 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.510+0000 7fa153e14640 1 -- start start 2024-04-25T12:22:13.521 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.510+0000 7fa153e14640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa14c0c4b40 0x7fa14c0cacd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:13.521 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.510+0000 7fa153e14640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa14c0c5e90 0x7fa14c14d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:13.521 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.510+0000 7fa153e14640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa14c0c8800 0x7fa14c1f5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:13.521 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.510+0000 7fa153e14640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa14c068610 con 0x7fa14c0c5e90 2024-04-25T12:22:13.521 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.510+0000 7fa153e14640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa14c0c52f0 con 0x7fa14c0c4b40 2024-04-25T12:22:13.521 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.510+0000 7fa153e14640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fa14c068790 con 0x7fa14c0c8800 2024-04-25T12:22:13.521 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.514+0000 7fa1513af640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa14c0c5e90 0x7fa14c14d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:13.521 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.514+0000 7fa1513af640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa14c0c5e90 0x7fa14c14d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38572/0 (socket says 172.21.15.86:38572) 2024-04-25T12:22:13.521 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.514+0000 7fa1513af640 1 -- 172.21.15.86:0/2690972175 learned_addr learned my addr 172.21.15.86:0/2690972175 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:13.521 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.514+0000 7fa1523b1640 1 --2- 172.21.15.86:0/2690972175 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa14c0c8800 0x7fa14c1f5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:13.521 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.514+0000 7fa151bb0640 1 --2- 172.21.15.86:0/2690972175 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa14c0c4b40 0x7fa14c0cacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:13.522 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.514+0000 7fa1513af640 1 -- 172.21.15.86:0/2690972175 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa14c0c8800 msgr2=0x7fa14c1f5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:13.522 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.514+0000 7fa1513af640 1 --2- 172.21.15.86:0/2690972175 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa14c0c8800 0x7fa14c1f5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:13.522 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.514+0000 7fa1513af640 1 -- 172.21.15.86:0/2690972175 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa14c0c4b40 msgr2=0x7fa14c0cacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:13.522 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.514+0000 7fa1513af640 1 --2- 172.21.15.86:0/2690972175 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa14c0c4b40 0x7fa14c0cacd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:13.522 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.514+0000 7fa1513af640 1 -- 172.21.15.86:0/2690972175 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa14c1f6180 con 0x7fa14c0c5e90 2024-04-25T12:22:13.522 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.514+0000 7fa1523b1640 1 --2- 172.21.15.86:0/2690972175 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa14c0c8800 0x7fa14c1f5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:22:13.522 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.514+0000 7fa1513af640 1 --2- 172.21.15.86:0/2690972175 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa14c0c5e90 0x7fa14c14d170 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa13c00c370 tx=0x7fa13c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:13.522 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.514+0000 7fa1427fc640 1 -- 172.21.15.86:0/2690972175 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa13c0052d0 con 0x7fa14c0c5e90 2024-04-25T12:22:13.522 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.514+0000 7fa1427fc640 1 -- 172.21.15.86:0/2690972175 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa13c005470 con 0x7fa14c0c5e90 2024-04-25T12:22:13.522 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.514+0000 7fa153e14640 1 -- 172.21.15.86:0/2690972175 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa14c0ca380 con 0x7fa14c0c5e90 2024-04-25T12:22:13.523 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.514+0000 7fa1427fc640 1 -- 172.21.15.86:0/2690972175 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa13c007260 con 0x7fa14c0c5e90 2024-04-25T12:22:13.523 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.514+0000 7fa153e14640 1 -- 172.21.15.86:0/2690972175 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa14c0ca620 con 0x7fa14c0c5e90 2024-04-25T12:22:13.523 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.514+0000 7fa153e14640 1 -- 172.21.15.86:0/2690972175 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa14c075df0 con 0x7fa14c0c5e90 2024-04-25T12:22:13.524 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.514+0000 7fa1427fc640 1 -- 172.21.15.86:0/2690972175 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa13c007400 con 0x7fa14c0c5e90 2024-04-25T12:22:13.524 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.514+0000 7fa1427fc640 1 --2- 172.21.15.86:0/2690972175 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fa130068380 0x7fa13006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:13.524 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.514+0000 7fa151bb0640 1 --2- 172.21.15.86:0/2690972175 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fa130068380 0x7fa13006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:13.524 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.514+0000 7fa1427fc640 1 -- 172.21.15.86:0/2690972175 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fa13c0861b0 con 0x7fa14c0c5e90 2024-04-25T12:22:13.524 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.514+0000 7fa151bb0640 1 --2- 172.21.15.86:0/2690972175 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fa130068380 0x7fa13006a840 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa148009a40 tx=0x7fa148008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:13.526 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.518+0000 7fa1427fc640 1 -- 172.21.15.86:0/2690972175 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa13c056400 con 0x7fa14c0c5e90 2024-04-25T12:22:13.691 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.682+0000 7fa153e14640 1 -- 172.21.15.86:0/2690972175 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fa14c06f840 con 0x7fa14c0c5e90 2024-04-25T12:22:13.692 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.686+0000 7fa1427fc640 1 -- 172.21.15.86:0/2690972175 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7fa13c055d00 con 0x7fa14c0c5e90 2024-04-25T12:22:13.692 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 32 2024-04-25T12:22:13.694 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.686+0000 7fa153e14640 1 -- 172.21.15.86:0/2690972175 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fa130068380 msgr2=0x7fa13006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:13.694 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.686+0000 7fa153e14640 1 --2- 172.21.15.86:0/2690972175 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fa130068380 0x7fa13006a840 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa148009a40 tx=0x7fa148008040 comp rx=0 tx=0).stop 2024-04-25T12:22:13.694 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.686+0000 7fa153e14640 1 -- 172.21.15.86:0/2690972175 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa14c0c5e90 msgr2=0x7fa14c14d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:13.695 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.686+0000 7fa153e14640 1 --2- 172.21.15.86:0/2690972175 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa14c0c5e90 0x7fa14c14d170 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa13c00c370 tx=0x7fa13c00c830 comp rx=0 tx=0).stop 2024-04-25T12:22:13.695 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.686+0000 7fa153e14640 1 -- 172.21.15.86:0/2690972175 shutdown_connections 2024-04-25T12:22:13.695 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.686+0000 7fa153e14640 1 --2- 172.21.15.86:0/2690972175 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa14c0c8800 0x7fa14c1f5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:13.695 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.686+0000 7fa153e14640 1 --2- 172.21.15.86:0/2690972175 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fa130068380 0x7fa13006a840 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:13.695 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.686+0000 7fa153e14640 1 --2- 172.21.15.86:0/2690972175 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa14c0c5e90 0x7fa14c14d170 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:13.695 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.686+0000 7fa153e14640 1 --2- 172.21.15.86:0/2690972175 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa14c0c4b40 0x7fa14c0cacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:13.695 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.686+0000 7fa153e14640 1 -- 172.21.15.86:0/2690972175 >> 172.21.15.86:0/2690972175 conn(0x7fa14c06b9d0 msgr2=0x7fa14c14b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:13.695 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.686+0000 7fa153e14640 1 -- 172.21.15.86:0/2690972175 shutdown_connections 2024-04-25T12:22:13.695 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.686+0000 7fa153e14640 1 -- 172.21.15.86:0/2690972175 wait complete. 2024-04-25T12:22:13.711 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T12:22:13.827 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.818+0000 7f80adbfa640 1 Processor -- start 2024-04-25T12:22:13.827 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.818+0000 7f80adbfa640 1 -- start start 2024-04-25T12:22:13.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.822+0000 7f80adbfa640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f80a80c8250 0x7f80a80c39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:13.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.822+0000 7f80adbfa640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f80a80c8630 0x7f80a8151b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:13.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.822+0000 7f80adbfa640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f80a80c8a70 0x7f80a8152080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:13.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.822+0000 7f80adbfa640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f80a80c6490 con 0x7f80a80c8630 2024-04-25T12:22:13.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.822+0000 7f80adbfa640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f80a815b740 con 0x7f80a80c8250 2024-04-25T12:22:13.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.822+0000 7f80adbfa640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f80a81525c0 con 0x7f80a80c8a70 2024-04-25T12:22:13.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.822+0000 7f80a6ffd640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f80a80c8630 0x7f80a8151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:13.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.822+0000 7f80a6ffd640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f80a80c8630 0x7f80a8151b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38576/0 (socket says 172.21.15.86:38576) 2024-04-25T12:22:13.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.822+0000 7f80a6ffd640 1 -- 172.21.15.86:0/1741189096 learned_addr learned my addr 172.21.15.86:0/1741189096 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:13.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.822+0000 7f80a77fe640 1 --2- 172.21.15.86:0/1741189096 >> v2:172.21.15.134:3300/0 conn(0x7f80a80c8250 0x7f80a80c39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:13.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.822+0000 7f80a7fff640 1 --2- 172.21.15.86:0/1741189096 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f80a80c8a70 0x7f80a8152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:13.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.822+0000 7f80a6ffd640 1 -- 172.21.15.86:0/1741189096 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f80a80c8a70 msgr2=0x7f80a8152080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:13.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.822+0000 7f80a6ffd640 1 --2- 172.21.15.86:0/1741189096 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f80a80c8a70 0x7f80a8152080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:13.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.822+0000 7f80a6ffd640 1 -- 172.21.15.86:0/1741189096 >> v2:172.21.15.134:3300/0 conn(0x7f80a80c8250 msgr2=0x7f80a80c39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:13.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.822+0000 7f80a6ffd640 1 --2- 172.21.15.86:0/1741189096 >> v2:172.21.15.134:3300/0 conn(0x7f80a80c8250 0x7f80a80c39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:13.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.822+0000 7f80a6ffd640 1 -- 172.21.15.86:0/1741189096 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80a80c58c0 con 0x7f80a80c8630 2024-04-25T12:22:13.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.822+0000 7f80a7fff640 1 --2- 172.21.15.86:0/1741189096 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f80a80c8a70 0x7f80a8152080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:22:13.831 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.822+0000 7f80a6ffd640 1 --2- 172.21.15.86:0/1741189096 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80a80c8630 0x7f80a8151b40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f80a8152770 tx=0x7f809c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38e62fce3d017c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:13.831 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.826+0000 7f80a67fc640 1 -- 172.21.15.86:0/1741189096 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f809c0b0070 con 0x7f80a80c8630 2024-04-25T12:22:13.831 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.826+0000 7f80a67fc640 1 -- 172.21.15.86:0/1741189096 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f809c0ab600 con 0x7f80a80c8630 2024-04-25T12:22:13.831 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.826+0000 7f80a67fc640 1 -- 172.21.15.86:0/1741189096 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f809c0ab9d0 con 0x7f80a80c8630 2024-04-25T12:22:13.832 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.826+0000 7f80adbfa640 1 -- 172.21.15.86:0/1741189096 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80a80c8630 msgr2=0x7f80a8151b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:13.832 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.826+0000 7f80adbfa640 1 --2- 172.21.15.86:0/1741189096 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80a80c8630 0x7f80a8151b40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f80a8152770 tx=0x7f809c01c490 comp rx=0 tx=0).stop 2024-04-25T12:22:13.832 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.826+0000 7f80adbfa640 1 -- 172.21.15.86:0/1741189096 shutdown_connections 2024-04-25T12:22:13.832 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.826+0000 7f80adbfa640 1 --2- 172.21.15.86:0/1741189096 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f80a80c8a70 0x7f80a8152080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:13.832 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.826+0000 7f80adbfa640 1 --2- 172.21.15.86:0/1741189096 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80a80c8630 0x7f80a8151b40 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:13.832 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.826+0000 7f80adbfa640 1 --2- 172.21.15.86:0/1741189096 >> v2:172.21.15.134:3300/0 conn(0x7f80a80c8250 0x7f80a80c39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:13.832 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.826+0000 7f80adbfa640 1 -- 172.21.15.86:0/1741189096 >> 172.21.15.86:0/1741189096 conn(0x7f80a806b9d0 msgr2=0x7f80a806bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:13.832 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.826+0000 7f80adbfa640 1 -- 172.21.15.86:0/1741189096 shutdown_connections 2024-04-25T12:22:13.832 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.826+0000 7f80adbfa640 1 -- 172.21.15.86:0/1741189096 wait complete. 2024-04-25T12:22:13.833 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.826+0000 7f80adbfa640 1 Processor -- start 2024-04-25T12:22:13.833 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.826+0000 7f80adbfa640 1 -- start start 2024-04-25T12:22:13.835 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.826+0000 7f80adbfa640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f80a80c8250 0x7f80a8159cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:13.835 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.826+0000 7f80adbfa640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80a80c8630 0x7f80a8150b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:13.835 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.826+0000 7f80adbfa640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80a80c8a70 0x7f80a80c7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:13.835 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.826+0000 7f80adbfa640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f80a815b400 con 0x7f80a80c8a70 2024-04-25T12:22:13.835 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.826+0000 7f80adbfa640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f80a80721a0 con 0x7f80a80c8630 2024-04-25T12:22:13.835 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.826+0000 7f80adbfa640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f80a80c6900 con 0x7f80a80c8250 2024-04-25T12:22:13.835 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.826+0000 7f80a7fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80a80c8a70 0x7f80a80c7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:13.835 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.826+0000 7f80a7fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80a80c8a70 0x7f80a80c7140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38584/0 (socket says 172.21.15.86:38584) 2024-04-25T12:22:13.835 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.826+0000 7f80a7fff640 1 -- 172.21.15.86:0/2855091152 learned_addr learned my addr 172.21.15.86:0/2855091152 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:13.836 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.826+0000 7f80a77fe640 1 --2- 172.21.15.86:0/2855091152 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f80a80c8250 0x7f80a8159cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:13.836 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.826+0000 7f80a6ffd640 1 --2- 172.21.15.86:0/2855091152 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80a80c8630 0x7f80a8150b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:13.836 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.826+0000 7f80a7fff640 1 -- 172.21.15.86:0/2855091152 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f80a80c8250 msgr2=0x7f80a8159cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:13.836 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.826+0000 7f80a7fff640 1 --2- 172.21.15.86:0/2855091152 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f80a80c8250 0x7f80a8159cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:13.836 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.826+0000 7f80a7fff640 1 -- 172.21.15.86:0/2855091152 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80a80c8630 msgr2=0x7f80a8150b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:13.836 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.826+0000 7f80a7fff640 1 --2- 172.21.15.86:0/2855091152 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80a80c8630 0x7f80a8150b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:13.836 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.826+0000 7f80a7fff640 1 -- 172.21.15.86:0/2855091152 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80a814f920 con 0x7f80a80c8a70 2024-04-25T12:22:13.836 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.826+0000 7f80a6ffd640 1 --2- 172.21.15.86:0/2855091152 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80a80c8630 0x7f80a8150b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:22:13.836 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.826+0000 7f80a7fff640 1 --2- 172.21.15.86:0/2855091152 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80a80c8a70 0x7f80a80c7140 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f80a0007e20 tx=0x7f80a000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:13.836 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.826+0000 7f808ffff640 1 -- 172.21.15.86:0/2855091152 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a001a070 con 0x7f80a80c8a70 2024-04-25T12:22:13.836 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.826+0000 7f808ffff640 1 -- 172.21.15.86:0/2855091152 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80a0003ba0 con 0x7f80a80c8a70 2024-04-25T12:22:13.836 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.826+0000 7f80adbfa640 1 -- 172.21.15.86:0/2855091152 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80a814f640 con 0x7f80a80c8a70 2024-04-25T12:22:13.836 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.826+0000 7f808ffff640 1 -- 172.21.15.86:0/2855091152 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a000de80 con 0x7f80a80c8a70 2024-04-25T12:22:13.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.826+0000 7f80adbfa640 1 -- 172.21.15.86:0/2855091152 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80a8150040 con 0x7f80a80c8a70 2024-04-25T12:22:13.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.830+0000 7f80adbfa640 1 -- 172.21.15.86:0/2855091152 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80a8075df0 con 0x7f80a80c8a70 2024-04-25T12:22:13.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.830+0000 7f808ffff640 1 -- 172.21.15.86:0/2855091152 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f80a001d070 con 0x7f80a80c8a70 2024-04-25T12:22:13.838 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.830+0000 7f808ffff640 1 --2- 172.21.15.86:0/2855091152 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f80940683b0 0x7f809406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:13.838 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.830+0000 7f80a77fe640 1 --2- 172.21.15.86:0/2855091152 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f80940683b0 0x7f809406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:13.838 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.830+0000 7f808ffff640 1 -- 172.21.15.86:0/2855091152 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f80a0086f30 con 0x7f80a80c8a70 2024-04-25T12:22:13.838 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.830+0000 7f80a77fe640 1 --2- 172.21.15.86:0/2855091152 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f80940683b0 0x7f809406a870 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8098009ae0 tx=0x7f8098009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:13.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:13.834+0000 7f808ffff640 1 -- 172.21.15.86:0/2855091152 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f80a0010070 con 0x7f80a80c8a70 2024-04-25T12:22:14.029 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.022+0000 7f80adbfa640 1 -- 172.21.15.86:0/2855091152 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f80a8071e50 con 0x7f80a80c8a70 2024-04-25T12:22:14.030 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.022+0000 7f808ffff640 1 -- 172.21.15.86:0/2855091152 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6917 (secure 0 0 0) 0x7f80a0056aa0 con 0x7f80a80c8a70 2024-04-25T12:22:14.030 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:22:14.030 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/1969068022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1969068022},{"type":"v1","addr":"172.21.15.86:6835","nonce":1969068022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T12:21:23.459093+0000","modified":"2024-04-25T12:22:09.931071+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4294,"mds_1":4262,"mds_2":4245,"mds_3":4239,"mds_4":4236},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4236":{"gid":4236,"name":"a","rank":4,"incarnation":18,"state":"up:creating","state_seq":1,"addr":"172.21.15.86:6838/3213562806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":3213562806},{"type":"v1","addr":"172.21.15.86:6838","nonce":3213562806}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4239":{"gid":4239,"name":"c","rank":3,"incarnation":16,"state":"up:active","state_seq":14,"addr":"172.21.15.86:6839/4002713597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6837","nonce":4002713597},{"type":"v1","addr":"172.21.15.86:6839","nonce":4002713597}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4245":{"gid":4245,"name":"d","rank":2,"incarnation":14,"state":"up:active","state_seq":13,"addr":"172.21.15.134:6833/3114005030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3114005030},{"type":"v1","addr":"172.21.15.134:6833","nonce":3114005030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4262":{"gid":4262,"name":"b","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.134:6837/1079608447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":1079608447},{"type":"v1","addr":"172.21.15.134:6837","nonce":1079608447}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4294":{"gid":4294,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6836/3044511437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3044511437},{"type":"v1","addr":"172.21.15.134:6836","nonce":3044511437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4294,4262,4245,4239]},"id":1}]} 2024-04-25T12:22:14.030 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 18 2024-04-25T12:22:14.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.026+0000 7f80adbfa640 1 -- 172.21.15.86:0/2855091152 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f80940683b0 msgr2=0x7f809406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:14.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.026+0000 7f80adbfa640 1 --2- 172.21.15.86:0/2855091152 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f80940683b0 0x7f809406a870 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8098009ae0 tx=0x7f8098009190 comp rx=0 tx=0).stop 2024-04-25T12:22:14.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.026+0000 7f80adbfa640 1 -- 172.21.15.86:0/2855091152 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80a80c8a70 msgr2=0x7f80a80c7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:14.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.026+0000 7f80adbfa640 1 --2- 172.21.15.86:0/2855091152 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80a80c8a70 0x7f80a80c7140 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f80a0007e20 tx=0x7f80a000d4a0 comp rx=0 tx=0).stop 2024-04-25T12:22:14.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.026+0000 7f80adbfa640 1 -- 172.21.15.86:0/2855091152 shutdown_connections 2024-04-25T12:22:14.033 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.026+0000 7f80adbfa640 1 --2- 172.21.15.86:0/2855091152 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f80940683b0 0x7f809406a870 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:14.033 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.026+0000 7f80adbfa640 1 --2- 172.21.15.86:0/2855091152 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80a80c8a70 0x7f80a80c7140 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:14.033 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.026+0000 7f80adbfa640 1 --2- 172.21.15.86:0/2855091152 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80a80c8630 0x7f80a8150b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:14.033 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.026+0000 7f80adbfa640 1 --2- 172.21.15.86:0/2855091152 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f80a80c8250 0x7f80a8159cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:14.033 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.026+0000 7f80adbfa640 1 -- 172.21.15.86:0/2855091152 >> 172.21.15.86:0/2855091152 conn(0x7f80a806b9d0 msgr2=0x7f80a806f280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:14.033 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.026+0000 7f80adbfa640 1 -- 172.21.15.86:0/2855091152 shutdown_connections 2024-04-25T12:22:14.033 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.026+0000 7f80adbfa640 1 -- 172.21.15.86:0/2855091152 wait complete. 2024-04-25T12:22:14.050 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T12:22:14.171 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.162+0000 7f3db5af4640 1 Processor -- start 2024-04-25T12:22:14.171 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.162+0000 7f3db5af4640 1 -- start start 2024-04-25T12:22:14.172 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.166+0000 7f3db5af4640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3db014fbc0 0x7f3db006f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:14.172 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.166+0000 7f3db5af4640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3db014ffa0 0x7f3db00c8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:14.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.166+0000 7f3db5af4640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3db0074100 0x7f3db00c8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:14.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.166+0000 7f3db5af4640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f3db00c5d70 con 0x7f3db0074100 2024-04-25T12:22:14.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.166+0000 7f3db5af4640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f3db00c6050 con 0x7f3db014ffa0 2024-04-25T12:22:14.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.166+0000 7f3db5af4640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f3db00c6330 con 0x7f3db014fbc0 2024-04-25T12:22:14.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.166+0000 7f3daffff640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3db0074100 0x7f3db00c8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:14.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.166+0000 7f3daffff640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3db0074100 0x7f3db00c8760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38590/0 (socket says 172.21.15.86:38590) 2024-04-25T12:22:14.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.166+0000 7f3daffff640 1 -- 172.21.15.86:0/523921711 learned_addr learned my addr 172.21.15.86:0/523921711 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:14.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.166+0000 7f3daf7fe640 1 --2- 172.21.15.86:0/523921711 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3db014fbc0 0x7f3db006f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:14.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.166+0000 7f3daeffd640 1 --2- 172.21.15.86:0/523921711 >> v2:172.21.15.134:3300/0 conn(0x7f3db014ffa0 0x7f3db00c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:14.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.166+0000 7f3daffff640 1 -- 172.21.15.86:0/523921711 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3db014fbc0 msgr2=0x7f3db006f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:14.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.166+0000 7f3daffff640 1 --2- 172.21.15.86:0/523921711 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3db014fbc0 0x7f3db006f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:14.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.166+0000 7f3daffff640 1 -- 172.21.15.86:0/523921711 >> v2:172.21.15.134:3300/0 conn(0x7f3db014ffa0 msgr2=0x7f3db00c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:14.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.166+0000 7f3daffff640 1 --2- 172.21.15.86:0/523921711 >> v2:172.21.15.134:3300/0 conn(0x7f3db014ffa0 0x7f3db00c8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:14.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.166+0000 7f3daffff640 1 -- 172.21.15.86:0/523921711 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3db00c6610 con 0x7f3db0074100 2024-04-25T12:22:14.174 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.166+0000 7f3daffff640 1 --2- 172.21.15.86:0/523921711 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3db0074100 0x7f3db00c8760 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3db006a030 tx=0x7f3da801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c70d5cfd60999ba server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:14.174 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.166+0000 7f3dae7fc640 1 -- 172.21.15.86:0/523921711 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da80a5890 con 0x7f3db0074100 2024-04-25T12:22:14.175 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.166+0000 7f3dae7fc640 1 -- 172.21.15.86:0/523921711 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3da80a5a30 con 0x7f3db0074100 2024-04-25T12:22:14.175 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.166+0000 7f3dae7fc640 1 -- 172.21.15.86:0/523921711 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da80a5e00 con 0x7f3db0074100 2024-04-25T12:22:14.175 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.170+0000 7f3db5af4640 1 -- 172.21.15.86:0/523921711 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3db0074100 msgr2=0x7f3db00c8760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:14.175 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.170+0000 7f3db5af4640 1 --2- 172.21.15.86:0/523921711 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3db0074100 0x7f3db00c8760 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3db006a030 tx=0x7f3da801c9f0 comp rx=0 tx=0).stop 2024-04-25T12:22:14.176 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.170+0000 7f3db5af4640 1 -- 172.21.15.86:0/523921711 shutdown_connections 2024-04-25T12:22:14.176 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.170+0000 7f3db5af4640 1 --2- 172.21.15.86:0/523921711 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3db0074100 0x7f3db00c8760 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:14.176 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.170+0000 7f3db5af4640 1 --2- 172.21.15.86:0/523921711 >> v2:172.21.15.134:3300/0 conn(0x7f3db014ffa0 0x7f3db00c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:14.176 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.170+0000 7f3db5af4640 1 --2- 172.21.15.86:0/523921711 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3db014fbc0 0x7f3db006f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:14.176 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.170+0000 7f3db5af4640 1 -- 172.21.15.86:0/523921711 >> 172.21.15.86:0/523921711 conn(0x7f3db006b9d0 msgr2=0x7f3db006bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:14.176 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.170+0000 7f3db5af4640 1 -- 172.21.15.86:0/523921711 shutdown_connections 2024-04-25T12:22:14.176 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.170+0000 7f3db5af4640 1 -- 172.21.15.86:0/523921711 wait complete. 2024-04-25T12:22:14.176 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.170+0000 7f3db5af4640 1 Processor -- start 2024-04-25T12:22:14.177 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.170+0000 7f3db5af4640 1 -- start start 2024-04-25T12:22:14.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.170+0000 7f3db5af4640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3db0074100 0x7f3db015c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:14.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.170+0000 7f3db5af4640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3db014fbc0 0x7f3db01f1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:14.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.170+0000 7f3db5af4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3db014ffa0 0x7f3db0144d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:14.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.170+0000 7f3db5af4640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3db01592e0 con 0x7f3db014fbc0 2024-04-25T12:22:14.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.170+0000 7f3db5af4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3db0159160 con 0x7f3db014ffa0 2024-04-25T12:22:14.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.170+0000 7f3db5af4640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f3db0159460 con 0x7f3db0074100 2024-04-25T12:22:14.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.170+0000 7f3daeffd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3db014fbc0 0x7f3db01f1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:14.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.170+0000 7f3daeffd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3db014fbc0 0x7f3db01f1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38592/0 (socket says 172.21.15.86:38592) 2024-04-25T12:22:14.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.170+0000 7f3daeffd640 1 -- 172.21.15.86:0/3627260659 learned_addr learned my addr 172.21.15.86:0/3627260659 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:14.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.170+0000 7f3daf7fe640 1 --2- 172.21.15.86:0/3627260659 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3db0074100 0x7f3db015c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:14.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.170+0000 7f3daeffd640 1 -- 172.21.15.86:0/3627260659 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3db0074100 msgr2=0x7f3db015c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:14.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.170+0000 7f3daeffd640 1 --2- 172.21.15.86:0/3627260659 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3db0074100 0x7f3db015c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:14.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.170+0000 7f3daeffd640 1 -- 172.21.15.86:0/3627260659 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3db014ffa0 msgr2=0x7f3db0144d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:14.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.170+0000 7f3daffff640 1 --2- 172.21.15.86:0/3627260659 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3db014ffa0 0x7f3db0144d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:14.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.170+0000 7f3daeffd640 1 --2- 172.21.15.86:0/3627260659 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3db014ffa0 0x7f3db0144d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:14.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.170+0000 7f3daeffd640 1 -- 172.21.15.86:0/3627260659 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3db0153540 con 0x7f3db014fbc0 2024-04-25T12:22:14.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.170+0000 7f3daeffd640 1 --2- 172.21.15.86:0/3627260659 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3db014fbc0 0x7f3db01f1e50 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3da400d620 tx=0x7f3da400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:14.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.170+0000 7f3d97fff640 1 -- 172.21.15.86:0/3627260659 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da400b620 con 0x7f3db014fbc0 2024-04-25T12:22:14.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.170+0000 7f3d97fff640 1 -- 172.21.15.86:0/3627260659 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3da4019070 con 0x7f3db014fbc0 2024-04-25T12:22:14.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.170+0000 7f3db5af4640 1 -- 172.21.15.86:0/3627260659 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3db0149110 con 0x7f3db014fbc0 2024-04-25T12:22:14.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.170+0000 7f3d97fff640 1 -- 172.21.15.86:0/3627260659 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da400b9e0 con 0x7f3db014fbc0 2024-04-25T12:22:14.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.170+0000 7f3db5af4640 1 -- 172.21.15.86:0/3627260659 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3db0152780 con 0x7f3db014fbc0 2024-04-25T12:22:14.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.170+0000 7f3db5af4640 1 -- 172.21.15.86:0/3627260659 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3db0075df0 con 0x7f3db014fbc0 2024-04-25T12:22:14.181 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.174+0000 7f3d97fff640 1 -- 172.21.15.86:0/3627260659 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3da400bb80 con 0x7f3db014fbc0 2024-04-25T12:22:14.181 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.174+0000 7f3d97fff640 1 --2- 172.21.15.86:0/3627260659 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f3d9c068380 0x7f3d9c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:14.181 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.174+0000 7f3d97fff640 1 -- 172.21.15.86:0/3627260659 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f3da4087c40 con 0x7f3db014fbc0 2024-04-25T12:22:14.181 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.174+0000 7f3daf7fe640 1 --2- 172.21.15.86:0/3627260659 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f3d9c068380 0x7f3d9c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:14.181 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.174+0000 7f3daf7fe640 1 --2- 172.21.15.86:0/3627260659 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f3d9c068380 0x7f3d9c06a840 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3da000ba30 tx=0x7f3da0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:14.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.178+0000 7f3d97fff640 1 -- 172.21.15.86:0/3627260659 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3da4057ee0 con 0x7f3db014fbc0 2024-04-25T12:22:14.346 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.338+0000 7f3db5af4640 1 -- 172.21.15.86:0/3627260659 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3db00c7df0 con 0x7f3db014fbc0 2024-04-25T12:22:14.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.342+0000 7f3d97fff640 1 -- 172.21.15.86:0/3627260659 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18905 (secure 0 0 0) 0x7f3da40577e0 con 0x7f3db014fbc0 2024-04-25T12:22:14.349 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:22:14.349 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":26,"fsid":"f2ef5c0c-9576-4650-b4f7-6cb14247f62a","created":"2024-04-25T12:20:59.241733+0000","modified":"2024-04-25T12:22:04.877793+0000","last_up_change":"2024-04-25T12:21:10.939617+0000","last_in_change":"2024-04-25T12:21:01.534145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T12:21:11.839922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T12:21:21.854040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T12:21:22.406060+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T12:21:26.152386+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1f713f00-ef9f-4a6f-a620-38a8a1f8a822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6801","nonce":2812764579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6803","nonce":2812764579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6807","nonce":2812764579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6805","nonce":2812764579}]},"public_addr":"172.21.15.86:6801/2812764579","cluster_addr":"172.21.15.86:6803/2812764579","heartbeat_back_addr":"172.21.15.86:6807/2812764579","heartbeat_front_addr":"172.21.15.86:6805/2812764579","state":["exists","up"]},{"osd":1,"uuid":"baf6606d-a556-4fbe-a930-855e04ff1534","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6809","nonce":467966038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6811","nonce":467966038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6815","nonce":467966038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6813","nonce":467966038}]},"public_addr":"172.21.15.86:6809/467966038","cluster_addr":"172.21.15.86:6811/467966038","heartbeat_back_addr":"172.21.15.86:6815/467966038","heartbeat_front_addr":"172.21.15.86:6813/467966038","state":["exists","up"]},{"osd":2,"uuid":"c983d68e-6d60-434f-aed6-108420c5dd09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6817","nonce":3279762843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6820","nonce":3279762843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6825","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6827","nonce":3279762843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6824","nonce":3279762843}]},"public_addr":"172.21.15.86:6817/3279762843","cluster_addr":"172.21.15.86:6820/3279762843","heartbeat_back_addr":"172.21.15.86:6827/3279762843","heartbeat_front_addr":"172.21.15.86:6824/3279762843","state":["exists","up"]},{"osd":3,"uuid":"e77657bb-45aa-43bf-ab41-c7377eb495ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6821","nonce":2861354413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6826","nonce":2861354413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6831","nonce":2861354413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6829","nonce":2861354413}]},"public_addr":"172.21.15.86:6821/2861354413","cluster_addr":"172.21.15.86:6826/2861354413","heartbeat_back_addr":"172.21.15.86:6831/2861354413","heartbeat_front_addr":"172.21.15.86:6829/2861354413","state":["exists","up"]},{"osd":4,"uuid":"252bd300-d75a-4b00-be4b-27e6b51de4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6802","nonce":1872913602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6805","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6808","nonce":1872913602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6815","nonce":1872913602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6813","nonce":1872913602}]},"public_addr":"172.21.15.134:6802/1872913602","cluster_addr":"172.21.15.134:6808/1872913602","heartbeat_back_addr":"172.21.15.134:6815/1872913602","heartbeat_front_addr":"172.21.15.134:6813/1872913602","state":["exists","up"]},{"osd":5,"uuid":"4135da3f-7427-4409-a48e-78bd8a7b46ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6801","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6803","nonce":2261413981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6806","nonce":2261413981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6812","nonce":2261413981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6809","nonce":2261413981}]},"public_addr":"172.21.15.134:6803/2261413981","cluster_addr":"172.21.15.134:6806/2261413981","heartbeat_back_addr":"172.21.15.134:6812/2261413981","heartbeat_front_addr":"172.21.15.134:6809/2261413981","state":["exists","up"]},{"osd":6,"uuid":"b6e7a5f1-fa7e-497d-abac-a19994d26820","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6825","nonce":2841082767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6827","nonce":2841082767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6831","nonce":2841082767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6829","nonce":2841082767}]},"public_addr":"172.21.15.134:6825/2841082767","cluster_addr":"172.21.15.134:6827/2841082767","heartbeat_back_addr":"172.21.15.134:6831/2841082767","heartbeat_front_addr":"172.21.15.134:6829/2841082767","state":["exists","up"]},{"osd":7,"uuid":"c5597e50-1962-4103-9124-dd7bceb8ac97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6817","nonce":1277404274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6819","nonce":1277404274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6823","nonce":1277404274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6821","nonce":1277404274}]},"public_addr":"172.21.15.134:6817/1277404274","cluster_addr":"172.21.15.134:6819/1277404274","heartbeat_back_addr":"172.21.15.134:6823/1277404274","heartbeat_front_addr":"172.21.15.134:6821/1277404274","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.018125+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.157958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.113619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.136904+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.844514+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.872629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.775339+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.822867+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":7,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.33","mappings":[{"from":3,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T12:22:14.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.342+0000 7f3db5af4640 1 -- 172.21.15.86:0/3627260659 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f3d9c068380 msgr2=0x7f3d9c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:14.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.342+0000 7f3db5af4640 1 --2- 172.21.15.86:0/3627260659 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f3d9c068380 0x7f3d9c06a840 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3da000ba30 tx=0x7f3da0008040 comp rx=0 tx=0).stop 2024-04-25T12:22:14.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.342+0000 7f3db5af4640 1 -- 172.21.15.86:0/3627260659 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3db014fbc0 msgr2=0x7f3db01f1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:14.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.342+0000 7f3db5af4640 1 --2- 172.21.15.86:0/3627260659 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3db014fbc0 0x7f3db01f1e50 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3da400d620 tx=0x7f3da400dae0 comp rx=0 tx=0).stop 2024-04-25T12:22:14.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.342+0000 7f3db5af4640 1 -- 172.21.15.86:0/3627260659 shutdown_connections 2024-04-25T12:22:14.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.342+0000 7f3db5af4640 1 --2- 172.21.15.86:0/3627260659 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3db014ffa0 0x7f3db0144d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:14.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.342+0000 7f3db5af4640 1 --2- 172.21.15.86:0/3627260659 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f3d9c068380 0x7f3d9c06a840 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:14.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.342+0000 7f3db5af4640 1 --2- 172.21.15.86:0/3627260659 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3db014fbc0 0x7f3db01f1e50 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:14.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.342+0000 7f3db5af4640 1 --2- 172.21.15.86:0/3627260659 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3db0074100 0x7f3db015c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:14.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.342+0000 7f3db5af4640 1 -- 172.21.15.86:0/3627260659 >> 172.21.15.86:0/3627260659 conn(0x7f3db006b9d0 msgr2=0x7f3db014e290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:14.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.342+0000 7f3db5af4640 1 -- 172.21.15.86:0/3627260659 shutdown_connections 2024-04-25T12:22:14.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.342+0000 7f3db5af4640 1 -- 172.21.15.86:0/3627260659 wait complete. 2024-04-25T12:22:14.368 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T12:22:14.480 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.474+0000 7f47d55d0640 1 Processor -- start 2024-04-25T12:22:14.480 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.474+0000 7f47d55d0640 1 -- start start 2024-04-25T12:22:14.481 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.474+0000 7f47d55d0640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f47d0074100 0x7f47d006f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:14.481 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.474+0000 7f47d55d0640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47d00c5d70 con 0x7f47d014fbc0 2024-04-25T12:22:14.481 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.474+0000 7f47d55d0640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47d00c6050 con 0x7f47d014ffa0 2024-04-25T12:22:14.482 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.474+0000 7f47d55d0640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f47d00c6330 con 0x7f47d0074100 2024-04-25T12:22:14.482 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.474+0000 7f47cf7fe640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f47d0074100 0x7f47d006f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:14.482 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.474+0000 7f47ceffd640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f47d014fbc0 0x7f47d00c8220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:43290/0 (socket says 172.21.15.86:43290) 2024-04-25T12:22:14.482 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.474+0000 7f47ceffd640 1 -- 172.21.15.86:0/2466376845 learned_addr learned my addr 172.21.15.86:0/2466376845 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-04-25T12:22:14.482 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.474+0000 7f47cf7fe640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f47d0074100 0x7f47d006f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38596/0 (socket says 172.21.15.86:38596) 2024-04-25T12:22:14.482 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.474+0000 7f47cf7fe640 1 -- 172.21.15.86:0/2466376845 >> v1:172.21.15.134:6789/0 conn(0x7f47d014ffa0 legacy=0x7f47d00c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:14.482 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.474+0000 7f47cf7fe640 1 -- 172.21.15.86:0/2466376845 >> v1:172.21.15.86:6789/0 conn(0x7f47d014fbc0 legacy=0x7f47d00c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:14.482 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.474+0000 7f47cf7fe640 1 -- 172.21.15.86:0/2466376845 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47d00c6610 con 0x7f47d0074100 2024-04-25T12:22:14.483 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.478+0000 7f47cf7fe640 1 --2- 172.21.15.86:0/2466376845 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47d0074100 0x7f47d006f700 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f47c8009dc0 tx=0x7f47c801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb0eb48598a49465 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:14.484 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.478+0000 7f47cdffb640 1 -- 172.21.15.86:0/2466376845 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c80b2070 con 0x7f47d0074100 2024-04-25T12:22:14.484 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.478+0000 7f47cdffb640 1 -- 172.21.15.86:0/2466376845 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47c80a59f0 con 0x7f47d0074100 2024-04-25T12:22:14.484 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.478+0000 7f47cdffb640 1 -- 172.21.15.86:0/2466376845 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c80a5dc0 con 0x7f47d0074100 2024-04-25T12:22:14.485 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.478+0000 7f47d55d0640 1 -- 172.21.15.86:0/2466376845 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47d0074100 msgr2=0x7f47d006f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:14.485 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.478+0000 7f47d55d0640 1 --2- 172.21.15.86:0/2466376845 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47d0074100 0x7f47d006f700 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f47c8009dc0 tx=0x7f47c801c910 comp rx=0 tx=0).stop 2024-04-25T12:22:14.485 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.478+0000 7f47d55d0640 1 -- 172.21.15.86:0/2466376845 shutdown_connections 2024-04-25T12:22:14.485 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.478+0000 7f47d55d0640 1 --2- 172.21.15.86:0/2466376845 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47d0074100 0x7f47d006f700 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:14.486 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.478+0000 7f47d55d0640 1 -- 172.21.15.86:0/2466376845 >> 172.21.15.86:0/2466376845 conn(0x7f47d006b9d0 msgr2=0x7f47d006bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:14.486 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.478+0000 7f47d55d0640 1 -- 172.21.15.86:0/2466376845 shutdown_connections 2024-04-25T12:22:14.486 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.478+0000 7f47d55d0640 1 -- 172.21.15.86:0/2466376845 wait complete. 2024-04-25T12:22:14.486 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.478+0000 7f47d55d0640 1 Processor -- start 2024-04-25T12:22:14.486 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.478+0000 7f47d55d0640 1 -- start start 2024-04-25T12:22:14.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.478+0000 7f47d55d0640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47d0074100 0x7f47d015b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:14.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.478+0000 7f47d55d0640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f47d014fbc0 0x7f47d01f8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:14.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.478+0000 7f47d55d0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47d014ffa0 0x7f47d0144ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:14.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.478+0000 7f47d55d0640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f47d0167630 con 0x7f47d0074100 2024-04-25T12:22:14.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.478+0000 7f47d55d0640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f47d01674b0 con 0x7f47d014ffa0 2024-04-25T12:22:14.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.478+0000 7f47d55d0640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f47d01677b0 con 0x7f47d014fbc0 2024-04-25T12:22:14.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.478+0000 7f47ceffd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47d0074100 0x7f47d015b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:14.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.478+0000 7f47ceffd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47d0074100 0x7f47d015b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38606/0 (socket says 172.21.15.86:38606) 2024-04-25T12:22:14.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.478+0000 7f47ceffd640 1 -- 172.21.15.86:0/2907217328 learned_addr learned my addr 172.21.15.86:0/2907217328 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:14.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.478+0000 7f47ce7fc640 1 --2- 172.21.15.86:0/2907217328 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f47d014fbc0 0x7f47d01f8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:14.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.478+0000 7f47cf7fe640 1 --2- 172.21.15.86:0/2907217328 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47d014ffa0 0x7f47d0144ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:14.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.478+0000 7f47ceffd640 1 -- 172.21.15.86:0/2907217328 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f47d014fbc0 msgr2=0x7f47d01f8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:14.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.478+0000 7f47ceffd640 1 --2- 172.21.15.86:0/2907217328 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f47d014fbc0 0x7f47d01f8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:14.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.478+0000 7f47ceffd640 1 -- 172.21.15.86:0/2907217328 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47d014ffa0 msgr2=0x7f47d0144ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:14.491 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.478+0000 7f47ceffd640 1 --2- 172.21.15.86:0/2907217328 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47d014ffa0 0x7f47d0144ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:14.491 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.478+0000 7f47ceffd640 1 -- 172.21.15.86:0/2907217328 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47d00c54d0 con 0x7f47d0074100 2024-04-25T12:22:14.491 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.478+0000 7f47ce7fc640 1 --2- 172.21.15.86:0/2907217328 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f47d014fbc0 0x7f47d01f8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:22:14.491 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.478+0000 7f47ceffd640 1 --2- 172.21.15.86:0/2907217328 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47d0074100 0x7f47d015b280 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f47c400c450 tx=0x7f47c400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:14.491 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.478+0000 7f47b77fe640 1 -- 172.21.15.86:0/2907217328 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c4017070 con 0x7f47d0074100 2024-04-25T12:22:14.491 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.478+0000 7f47b77fe640 1 -- 172.21.15.86:0/2907217328 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47c4005cf0 con 0x7f47d0074100 2024-04-25T12:22:14.491 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.478+0000 7f47d55d0640 1 -- 172.21.15.86:0/2907217328 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47d01495c0 con 0x7f47d0074100 2024-04-25T12:22:14.491 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.478+0000 7f47b77fe640 1 -- 172.21.15.86:0/2907217328 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c4007290 con 0x7f47d0074100 2024-04-25T12:22:14.491 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.478+0000 7f47d55d0640 1 -- 172.21.15.86:0/2907217328 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47d00717d0 con 0x7f47d0074100 2024-04-25T12:22:14.491 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.482+0000 7f47d55d0640 1 -- 172.21.15.86:0/2907217328 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47d0075df0 con 0x7f47d0074100 2024-04-25T12:22:14.491 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.482+0000 7f47b77fe640 1 -- 172.21.15.86:0/2907217328 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f47c401a070 con 0x7f47d0074100 2024-04-25T12:22:14.492 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.482+0000 7f47b77fe640 1 --2- 172.21.15.86:0/2907217328 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f47bc0683b0 0x7f47bc06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:14.492 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.482+0000 7f47b77fe640 1 -- 172.21.15.86:0/2907217328 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f47c40860e0 con 0x7f47d0074100 2024-04-25T12:22:14.492 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.482+0000 7f47ce7fc640 1 --2- 172.21.15.86:0/2907217328 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f47bc0683b0 0x7f47bc06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:14.492 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.482+0000 7f47ce7fc640 1 --2- 172.21.15.86:0/2907217328 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f47bc0683b0 0x7f47bc06a870 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f47d0072c80 tx=0x7f47c0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:14.493 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.486+0000 7f47b77fe640 1 -- 172.21.15.86:0/2907217328 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f47c40562a0 con 0x7f47d0074100 2024-04-25T12:22:14.674 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.666+0000 7f47d55d0640 1 -- 172.21.15.86:0/2907217328 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f47d0149c50 con 0x7f47d0074100 2024-04-25T12:22:14.675 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.666+0000 7f47b77fe640 1 -- 172.21.15.86:0/2907217328 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6917 (secure 0 0 0) 0x7f47c4055ba0 con 0x7f47d0074100 2024-04-25T12:22:14.675 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:22:14.675 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/1969068022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1969068022},{"type":"v1","addr":"172.21.15.86:6835","nonce":1969068022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T12:21:23.459093+0000","modified":"2024-04-25T12:22:09.931071+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4294,"mds_1":4262,"mds_2":4245,"mds_3":4239,"mds_4":4236},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4236":{"gid":4236,"name":"a","rank":4,"incarnation":18,"state":"up:creating","state_seq":1,"addr":"172.21.15.86:6838/3213562806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":3213562806},{"type":"v1","addr":"172.21.15.86:6838","nonce":3213562806}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4239":{"gid":4239,"name":"c","rank":3,"incarnation":16,"state":"up:active","state_seq":14,"addr":"172.21.15.86:6839/4002713597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6837","nonce":4002713597},{"type":"v1","addr":"172.21.15.86:6839","nonce":4002713597}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4245":{"gid":4245,"name":"d","rank":2,"incarnation":14,"state":"up:active","state_seq":13,"addr":"172.21.15.134:6833/3114005030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3114005030},{"type":"v1","addr":"172.21.15.134:6833","nonce":3114005030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4262":{"gid":4262,"name":"b","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.134:6837/1079608447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":1079608447},{"type":"v1","addr":"172.21.15.134:6837","nonce":1079608447}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4294":{"gid":4294,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6836/3044511437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3044511437},{"type":"v1","addr":"172.21.15.134:6836","nonce":3044511437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4294,4262,4245,4239]},"id":1}]} 2024-04-25T12:22:14.675 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 18 2024-04-25T12:22:14.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.670+0000 7f47d55d0640 1 -- 172.21.15.86:0/2907217328 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f47bc0683b0 msgr2=0x7f47bc06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:14.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.670+0000 7f47d55d0640 1 --2- 172.21.15.86:0/2907217328 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f47bc0683b0 0x7f47bc06a870 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f47d0072c80 tx=0x7f47c0008040 comp rx=0 tx=0).stop 2024-04-25T12:22:14.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.670+0000 7f47d55d0640 1 -- 172.21.15.86:0/2907217328 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47d0074100 msgr2=0x7f47d015b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:14.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.670+0000 7f47d55d0640 1 --2- 172.21.15.86:0/2907217328 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47d0074100 0x7f47d015b280 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f47c400c450 tx=0x7f47c400c910 comp rx=0 tx=0).stop 2024-04-25T12:22:14.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.670+0000 7f47d55d0640 1 -- 172.21.15.86:0/2907217328 shutdown_connections 2024-04-25T12:22:14.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.670+0000 7f47d55d0640 1 --2- 172.21.15.86:0/2907217328 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47d014ffa0 0x7f47d0144ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:14.678 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.670+0000 7f47d55d0640 1 --2- 172.21.15.86:0/2907217328 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f47d014fbc0 0x7f47d01f8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:14.678 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.670+0000 7f47d55d0640 1 --2- 172.21.15.86:0/2907217328 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f47bc0683b0 0x7f47bc06a870 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:14.678 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.670+0000 7f47d55d0640 1 --2- 172.21.15.86:0/2907217328 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47d0074100 0x7f47d015b280 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:14.678 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.670+0000 7f47d55d0640 1 -- 172.21.15.86:0/2907217328 >> 172.21.15.86:0/2907217328 conn(0x7f47d006b9d0 msgr2=0x7f47d0071030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:14.678 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.670+0000 7f47d55d0640 1 -- 172.21.15.86:0/2907217328 shutdown_connections 2024-04-25T12:22:14.678 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:14.670+0000 7f47d55d0640 1 -- 172.21.15.86:0/2907217328 wait complete. 2024-04-25T12:22:15.296 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T12:21:23.459093+0000', 'modified': '2024-04-25T12:22:09.931071+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 4294, 'mds_1': 4262, 'mds_2': 4245, 'mds_3': 4239, 'mds_4': 4236}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4236': {'gid': 4236, 'name': 'a', 'rank': 4, 'incarnation': 18, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.86:6838/3213562806', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6836', 'nonce': 3213562806}, {'type': 'v1', 'addr': '172.21.15.86:6838', 'nonce': 3213562806}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4239': {'gid': 4239, 'name': 'c', 'rank': 3, 'incarnation': 16, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.86:6839/4002713597', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6837', 'nonce': 4002713597}, {'type': 'v1', 'addr': '172.21.15.86:6839', 'nonce': 4002713597}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4245': {'gid': 4245, 'name': 'd', 'rank': 2, 'incarnation': 14, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.134:6833/3114005030', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6832', 'nonce': 3114005030}, {'type': 'v1', 'addr': '172.21.15.134:6833', 'nonce': 3114005030}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4262': {'gid': 4262, 'name': 'b', 'rank': 1, 'incarnation': 10, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.134:6837/1079608447', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6835', 'nonce': 1079608447}, {'type': 'v1', 'addr': '172.21.15.134:6837', 'nonce': 1079608447}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4294': {'gid': 4294, 'name': 'f', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.134:6836/3044511437', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6834', 'nonce': 3044511437}, {'type': 'v1', 'addr': '172.21.15.134:6836', 'nonce': 3044511437}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4294, 'qdb_cluster': [4294, 4262, 4245, 4239]} 2024-04-25T12:22:15.297 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4236:up:creating 2024-04-25T12:22:16.298 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T12:22:16.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.426+0000 7f268ec94640 1 Processor -- start 2024-04-25T12:22:16.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.426+0000 7f268ec94640 1 -- start start 2024-04-25T12:22:16.433 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.426+0000 7f268ec94640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f26880c4b40 0x7f26880c8800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:16.433 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.426+0000 7f268ec94640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f268806c4f0 0x7f26880c39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:16.433 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.426+0000 7f268ec94640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f268806c930 0x7f26880c3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:16.433 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.426+0000 7f268ec94640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f2688158090 con 0x7f26880c4b40 2024-04-25T12:22:16.433 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.426+0000 7f268ec94640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f26881585c0 con 0x7f268806c930 2024-04-25T12:22:16.433 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.426+0000 7f268ec94640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f26880c52f0 con 0x7f268806c4f0 2024-04-25T12:22:16.433 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.426+0000 7f268ca30640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f26880c4b40 0x7f26880c8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:16.433 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.426+0000 7f268ca30640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f26880c4b40 0x7f26880c8800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38614/0 (socket says 172.21.15.86:38614) 2024-04-25T12:22:16.433 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.426+0000 7f268ca30640 1 -- 172.21.15.86:0/3432828794 learned_addr learned my addr 172.21.15.86:0/3432828794 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:16.433 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.426+0000 7f2687fff640 1 --2- 172.21.15.86:0/3432828794 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f268806c4f0 0x7f26880c39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:16.433 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.426+0000 7f268d231640 1 --2- 172.21.15.86:0/3432828794 >> v2:172.21.15.134:3300/0 conn(0x7f268806c930 0x7f26880c3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:16.433 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.426+0000 7f268ca30640 1 -- 172.21.15.86:0/3432828794 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f268806c4f0 msgr2=0x7f26880c39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:16.433 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.426+0000 7f268ca30640 1 --2- 172.21.15.86:0/3432828794 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f268806c4f0 0x7f26880c39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:16.434 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.426+0000 7f268ca30640 1 -- 172.21.15.86:0/3432828794 >> v2:172.21.15.134:3300/0 conn(0x7f268806c930 msgr2=0x7f26880c3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:16.434 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.426+0000 7f268ca30640 1 --2- 172.21.15.86:0/3432828794 >> v2:172.21.15.134:3300/0 conn(0x7f268806c930 0x7f26880c3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:16.434 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.426+0000 7f268ca30640 1 -- 172.21.15.86:0/3432828794 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26880c4790 con 0x7f26880c4b40 2024-04-25T12:22:16.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.426+0000 7f268ca30640 1 --2- 172.21.15.86:0/3432828794 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26880c4b40 0x7f26880c8800 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2678009870 tx=0x7f267801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5df1526aa4effae4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:16.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.426+0000 7f26877fe640 1 -- 172.21.15.86:0/3432828794 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26780b1070 con 0x7f26880c4b40 2024-04-25T12:22:16.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.426+0000 7f26877fe640 1 -- 172.21.15.86:0/3432828794 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26780a8050 con 0x7f26880c4b40 2024-04-25T12:22:16.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.426+0000 7f26877fe640 1 -- 172.21.15.86:0/3432828794 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26780ac860 con 0x7f26880c4b40 2024-04-25T12:22:16.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.430+0000 7f268ec94640 1 -- 172.21.15.86:0/3432828794 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26880c4b40 msgr2=0x7f26880c8800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:16.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.430+0000 7f268ec94640 1 --2- 172.21.15.86:0/3432828794 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26880c4b40 0x7f26880c8800 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2678009870 tx=0x7f267801c400 comp rx=0 tx=0).stop 2024-04-25T12:22:16.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.430+0000 7f268ec94640 1 -- 172.21.15.86:0/3432828794 shutdown_connections 2024-04-25T12:22:16.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.430+0000 7f268ec94640 1 --2- 172.21.15.86:0/3432828794 >> v2:172.21.15.134:3300/0 conn(0x7f268806c930 0x7f26880c3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:16.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.430+0000 7f268ec94640 1 --2- 172.21.15.86:0/3432828794 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f268806c4f0 0x7f26880c39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:16.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.430+0000 7f268ec94640 1 --2- 172.21.15.86:0/3432828794 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26880c4b40 0x7f26880c8800 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:16.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.430+0000 7f268ec94640 1 -- 172.21.15.86:0/3432828794 >> 172.21.15.86:0/3432828794 conn(0x7f268806b9d0 msgr2=0x7f268806bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:16.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.430+0000 7f268ec94640 1 -- 172.21.15.86:0/3432828794 shutdown_connections 2024-04-25T12:22:16.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.430+0000 7f268ec94640 1 -- 172.21.15.86:0/3432828794 wait complete. 2024-04-25T12:22:16.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.430+0000 7f268ec94640 1 Processor -- start 2024-04-25T12:22:16.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.430+0000 7f268ec94640 1 -- start start 2024-04-25T12:22:16.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.430+0000 7f268ec94640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f268806c4f0 0x7f268814c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:16.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.430+0000 7f268ec94640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f268806c930 0x7f2688146df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:16.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.430+0000 7f268ec94640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f26880c4b40 0x7f2688147330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:16.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.430+0000 7f268ec94640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f2688068790 con 0x7f268806c930 2024-04-25T12:22:16.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.430+0000 7f268ec94640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2688068610 con 0x7f268806c4f0 2024-04-25T12:22:16.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.430+0000 7f268ec94640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f26880681d0 con 0x7f26880c4b40 2024-04-25T12:22:16.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.430+0000 7f2687fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f268806c930 0x7f2688146df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:16.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.430+0000 7f2687fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f268806c930 0x7f2688146df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38620/0 (socket says 172.21.15.86:38620) 2024-04-25T12:22:16.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.430+0000 7f2687fff640 1 -- 172.21.15.86:0/852820336 learned_addr learned my addr 172.21.15.86:0/852820336 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:16.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.430+0000 7f268ca30640 1 --2- 172.21.15.86:0/852820336 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f268806c4f0 0x7f268814c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:16.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.430+0000 7f268d231640 1 --2- 172.21.15.86:0/852820336 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f26880c4b40 0x7f2688147330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:16.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.430+0000 7f2687fff640 1 -- 172.21.15.86:0/852820336 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f26880c4b40 msgr2=0x7f2688147330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:16.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.430+0000 7f2687fff640 1 --2- 172.21.15.86:0/852820336 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f26880c4b40 0x7f2688147330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:16.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.430+0000 7f2687fff640 1 -- 172.21.15.86:0/852820336 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f268806c4f0 msgr2=0x7f268814c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:16.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.430+0000 7f2687fff640 1 --2- 172.21.15.86:0/852820336 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f268806c4f0 0x7f268814c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:16.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.430+0000 7f2687fff640 1 -- 172.21.15.86:0/852820336 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f268814e0b0 con 0x7f268806c930 2024-04-25T12:22:16.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.430+0000 7f2687fff640 1 --2- 172.21.15.86:0/852820336 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f268806c930 0x7f2688146df0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f267c00d830 tx=0x7f267c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:16.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.430+0000 7f26857fa640 1 -- 172.21.15.86:0/852820336 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f267c018030 con 0x7f268806c930 2024-04-25T12:22:16.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.430+0000 7f26857fa640 1 -- 172.21.15.86:0/852820336 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f267c00be10 con 0x7f268806c930 2024-04-25T12:22:16.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.430+0000 7f26857fa640 1 -- 172.21.15.86:0/852820336 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f267c0098b0 con 0x7f268806c930 2024-04-25T12:22:16.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.430+0000 7f268ec94640 1 -- 172.21.15.86:0/852820336 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f268814e370 con 0x7f268806c930 2024-04-25T12:22:16.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.430+0000 7f268ec94640 1 -- 172.21.15.86:0/852820336 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f268814e930 con 0x7f268806c930 2024-04-25T12:22:16.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.434+0000 7f268ec94640 1 -- 172.21.15.86:0/852820336 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2688075df0 con 0x7f268806c930 2024-04-25T12:22:16.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.434+0000 7f26857fa640 1 -- 172.21.15.86:0/852820336 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f267c01b070 con 0x7f268806c930 2024-04-25T12:22:16.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.434+0000 7f26857fa640 1 --2- 172.21.15.86:0/852820336 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f2674068380 0x7f267406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:16.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.434+0000 7f26857fa640 1 -- 172.21.15.86:0/852820336 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f267c086f40 con 0x7f268806c930 2024-04-25T12:22:16.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.434+0000 7f268ca30640 1 --2- 172.21.15.86:0/852820336 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f2674068380 0x7f267406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:16.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.434+0000 7f268ca30640 1 --2- 172.21.15.86:0/852820336 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f2674068380 0x7f267406a840 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f26780ae000 tx=0x7f2678008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:16.445 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.438+0000 7f26857fa640 1 -- 172.21.15.86:0/852820336 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f267c057100 con 0x7f268806c930 2024-04-25T12:22:16.648 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.642+0000 7f268ec94640 1 -- 172.21.15.86:0/852820336 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f268806f840 con 0x7f268806c930 2024-04-25T12:22:16.649 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.642+0000 7f26857fa640 1 -- 172.21.15.86:0/852820336 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6921 (secure 0 0 0) 0x7f267c056a00 con 0x7f268806c930 2024-04-25T12:22:16.649 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:22:16.649 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/1969068022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1969068022},{"type":"v1","addr":"172.21.15.86:6835","nonce":1969068022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T12:21:23.459093+0000","modified":"2024-04-25T12:22:15.953239+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4294,"mds_1":4262,"mds_2":4245,"mds_3":4239,"mds_4":4236},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4236":{"gid":4236,"name":"a","rank":4,"incarnation":18,"state":"up:active","state_seq":16,"addr":"172.21.15.86:6838/3213562806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":3213562806},{"type":"v1","addr":"172.21.15.86:6838","nonce":3213562806}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4239":{"gid":4239,"name":"c","rank":3,"incarnation":16,"state":"up:active","state_seq":14,"addr":"172.21.15.86:6839/4002713597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6837","nonce":4002713597},{"type":"v1","addr":"172.21.15.86:6839","nonce":4002713597}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4245":{"gid":4245,"name":"d","rank":2,"incarnation":14,"state":"up:active","state_seq":13,"addr":"172.21.15.134:6833/3114005030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3114005030},{"type":"v1","addr":"172.21.15.134:6833","nonce":3114005030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4262":{"gid":4262,"name":"b","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.134:6837/1079608447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":1079608447},{"type":"v1","addr":"172.21.15.134:6837","nonce":1079608447}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4294":{"gid":4294,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6836/3044511437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3044511437},{"type":"v1","addr":"172.21.15.134:6836","nonce":3044511437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4236,4262,4239,4245,4294]},"id":1}]} 2024-04-25T12:22:16.650 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 19 2024-04-25T12:22:16.651 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.646+0000 7f268ec94640 1 -- 172.21.15.86:0/852820336 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f2674068380 msgr2=0x7f267406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:16.651 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.646+0000 7f268ec94640 1 --2- 172.21.15.86:0/852820336 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f2674068380 0x7f267406a840 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f26780ae000 tx=0x7f2678008040 comp rx=0 tx=0).stop 2024-04-25T12:22:16.651 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.646+0000 7f268ec94640 1 -- 172.21.15.86:0/852820336 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f268806c930 msgr2=0x7f2688146df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:16.652 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.646+0000 7f268ec94640 1 --2- 172.21.15.86:0/852820336 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f268806c930 0x7f2688146df0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f267c00d830 tx=0x7f267c00dcf0 comp rx=0 tx=0).stop 2024-04-25T12:22:16.652 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.646+0000 7f268ec94640 1 -- 172.21.15.86:0/852820336 shutdown_connections 2024-04-25T12:22:16.652 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.646+0000 7f268ec94640 1 --2- 172.21.15.86:0/852820336 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f26880c4b40 0x7f2688147330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:16.652 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.646+0000 7f268ec94640 1 --2- 172.21.15.86:0/852820336 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f2674068380 0x7f267406a840 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:16.652 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.646+0000 7f268ec94640 1 --2- 172.21.15.86:0/852820336 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f268806c930 0x7f2688146df0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:16.652 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.646+0000 7f268ec94640 1 --2- 172.21.15.86:0/852820336 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f268806c4f0 0x7f268814c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:16.652 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.646+0000 7f268ec94640 1 -- 172.21.15.86:0/852820336 >> 172.21.15.86:0/852820336 conn(0x7f268806b9d0 msgr2=0x7f2688071d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:16.652 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.646+0000 7f268ec94640 1 -- 172.21.15.86:0/852820336 shutdown_connections 2024-04-25T12:22:16.652 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:16.646+0000 7f268ec94640 1 -- 172.21.15.86:0/852820336 wait complete. 2024-04-25T12:22:17.272 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 19, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T12:21:23.459093+0000', 'modified': '2024-04-25T12:22:15.953239+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 4294, 'mds_1': 4262, 'mds_2': 4245, 'mds_3': 4239, 'mds_4': 4236}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4236': {'gid': 4236, 'name': 'a', 'rank': 4, 'incarnation': 18, 'state': 'up:active', 'state_seq': 16, 'addr': '172.21.15.86:6838/3213562806', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6836', 'nonce': 3213562806}, {'type': 'v1', 'addr': '172.21.15.86:6838', 'nonce': 3213562806}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4239': {'gid': 4239, 'name': 'c', 'rank': 3, 'incarnation': 16, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.86:6839/4002713597', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6837', 'nonce': 4002713597}, {'type': 'v1', 'addr': '172.21.15.86:6839', 'nonce': 4002713597}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4245': {'gid': 4245, 'name': 'd', 'rank': 2, 'incarnation': 14, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.134:6833/3114005030', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6832', 'nonce': 3114005030}, {'type': 'v1', 'addr': '172.21.15.134:6833', 'nonce': 3114005030}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4262': {'gid': 4262, 'name': 'b', 'rank': 1, 'incarnation': 10, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.134:6837/1079608447', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6835', 'nonce': 1079608447}, {'type': 'v1', 'addr': '172.21.15.134:6837', 'nonce': 1079608447}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4294': {'gid': 4294, 'name': 'f', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.134:6836/3044511437', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6834', 'nonce': 3044511437}, {'type': 'v1', 'addr': '172.21.15.134:6836', 'nonce': 3044511437}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4294, 'qdb_cluster': [4236, 4262, 4239, 4245, 4294]} 2024-04-25T12:22:17.272 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-04-25T12:22:17.273 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T12:22:17.404 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.402+0000 7f520f76f640 1 Processor -- start 2024-04-25T12:22:17.405 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.402+0000 7f520f76f640 1 -- start start 2024-04-25T12:22:17.406 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.402+0000 7f520f76f640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f52080c8630 0x7f5208151b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:17.406 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.402+0000 7f520f76f640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f520815b740 con 0x7f52080c8250 2024-04-25T12:22:17.406 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.402+0000 7f520f76f640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52080c40f0 con 0x7f52080c8a70 2024-04-25T12:22:17.406 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.402+0000 7f520f76f640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f52080c6490 con 0x7f52080c8630 2024-04-25T12:22:17.406 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.402+0000 7f520cd0a640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f52080c8630 0x7f5208151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:17.406 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.402+0000 7f520d50b640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f52080c8250 0x7f52080c39e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:43298/0 (socket says 172.21.15.86:43298) 2024-04-25T12:22:17.406 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.402+0000 7f520d50b640 1 -- 172.21.15.86:0/1254961094 learned_addr learned my addr 172.21.15.86:0/1254961094 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-04-25T12:22:17.407 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.402+0000 7f520cd0a640 1 -- 172.21.15.86:0/1254961094 >> v1:172.21.15.134:6789/0 conn(0x7f52080c8a70 legacy=0x7f5208152080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:17.407 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.402+0000 7f520cd0a640 1 -- 172.21.15.86:0/1254961094 >> v1:172.21.15.86:6789/0 conn(0x7f52080c8250 legacy=0x7f52080c39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:17.407 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.402+0000 7f520cd0a640 1 -- 172.21.15.86:0/1254961094 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52080c58c0 con 0x7f52080c8630 2024-04-25T12:22:17.408 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.406+0000 7f520cd0a640 1 --2- 172.21.15.86:0/1254961094 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52080c8630 0x7f5208151b40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f51f80097c0 tx=0x7f51f801c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=446503f3763b53f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:17.408 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.406+0000 7f51fffff640 1 -- 172.21.15.86:0/1254961094 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f80b0070 con 0x7f52080c8630 2024-04-25T12:22:17.408 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.406+0000 7f51fffff640 1 -- 172.21.15.86:0/1254961094 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51f80ab600 con 0x7f52080c8630 2024-04-25T12:22:17.408 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.406+0000 7f51fffff640 1 -- 172.21.15.86:0/1254961094 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f80ab9d0 con 0x7f52080c8630 2024-04-25T12:22:17.409 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.406+0000 7f520f76f640 1 -- 172.21.15.86:0/1254961094 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52080c8630 msgr2=0x7f5208151b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:17.409 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.406+0000 7f520f76f640 1 --2- 172.21.15.86:0/1254961094 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52080c8630 0x7f5208151b40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f51f80097c0 tx=0x7f51f801c260 comp rx=0 tx=0).stop 2024-04-25T12:22:17.409 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.406+0000 7f520f76f640 1 -- 172.21.15.86:0/1254961094 shutdown_connections 2024-04-25T12:22:17.409 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.406+0000 7f520f76f640 1 --2- 172.21.15.86:0/1254961094 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52080c8630 0x7f5208151b40 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:17.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.406+0000 7f520f76f640 1 -- 172.21.15.86:0/1254961094 >> 172.21.15.86:0/1254961094 conn(0x7f520806b9d0 msgr2=0x7f520806bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:17.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.406+0000 7f520f76f640 1 -- 172.21.15.86:0/1254961094 shutdown_connections 2024-04-25T12:22:17.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.406+0000 7f520f76f640 1 -- 172.21.15.86:0/1254961094 wait complete. 2024-04-25T12:22:17.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.406+0000 7f520f76f640 1 Processor -- start 2024-04-25T12:22:17.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.406+0000 7f520f76f640 1 -- start start 2024-04-25T12:22:17.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.410+0000 7f520f76f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52080c8250 0x7f52081530b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:17.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.410+0000 7f520f76f640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f52080c8630 0x7f520814e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:17.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.410+0000 7f520f76f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52080c8a70 0x7f52080736a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:17.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.410+0000 7f520f76f640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f520815b400 con 0x7f52080c8a70 2024-04-25T12:22:17.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.410+0000 7f520f76f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f52080721a0 con 0x7f52080c8250 2024-04-25T12:22:17.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.410+0000 7f520f76f640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f52080c6920 con 0x7f52080c8630 2024-04-25T12:22:17.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.410+0000 7f520dd0c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52080c8a70 0x7f52080736a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:17.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.410+0000 7f520dd0c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52080c8a70 0x7f52080736a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38624/0 (socket says 172.21.15.86:38624) 2024-04-25T12:22:17.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.410+0000 7f520dd0c640 1 -- 172.21.15.86:0/2712037205 learned_addr learned my addr 172.21.15.86:0/2712037205 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:17.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.410+0000 7f520d50b640 1 --2- 172.21.15.86:0/2712037205 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52080c8250 0x7f52081530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:17.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.410+0000 7f520cd0a640 1 --2- 172.21.15.86:0/2712037205 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f52080c8630 0x7f520814e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:17.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.410+0000 7f520dd0c640 1 -- 172.21.15.86:0/2712037205 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f52080c8630 msgr2=0x7f520814e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:17.414 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.410+0000 7f520dd0c640 1 --2- 172.21.15.86:0/2712037205 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f52080c8630 0x7f520814e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:17.414 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.410+0000 7f520dd0c640 1 -- 172.21.15.86:0/2712037205 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52080c8250 msgr2=0x7f52081530b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:17.414 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.410+0000 7f520dd0c640 1 --2- 172.21.15.86:0/2712037205 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52080c8250 0x7f52081530b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:17.414 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.410+0000 7f520dd0c640 1 -- 172.21.15.86:0/2712037205 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52081445d0 con 0x7f52080c8a70 2024-04-25T12:22:17.414 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.410+0000 7f520d50b640 1 --2- 172.21.15.86:0/2712037205 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52080c8250 0x7f52081530b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:22:17.414 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.410+0000 7f520dd0c640 1 --2- 172.21.15.86:0/2712037205 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52080c8a70 0x7f52080736a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f520000b970 tx=0x7f520000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:17.414 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.410+0000 7f51fdffb640 1 -- 172.21.15.86:0/2712037205 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5200019070 con 0x7f52080c8a70 2024-04-25T12:22:17.414 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.410+0000 7f51fdffb640 1 -- 172.21.15.86:0/2712037205 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f520000cb40 con 0x7f52080c8a70 2024-04-25T12:22:17.414 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.410+0000 7f520f76f640 1 -- 172.21.15.86:0/2712037205 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5208144890 con 0x7f52080c8a70 2024-04-25T12:22:17.414 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.410+0000 7f51fdffb640 1 -- 172.21.15.86:0/2712037205 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5200014440 con 0x7f52080c8a70 2024-04-25T12:22:17.414 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.410+0000 7f520f76f640 1 -- 172.21.15.86:0/2712037205 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f520814d9c0 con 0x7f52080c8a70 2024-04-25T12:22:17.415 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.410+0000 7f51fdffb640 1 -- 172.21.15.86:0/2712037205 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f520001c070 con 0x7f52080c8a70 2024-04-25T12:22:17.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.410+0000 7f51fdffb640 1 --2- 172.21.15.86:0/2712037205 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f51ec068380 0x7f51ec06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:17.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.410+0000 7f520d50b640 1 --2- 172.21.15.86:0/2712037205 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f51ec068380 0x7f51ec06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:17.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.410+0000 7f51fdffb640 1 -- 172.21.15.86:0/2712037205 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f52000869f0 con 0x7f52080c8a70 2024-04-25T12:22:17.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.414+0000 7f520d50b640 1 --2- 172.21.15.86:0/2712037205 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f51ec068380 0x7f51ec06a840 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5204000f70 tx=0x7f5204007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:17.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.414+0000 7f52128f1000 1 Processor -- start 2024-04-25T12:22:17.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.414+0000 7f52128f1000 1 -- start start 2024-04-25T12:22:17.418 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.414+0000 7f52128f1000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d6c3b6d190 0x55d6c3b6d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:17.418 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.414+0000 7f52128f1000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55d6c3b6dab0 0x55d6c3ba8080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:17.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.414+0000 7f52128f1000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6c3ba85c0 0x55d6c3ba89a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:17.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.414+0000 7f52128f1000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55d6c39b6420 con 0x55d6c3b6d190 2024-04-25T12:22:17.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.414+0000 7f52128f1000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55d6c3950bf0 con 0x55d6c3ba85c0 2024-04-25T12:22:17.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.414+0000 7f52128f1000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x55d6c39b23e0 con 0x55d6c3b6dab0 2024-04-25T12:22:17.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.414+0000 7f520d50b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d6c3b6d190 0x55d6c3b6d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:17.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.414+0000 7f520d50b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d6c3b6d190 0x55d6c3b6d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38630/0 (socket says 172.21.15.86:38630) 2024-04-25T12:22:17.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.414+0000 7f520d50b640 1 -- 172.21.15.86:0/1378835818 learned_addr learned my addr 172.21.15.86:0/1378835818 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:17.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.414+0000 7f520cd0a640 1 --2- 172.21.15.86:0/1378835818 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55d6c3b6dab0 0x55d6c3ba8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:17.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.414+0000 7f520dd0c640 1 --2- 172.21.15.86:0/1378835818 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6c3ba85c0 0x55d6c3ba89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:17.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.414+0000 7f520d50b640 1 -- 172.21.15.86:0/1378835818 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55d6c3b6dab0 msgr2=0x55d6c3ba8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:17.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.414+0000 7f520d50b640 1 --2- 172.21.15.86:0/1378835818 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55d6c3b6dab0 0x55d6c3ba8080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:17.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.414+0000 7f520d50b640 1 -- 172.21.15.86:0/1378835818 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6c3ba85c0 msgr2=0x55d6c3ba89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:17.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.414+0000 7f520d50b640 1 --2- 172.21.15.86:0/1378835818 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6c3ba85c0 0x55d6c3ba89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:17.420 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.414+0000 7f520d50b640 1 -- 172.21.15.86:0/1378835818 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6c3a5e450 con 0x55d6c3b6d190 2024-04-25T12:22:17.420 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.414+0000 7f520dd0c640 1 --2- 172.21.15.86:0/1378835818 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6c3ba85c0 0x55d6c3ba89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:22:17.420 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.414+0000 7f520d50b640 1 --2- 172.21.15.86:0/1378835818 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d6c3b6d190 0x55d6c3b6d570 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f52040077e0 tx=0x7f5204011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1e7d74c9033254a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:17.420 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.414+0000 7f51f2ffd640 1 -- 172.21.15.86:0/1378835818 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5204005050 con 0x55d6c3b6d190 2024-04-25T12:22:17.420 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.414+0000 7f51f2ffd640 1 -- 172.21.15.86:0/1378835818 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52040051f0 con 0x55d6c3b6d190 2024-04-25T12:22:17.420 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.414+0000 7f51f2ffd640 1 -- 172.21.15.86:0/1378835818 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52040055e0 con 0x55d6c3b6d190 2024-04-25T12:22:17.420 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.414+0000 7f52128f1000 1 -- 172.21.15.86:0/1378835818 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d6c3b6d190 msgr2=0x55d6c3b6d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:17.420 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.414+0000 7f52128f1000 1 --2- 172.21.15.86:0/1378835818 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d6c3b6d190 0x55d6c3b6d570 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f52040077e0 tx=0x7f5204011000 comp rx=0 tx=0).stop 2024-04-25T12:22:17.420 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.414+0000 7f52128f1000 1 -- 172.21.15.86:0/1378835818 shutdown_connections 2024-04-25T12:22:17.420 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.414+0000 7f52128f1000 1 --2- 172.21.15.86:0/1378835818 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6c3ba85c0 0x55d6c3ba89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:17.420 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.414+0000 7f52128f1000 1 --2- 172.21.15.86:0/1378835818 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55d6c3b6dab0 0x55d6c3ba8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:17.420 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.414+0000 7f52128f1000 1 --2- 172.21.15.86:0/1378835818 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d6c3b6d190 0x55d6c3b6d570 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:17.420 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.414+0000 7f52128f1000 1 -- 172.21.15.86:0/1378835818 >> 172.21.15.86:0/1378835818 conn(0x55d6c3ba4e40 msgr2=0x55d6c3ba7260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:17.420 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.414+0000 7f52128f1000 1 -- 172.21.15.86:0/1378835818 shutdown_connections 2024-04-25T12:22:17.420 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.414+0000 7f52128f1000 1 -- 172.21.15.86:0/1378835818 wait complete. 2024-04-25T12:22:17.421 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.414+0000 7f52128f1000 1 -- start start 2024-04-25T12:22:17.421 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.414+0000 7f52128f1000 1 Processor -- start 2024-04-25T12:22:17.423 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.418+0000 7f52128f1000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d6c3b6d190 0x55d6c3b69c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:17.424 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.418+0000 7f52128f1000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55d6c3b6dab0 0x55d6c3b6a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:17.424 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.418+0000 7f52128f1000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6c3ba85c0 0x55d6c3b6a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:17.424 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.418+0000 7f52128f1000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55d6c3956ec0 con 0x55d6c3b6d190 2024-04-25T12:22:17.424 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.418+0000 7f52128f1000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55d6c3a37120 con 0x55d6c3ba85c0 2024-04-25T12:22:17.424 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.418+0000 7f52128f1000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x55d6c39c1350 con 0x55d6c3b6dab0 2024-04-25T12:22:17.424 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.418+0000 7f52128f1000 10 client.0 _ll_register_callbacks cb 0x55d6c39934d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T12:22:17.424 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.418+0000 7f520d50b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d6c3b6d190 0x55d6c3b69c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:17.424 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.418+0000 7f520d50b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d6c3b6d190 0x55d6c3b69c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38636/0 (socket says 172.21.15.86:38636) 2024-04-25T12:22:17.424 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.418+0000 7f520d50b640 1 -- 172.21.15.86:0/3679700982 learned_addr learned my addr 172.21.15.86:0/3679700982 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:17.424 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.418+0000 7f520cd0a640 1 --2- 172.21.15.86:0/3679700982 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55d6c3b6dab0 0x55d6c3b6a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:17.424 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.418+0000 7f520d50b640 1 -- 172.21.15.86:0/3679700982 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55d6c3b6dab0 msgr2=0x55d6c3b6a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:17.424 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.418+0000 7f520dd0c640 1 --2- 172.21.15.86:0/3679700982 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6c3ba85c0 0x55d6c3b6a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:17.424 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.418+0000 7f520d50b640 1 --2- 172.21.15.86:0/3679700982 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55d6c3b6dab0 0x55d6c3b6a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:17.425 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.418+0000 7f520d50b640 1 -- 172.21.15.86:0/3679700982 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6c3ba85c0 msgr2=0x55d6c3b6a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:17.425 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.418+0000 7f520d50b640 1 --2- 172.21.15.86:0/3679700982 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6c3ba85c0 0x55d6c3b6a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:17.425 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.418+0000 7f520d50b640 1 -- 172.21.15.86:0/3679700982 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6c39fbf80 con 0x55d6c3b6d190 2024-04-25T12:22:17.425 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.418+0000 7f520d50b640 1 --2- 172.21.15.86:0/3679700982 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d6c3b6d190 0x55d6c3b69c20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x55d6c3a488e0 tx=0x7f5204000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b5201ef7cb2cd77 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:17.425 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.418+0000 7f51e7fff640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-04-25T12:22:17.425 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.418+0000 7f51e7fff640 1 -- 172.21.15.86:0/3679700982 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f520402a060 con 0x55d6c3b6d190 2024-04-25T12:22:17.425 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.418+0000 7f51e7fff640 1 -- 172.21.15.86:0/3679700982 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f5204021450 con 0x55d6c3b6d190 2024-04-25T12:22:17.425 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.418+0000 7f52128f1000 1 -- 172.21.15.86:0/3679700982 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52040051f0 con 0x55d6c3b6d190 2024-04-25T12:22:17.425 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.418+0000 7f51e7fff640 1 -- 172.21.15.86:0/3679700982 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f5204030050 con 0x55d6c3b6d190 2024-04-25T12:22:17.425 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.418+0000 7f52128f1000 10 client.4800 fetch_fsmap learned FSMap version 19 2024-04-25T12:22:17.425 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.418+0000 7f52128f1000 1 -- 172.21.15.86:0/3679700982 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55d6c398ff00 con 0x55d6c3b6d190 2024-04-25T12:22:17.425 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.418+0000 7f51e7fff640 1 -- 172.21.15.86:0/3679700982 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52040051f0 con 0x55d6c3b6d190 2024-04-25T12:22:17.425 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.418+0000 7f51e7fff640 1 -- 172.21.15.86:0/3679700982 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7f5204021650 con 0x55d6c3b6d190 2024-04-25T12:22:17.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.418+0000 7f52128f1000 10 client.4800 fetch_fsmap finished waiting for FSMap version 19 2024-04-25T12:22:17.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.418+0000 7f52128f1000 10 client.4800 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T12:22:17.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.418+0000 7f52128f1000 20 client.4800 populate_metadata read hostname 'smithi086' 2024-04-25T12:22:17.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.418+0000 7f52128f1000 1 --2- 172.21.15.86:0/3679700982 >> [v2:172.21.15.86:6836/3213562806,v1:172.21.15.86:6838/3213562806] conn(0x55d6c3bbcd90 0x55d6c3bbf180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:17.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.418+0000 7f52128f1000 4 client.4800 mds_command: new command op to 4236 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T12:22:17.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.418+0000 7f52128f1000 1 -- 172.21.15.86:0/3679700982 --> [v2:172.21.15.86:6836/3213562806,v1:172.21.15.86:6838/3213562806] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d6c394fbc0 con 0x55d6c3bbcd90 2024-04-25T12:22:17.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.418+0000 7f520cd0a640 1 --2- 172.21.15.86:0/3679700982 >> [v2:172.21.15.86:6836/3213562806,v1:172.21.15.86:6838/3213562806] conn(0x55d6c3bbcd90 0x55d6c3bbf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:17.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.418+0000 7f520cd0a640 1 -- 172.21.15.86:0/3679700982 >> [v2:172.21.15.86:6836/3213562806,v1:172.21.15.86:6838/3213562806] conn(0x55d6c3bbcd90 msgr2=0x55d6c3bbf180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 19 2024-04-25T12:22:17.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.418+0000 7f520cd0a640 1 -- 172.21.15.86:0/3679700982 >> [v2:172.21.15.86:6836/3213562806,v1:172.21.15.86:6838/3213562806] conn(0x55d6c3bbcd90 msgr2=0x55d6c3bbf180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T12:22:17.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.418+0000 7f520cd0a640 1 --2- 172.21.15.86:0/3679700982 >> [v2:172.21.15.86:6836/3213562806,v1:172.21.15.86:6838/3213562806] conn(0x55d6c3bbcd90 0x55d6c3bbf180 crc :-1 s=COMPRESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T12:22:17.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.418+0000 7f520cd0a640 1 --2- 172.21.15.86:0/3679700982 >> [v2:172.21.15.86:6836/3213562806,v1:172.21.15.86:6838/3213562806] conn(0x55d6c3bbcd90 0x55d6c3bbf180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T12:22:17.624 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.622+0000 7f520cd0a640 1 --2- 172.21.15.86:0/3679700982 >> [v2:172.21.15.86:6836/3213562806,v1:172.21.15.86:6838/3213562806] conn(0x55d6c3bbcd90 0x55d6c3bbf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:17.624 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.622+0000 7f520cd0a640 1 --2- 172.21.15.86:0/3679700982 >> [v2:172.21.15.86:6836/3213562806,v1:172.21.15.86:6838/3213562806] conn(0x55d6c3bbcd90 0x55d6c3bbf180 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=cbb160bda5ca50b4 server_cookie=6d310dc02a38f1bf in_seq=0 out_seq=0 2024-04-25T12:22:17.624 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:17.622+0000 7f51e7fff640 10 client.4800 ms_handle_connect on v2:172.21.15.86:6836/3213562806 2024-04-25T12:22:18.413 INFO:tasks.ceph.mds.f.smithi134.stderr:2024-04-25T12:22:18.410+0000 7f970442b640 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-04-25T12:22:20.968 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.966+0000 7f51e7fff640 1 -- 172.21.15.86:0/3679700982 <== mds.4 v2:172.21.15.86:6836/3213562806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d6c394fbc0 con 0x55d6c3bbcd90 2024-04-25T12:22:20.969 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.966+0000 7f51e7fff640 10 client.4800 handle_command_reply: tid=0 2024-04-25T12:22:20.969 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.966+0000 7f52128f1000 1 client.4800 shutdown 2024-04-25T12:22:20.969 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.966+0000 7f52128f1000 1 -- 172.21.15.86:0/3679700982 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d6c3b6d190 msgr2=0x55d6c3b69c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:20.969 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.966+0000 7f52128f1000 1 --2- 172.21.15.86:0/3679700982 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d6c3b6d190 0x55d6c3b69c20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x55d6c3a488e0 tx=0x7f5204000bd0 comp rx=0 tx=0).stop 2024-04-25T12:22:20.969 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.966+0000 7f52128f1000 1 -- 172.21.15.86:0/3679700982 shutdown_connections 2024-04-25T12:22:20.969 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.966+0000 7f52128f1000 1 --2- 172.21.15.86:0/3679700982 >> [v2:172.21.15.86:6836/3213562806,v1:172.21.15.86:6838/3213562806] conn(0x55d6c3bbcd90 0x55d6c3bbf180 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:20.969 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.966+0000 7f52128f1000 1 --2- 172.21.15.86:0/3679700982 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6c3ba85c0 0x55d6c3b6a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:20.969 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.966+0000 7f52128f1000 1 --2- 172.21.15.86:0/3679700982 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55d6c3b6dab0 0x55d6c3b6a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:20.969 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.966+0000 7f52128f1000 1 --2- 172.21.15.86:0/3679700982 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d6c3b6d190 0x55d6c3b69c20 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:20.969 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.966+0000 7f51e7fff640 0 client.4800 ms_handle_reset on v2:172.21.15.86:6836/3213562806 2024-04-25T12:22:20.969 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.966+0000 7f52128f1000 1 -- 172.21.15.86:0/3679700982 >> 172.21.15.86:0/3679700982 conn(0x55d6c3ba4e40 msgr2=0x55d6c3ba61c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:20.969 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.966+0000 7f52128f1000 1 -- 172.21.15.86:0/3679700982 shutdown_connections 2024-04-25T12:22:20.969 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.966+0000 7f52128f1000 1 -- 172.21.15.86:0/3679700982 wait complete. 2024-04-25T12:22:20.969 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.966+0000 7f52128f1000 20 client.4800 trim_cache size 0 max 16384 2024-04-25T12:22:20.994 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.990+0000 7f52128f1000 1 Processor -- start 2024-04-25T12:22:20.994 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.990+0000 7f52128f1000 1 -- start start 2024-04-25T12:22:20.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.990+0000 7f52128f1000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55d6c3b6d190 0x55d6c3bc21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:20.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.990+0000 7f52128f1000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d6c3b6dab0 0x55d6c3bc26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:20.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.990+0000 7f52128f1000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6c3ba85c0 0x55d6c3c18ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:20.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.990+0000 7f52128f1000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f52081ff3b0 con 0x55d6c3b6dab0 2024-04-25T12:22:20.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.990+0000 7f52128f1000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f52081ffa80 con 0x55d6c3ba85c0 2024-04-25T12:22:20.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.990+0000 7f52128f1000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f52081fdb30 con 0x55d6c3b6d190 2024-04-25T12:22:20.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.994+0000 7f520cd0a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d6c3b6dab0 0x55d6c3bc26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:20.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.994+0000 7f520cd0a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d6c3b6dab0 0x55d6c3bc26f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38638/0 (socket says 172.21.15.86:38638) 2024-04-25T12:22:20.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.994+0000 7f520cd0a640 1 -- 172.21.15.86:0/1758089457 learned_addr learned my addr 172.21.15.86:0/1758089457 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:20.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.994+0000 7f520d50b640 1 --2- 172.21.15.86:0/1758089457 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55d6c3b6d190 0x55d6c3bc21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:20.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.994+0000 7f520dd0c640 1 --2- 172.21.15.86:0/1758089457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6c3ba85c0 0x55d6c3c18ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:20.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.994+0000 7f520cd0a640 1 -- 172.21.15.86:0/1758089457 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55d6c3b6d190 msgr2=0x55d6c3bc21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:20.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.994+0000 7f520cd0a640 1 --2- 172.21.15.86:0/1758089457 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55d6c3b6d190 0x55d6c3bc21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:20.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.994+0000 7f520cd0a640 1 -- 172.21.15.86:0/1758089457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6c3ba85c0 msgr2=0x55d6c3c18ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:20.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.994+0000 7f520cd0a640 1 --2- 172.21.15.86:0/1758089457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6c3ba85c0 0x55d6c3c18ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:20.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.994+0000 7f520cd0a640 1 -- 172.21.15.86:0/1758089457 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6c393ce80 con 0x55d6c3b6dab0 2024-04-25T12:22:20.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.994+0000 7f520cd0a640 1 --2- 172.21.15.86:0/1758089457 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d6c3b6dab0 0x55d6c3bc26f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f51f8009580 tx=0x7f51f80a6000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6621ee94e2e6a56e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:20.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.994+0000 7f51f27fc640 1 -- 172.21.15.86:0/1758089457 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f80b0040 con 0x55d6c3b6dab0 2024-04-25T12:22:20.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.994+0000 7f51f27fc640 1 -- 172.21.15.86:0/1758089457 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51f80abc50 con 0x55d6c3b6dab0 2024-04-25T12:22:20.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.994+0000 7f51f27fc640 1 -- 172.21.15.86:0/1758089457 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f80c30d0 con 0x55d6c3b6dab0 2024-04-25T12:22:20.998 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.994+0000 7f52128f1000 1 -- 172.21.15.86:0/1758089457 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d6c3b6dab0 msgr2=0x55d6c3bc26f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:20.999 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.994+0000 7f52128f1000 1 --2- 172.21.15.86:0/1758089457 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d6c3b6dab0 0x55d6c3bc26f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f51f8009580 tx=0x7f51f80a6000 comp rx=0 tx=0).stop 2024-04-25T12:22:20.999 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.994+0000 7f52128f1000 1 -- 172.21.15.86:0/1758089457 shutdown_connections 2024-04-25T12:22:20.999 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.994+0000 7f52128f1000 1 --2- 172.21.15.86:0/1758089457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6c3ba85c0 0x55d6c3c18ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:20.999 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.994+0000 7f52128f1000 1 --2- 172.21.15.86:0/1758089457 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d6c3b6dab0 0x55d6c3bc26f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:20.999 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.994+0000 7f52128f1000 1 --2- 172.21.15.86:0/1758089457 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55d6c3b6d190 0x55d6c3bc21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:20.999 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.994+0000 7f52128f1000 1 -- 172.21.15.86:0/1758089457 >> 172.21.15.86:0/1758089457 conn(0x55d6c3ba4e40 msgr2=0x55d6c3ba3500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:20.999 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.994+0000 7f52128f1000 1 -- 172.21.15.86:0/1758089457 shutdown_connections 2024-04-25T12:22:20.999 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.994+0000 7f52128f1000 1 -- 172.21.15.86:0/1758089457 wait complete. 2024-04-25T12:22:20.999 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.994+0000 7f52128f1000 1 -- start start 2024-04-25T12:22:21.000 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.998+0000 7f52128f1000 1 Processor -- start 2024-04-25T12:22:21.004 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.998+0000 7f52128f1000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6c3b6d190 0x55d6c3bc21c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.004 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.998+0000 7f52128f1000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d6c3b6dab0 0x55d6c3c1c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.004 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.998+0000 7f52128f1000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55d6c3ba85c0 0x55d6c3c1ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.004 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.998+0000 7f52128f1000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55d6c39b5730 con 0x55d6c3b6dab0 2024-04-25T12:22:21.004 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.998+0000 7f52128f1000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55d6c39829e0 con 0x55d6c3b6d190 2024-04-25T12:22:21.004 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.998+0000 7f52128f1000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x55d6c39baa50 con 0x55d6c3ba85c0 2024-04-25T12:22:21.004 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.998+0000 7f520cd0a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d6c3b6dab0 0x55d6c3c1c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.004 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.998+0000 7f52128f1000 10 client.0 _ll_register_callbacks cb 0x7f52040076e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T12:22:21.004 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.998+0000 7f520cd0a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d6c3b6dab0 0x55d6c3c1c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38644/0 (socket says 172.21.15.86:38644) 2024-04-25T12:22:21.004 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.998+0000 7f520cd0a640 1 -- 172.21.15.86:0/628176498 learned_addr learned my addr 172.21.15.86:0/628176498 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:21.004 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.998+0000 7f520dd0c640 1 --2- 172.21.15.86:0/628176498 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55d6c3ba85c0 0x55d6c3c1ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.004 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.998+0000 7f520d50b640 1 --2- 172.21.15.86:0/628176498 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6c3b6d190 0x55d6c3bc21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.005 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.998+0000 7f520cd0a640 1 -- 172.21.15.86:0/628176498 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55d6c3ba85c0 msgr2=0x55d6c3c1ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:21.005 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.998+0000 7f520cd0a640 1 --2- 172.21.15.86:0/628176498 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55d6c3ba85c0 0x55d6c3c1ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.005 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.998+0000 7f520cd0a640 1 -- 172.21.15.86:0/628176498 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6c3b6d190 msgr2=0x55d6c3bc21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:21.005 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.998+0000 7f520cd0a640 1 --2- 172.21.15.86:0/628176498 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6c3b6d190 0x55d6c3bc21c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.005 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.998+0000 7f520cd0a640 1 -- 172.21.15.86:0/628176498 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6c397eb30 con 0x55d6c3b6dab0 2024-04-25T12:22:21.005 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.998+0000 7f520cd0a640 1 --2- 172.21.15.86:0/628176498 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d6c3b6dab0 0x55d6c3c1c950 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f51f8018e70 tx=0x7f51f801aaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a195e04ce71cae8c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:21.005 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.998+0000 7f51e7fff640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-04-25T12:22:21.005 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.998+0000 7f51e7fff640 1 -- 172.21.15.86:0/628176498 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f80b0040 con 0x55d6c3b6dab0 2024-04-25T12:22:21.005 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.998+0000 7f51e7fff640 1 -- 172.21.15.86:0/628176498 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f51f80aba50 con 0x55d6c3b6dab0 2024-04-25T12:22:21.005 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.998+0000 7f52128f1000 1 -- 172.21.15.86:0/628176498 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51f80abc50 con 0x55d6c3b6dab0 2024-04-25T12:22:21.005 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.998+0000 7f51e7fff640 1 -- 172.21.15.86:0/628176498 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f51f8004030 con 0x55d6c3b6dab0 2024-04-25T12:22:21.005 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.998+0000 7f52128f1000 10 client.4806 fetch_fsmap learned FSMap version 19 2024-04-25T12:22:21.005 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.998+0000 7f52128f1000 1 -- 172.21.15.86:0/628176498 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55d6c3a375b0 con 0x55d6c3b6dab0 2024-04-25T12:22:21.006 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.998+0000 7f51e7fff640 1 -- 172.21.15.86:0/628176498 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51f80abc50 con 0x55d6c3b6dab0 2024-04-25T12:22:21.006 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.998+0000 7f51e7fff640 1 -- 172.21.15.86:0/628176498 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7f51f80c0070 con 0x55d6c3b6dab0 2024-04-25T12:22:21.006 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.998+0000 7f52128f1000 10 client.4806 fetch_fsmap finished waiting for FSMap version 19 2024-04-25T12:22:21.006 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.998+0000 7f52128f1000 10 client.4806 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T12:22:21.006 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.998+0000 7f52128f1000 20 client.4806 populate_metadata read hostname 'smithi086' 2024-04-25T12:22:21.006 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.998+0000 7f52128f1000 1 --2- 172.21.15.86:0/628176498 >> [v2:172.21.15.86:6836/3213562806,v1:172.21.15.86:6838/3213562806] conn(0x55d6c3c1b520 0x55d6c3c1b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.006 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.998+0000 7f52128f1000 4 client.4806 mds_command: new command op to 4236 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T12:22:21.006 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.998+0000 7f52128f1000 1 -- 172.21.15.86:0/628176498 --> [v2:172.21.15.86:6836/3213562806,v1:172.21.15.86:6838/3213562806] -- command(tid 0: {"prefix": "status"}) -- 0x55d6c39c3e40 con 0x55d6c3c1b520 2024-04-25T12:22:21.006 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.998+0000 7f520d50b640 1 --2- 172.21.15.86:0/628176498 >> [v2:172.21.15.86:6836/3213562806,v1:172.21.15.86:6838/3213562806] conn(0x55d6c3c1b520 0x55d6c3c1b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.006 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.998+0000 7f520d50b640 1 --2- 172.21.15.86:0/628176498 >> [v2:172.21.15.86:6836/3213562806,v1:172.21.15.86:6838/3213562806] conn(0x55d6c3c1b520 0x55d6c3c1b900 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=81c217a754379bea server_cookie=9c5e51c0f71bd0ba in_seq=0 out_seq=0 2024-04-25T12:22:21.006 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:20.998+0000 7f51e7fff640 10 client.4806 ms_handle_connect on v2:172.21.15.86:6836/3213562806 2024-04-25T12:22:21.006 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.002+0000 7f51e7fff640 1 -- 172.21.15.86:0/628176498 <== mds.4 v2:172.21.15.86:6836/3213562806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55d6c39c3e40 con 0x55d6c3c1b520 2024-04-25T12:22:21.006 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.002+0000 7f51e7fff640 10 client.4806 handle_command_reply: tid=0 2024-04-25T12:22:21.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.002+0000 7f52128f1000 1 client.4806 shutdown 2024-04-25T12:22:21.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.002+0000 7f52128f1000 1 -- 172.21.15.86:0/628176498 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d6c3b6dab0 msgr2=0x55d6c3c1c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:21.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.002+0000 7f52128f1000 1 --2- 172.21.15.86:0/628176498 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d6c3b6dab0 0x55d6c3c1c950 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f51f8018e70 tx=0x7f51f801aaa0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.002+0000 7f52128f1000 1 -- 172.21.15.86:0/628176498 shutdown_connections 2024-04-25T12:22:21.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.002+0000 7f52128f1000 1 --2- 172.21.15.86:0/628176498 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55d6c3ba85c0 0x55d6c3c1ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.002+0000 7f52128f1000 1 --2- 172.21.15.86:0/628176498 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d6c3b6dab0 0x55d6c3c1c950 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.002+0000 7f52128f1000 1 --2- 172.21.15.86:0/628176498 >> [v2:172.21.15.86:6836/3213562806,v1:172.21.15.86:6838/3213562806] conn(0x55d6c3c1b520 0x55d6c3c1b900 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.002+0000 7f52128f1000 1 --2- 172.21.15.86:0/628176498 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6c3b6d190 0x55d6c3bc21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.002+0000 7f51e7fff640 0 client.4806 ms_handle_reset on v2:172.21.15.86:6836/3213562806 2024-04-25T12:22:21.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.002+0000 7f52128f1000 1 -- 172.21.15.86:0/628176498 >> 172.21.15.86:0/628176498 conn(0x55d6c3ba4e40 msgr2=0x55d6c3ba2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:21.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.002+0000 7f52128f1000 1 -- 172.21.15.86:0/628176498 shutdown_connections 2024-04-25T12:22:21.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.002+0000 7f52128f1000 1 -- 172.21.15.86:0/628176498 wait complete. 2024-04-25T12:22:21.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.002+0000 7f52128f1000 20 client.4806 trim_cache size 0 max 16384 2024-04-25T12:22:21.008 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-25T12:22:21.008 INFO:teuthology.orchestra.run.smithi086.stdout: "cluster_fsid": "f2ef5c0c-9576-4650-b4f7-6cb14247f62a", 2024-04-25T12:22:21.008 INFO:teuthology.orchestra.run.smithi086.stdout: "whoami": 4, 2024-04-25T12:22:21.008 INFO:teuthology.orchestra.run.smithi086.stdout: "id": 4236, 2024-04-25T12:22:21.008 INFO:teuthology.orchestra.run.smithi086.stdout: "want_state": "up:active", 2024-04-25T12:22:21.008 INFO:teuthology.orchestra.run.smithi086.stdout: "state": "up:active", 2024-04-25T12:22:21.008 INFO:teuthology.orchestra.run.smithi086.stdout: "fs_name": "cephfs", 2024-04-25T12:22:21.008 INFO:teuthology.orchestra.run.smithi086.stdout: "rank_uptime": 11.068740778, 2024-04-25T12:22:21.008 INFO:teuthology.orchestra.run.smithi086.stdout: "mdsmap_epoch": 19, 2024-04-25T12:22:21.008 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch": 26, 2024-04-25T12:22:21.008 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch_barrier": 26, 2024-04-25T12:22:21.008 INFO:teuthology.orchestra.run.smithi086.stdout: "uptime": 63.616550484999998 2024-04-25T12:22:21.009 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-25T12:22:21.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.002+0000 7f520f76f640 1 -- 172.21.15.86:0/2712037205 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f51ec068380 msgr2=0x7f51ec06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:21.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.002+0000 7f520f76f640 1 --2- 172.21.15.86:0/2712037205 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f51ec068380 0x7f51ec06a840 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5204000f70 tx=0x7f5204007d30 comp rx=0 tx=0).stop 2024-04-25T12:22:21.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.002+0000 7f520f76f640 1 -- 172.21.15.86:0/2712037205 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52080c8a70 msgr2=0x7f52080736a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:21.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.002+0000 7f520f76f640 1 --2- 172.21.15.86:0/2712037205 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52080c8a70 0x7f52080736a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f520000b970 tx=0x7f520000be30 comp rx=0 tx=0).stop 2024-04-25T12:22:21.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.002+0000 7f520f76f640 1 -- 172.21.15.86:0/2712037205 shutdown_connections 2024-04-25T12:22:21.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.002+0000 7f520f76f640 1 --2- 172.21.15.86:0/2712037205 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f51ec068380 0x7f51ec06a840 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.002+0000 7f520f76f640 1 --2- 172.21.15.86:0/2712037205 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52080c8a70 0x7f52080736a0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.002+0000 7f520f76f640 1 --2- 172.21.15.86:0/2712037205 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f52080c8630 0x7f520814e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.002+0000 7f520f76f640 1 --2- 172.21.15.86:0/2712037205 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52080c8250 0x7f52081530b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.002+0000 7f520f76f640 1 -- 172.21.15.86:0/2712037205 >> 172.21.15.86:0/2712037205 conn(0x7f520806b9d0 msgr2=0x7f520806eff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:21.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.002+0000 7f520f76f640 1 -- 172.21.15.86:0/2712037205 shutdown_connections 2024-04-25T12:22:21.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.002+0000 7f520f76f640 1 -- 172.21.15.86:0/2712037205 wait complete. 2024-04-25T12:22:21.024 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-25T12:22:21.144 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.142+0000 7f35e23d3640 1 Processor -- start 2024-04-25T12:22:21.144 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.142+0000 7f35e23d3640 1 -- start start 2024-04-25T12:22:21.147 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.142+0000 7f35e23d3640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f35dc0cda50 0x7f35dc0c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.147 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.142+0000 7f35e23d3640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f35dc15b0b0 0x7f35dc15b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.147 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.142+0000 7f35e23d3640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35dc15beb0 con 0x7f35dc155350 2024-04-25T12:22:21.147 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.142+0000 7f35e23d3640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f35dc0cca40 con 0x7f35dc0cda50 2024-04-25T12:22:21.147 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.142+0000 7f35e23d3640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f35dc0ccc90 con 0x7f35dc15b0b0 2024-04-25T12:22:21.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.142+0000 7f35dbfff640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f35dc155350 0x7f35dc0cb7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:43308/0 (socket says 172.21.15.86:43308) 2024-04-25T12:22:21.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.142+0000 7f35dbfff640 1 -- 172.21.15.86:0/3549867385 learned_addr learned my addr 172.21.15.86:0/3549867385 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-04-25T12:22:21.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.142+0000 7f35daffd640 1 -- 172.21.15.86:0/3549867385 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 106729503 0 0) 0x7f35dc15beb0 con 0x7f35dc155350 2024-04-25T12:22:21.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.142+0000 7f35daffd640 1 -- 172.21.15.86:0/3549867385 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35c8003530 con 0x7f35dc155350 2024-04-25T12:22:21.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.142+0000 7f35db7fe640 1 --2- 172.21.15.86:0/3549867385 >> v2:172.21.15.134:3300/0 conn(0x7f35dc0cda50 0x7f35dc0c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.142+0000 7f35e0970640 1 --2- 172.21.15.86:0/3549867385 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f35dc15b0b0 0x7f35dc15b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.142+0000 7f35daffd640 1 -- 172.21.15.86:0/3549867385 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 368210433 0 0) 0x7f35c8003530 con 0x7f35dc155350 2024-04-25T12:22:21.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.142+0000 7f35daffd640 1 -- 172.21.15.86:0/3549867385 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f35dc15b0b0 msgr2=0x7f35dc15b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:21.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.142+0000 7f35daffd640 1 --2- 172.21.15.86:0/3549867385 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f35dc15b0b0 0x7f35dc15b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.142+0000 7f35daffd640 1 -- 172.21.15.86:0/3549867385 >> v2:172.21.15.134:3300/0 conn(0x7f35dc0cda50 msgr2=0x7f35dc0c59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:21.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.142+0000 7f35daffd640 1 --2- 172.21.15.86:0/3549867385 >> v2:172.21.15.134:3300/0 conn(0x7f35dc0cda50 0x7f35dc0c59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.142+0000 7f35daffd640 1 -- 172.21.15.86:0/3549867385 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35dc0ccf70 con 0x7f35dc155350 2024-04-25T12:22:21.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.142+0000 7f35daffd640 1 -- 172.21.15.86:0/3549867385 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1387950573 0 0) 0x7f35cc001680 con 0x7f35dc155350 2024-04-25T12:22:21.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.142+0000 7f35daffd640 1 -- 172.21.15.86:0/3549867385 >> v1:172.21.15.86:6789/0 conn(0x7f35dc155350 legacy=0x7f35dc0cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:21.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.142+0000 7f35daffd640 1 --2- 172.21.15.86:0/3549867385 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35c80039c0 0x7f35c8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.142+0000 7f35daffd640 1 --2- 172.21.15.86:0/3549867385 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f35dc15b0b0 0x7f35c8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.142+0000 7f35daffd640 1 --2- 172.21.15.86:0/3549867385 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35c8004d50 0x7f35c80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.142+0000 7f35daffd640 1 -- 172.21.15.86:0/3549867385 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f35dc0cca40 con 0x7f35c80039c0 2024-04-25T12:22:21.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.142+0000 7f35daffd640 1 -- 172.21.15.86:0/3549867385 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f35dc0ccc90 con 0x7f35c8004d50 2024-04-25T12:22:21.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.142+0000 7f35daffd640 1 -- 172.21.15.86:0/3549867385 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f35c800b9d0 con 0x7f35dc15b0b0 2024-04-25T12:22:21.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.142+0000 7f35dbfff640 1 --2- 172.21.15.86:0/3549867385 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35c80039c0 0x7f35c8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.142+0000 7f35db7fe640 1 --2- 172.21.15.86:0/3549867385 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f35dc15b0b0 0x7f35c8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.142+0000 7f35e0970640 1 --2- 172.21.15.86:0/3549867385 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35c8004d50 0x7f35c80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.142+0000 7f35dbfff640 1 -- 172.21.15.86:0/3549867385 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f35dc15b0b0 msgr2=0x7f35c8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:21.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.142+0000 7f35dbfff640 1 --2- 172.21.15.86:0/3549867385 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f35dc15b0b0 0x7f35c8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.142+0000 7f35dbfff640 1 -- 172.21.15.86:0/3549867385 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35c8004d50 msgr2=0x7f35c80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:21.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.142+0000 7f35dbfff640 1 --2- 172.21.15.86:0/3549867385 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35c8004d50 0x7f35c80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.142+0000 7f35dbfff640 1 -- 172.21.15.86:0/3549867385 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35c8003530 con 0x7f35c80039c0 2024-04-25T12:22:21.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.142+0000 7f35e0970640 1 --2- 172.21.15.86:0/3549867385 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35c8004d50 0x7f35c80051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:22:21.151 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.146+0000 7f35dbfff640 1 --2- 172.21.15.86:0/3549867385 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35c80039c0 0x7f35c8003de0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f35cc001060 tx=0x7f35cc01f410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53bf1e6b81d12a13 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:21.151 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.146+0000 7f35daffd640 1 -- 172.21.15.86:0/3549867385 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35cc007d80 con 0x7f35c80039c0 2024-04-25T12:22:21.151 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.146+0000 7f35daffd640 1 -- 172.21.15.86:0/3549867385 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35cc005b00 con 0x7f35c80039c0 2024-04-25T12:22:21.151 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.146+0000 7f35daffd640 1 -- 172.21.15.86:0/3549867385 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35cc007070 con 0x7f35c80039c0 2024-04-25T12:22:21.151 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.146+0000 7f35e23d3640 1 -- 172.21.15.86:0/3549867385 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35c80039c0 msgr2=0x7f35c8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:21.151 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.146+0000 7f35e23d3640 1 --2- 172.21.15.86:0/3549867385 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35c80039c0 0x7f35c8003de0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f35cc001060 tx=0x7f35cc01f410 comp rx=0 tx=0).stop 2024-04-25T12:22:21.151 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.146+0000 7f35e0970640 1 -- 172.21.15.86:0/3549867385 reap_dead start 2024-04-25T12:22:21.151 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.146+0000 7f35e23d3640 1 -- 172.21.15.86:0/3549867385 shutdown_connections 2024-04-25T12:22:21.151 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.146+0000 7f35e23d3640 1 -- 172.21.15.86:0/3549867385 >> 172.21.15.86:0/3549867385 conn(0x7f35dc06cc30 msgr2=0x7f35dc06d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:21.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.146+0000 7f35e23d3640 1 -- 172.21.15.86:0/3549867385 shutdown_connections 2024-04-25T12:22:21.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.146+0000 7f35e23d3640 1 -- 172.21.15.86:0/3549867385 wait complete. 2024-04-25T12:22:21.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.146+0000 7f35e23d3640 1 Processor -- start 2024-04-25T12:22:21.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.146+0000 7f35e23d3640 1 -- start start 2024-04-25T12:22:21.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.150+0000 7f35e23d3640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35c80039c0 0x7f35dc156c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.150+0000 7f35e23d3640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f35dc154890 0x7f35dc1f0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.150+0000 7f35e23d3640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35dc151140 0x7f35dc15d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.150+0000 7f35e23d3640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f35dc155730 con 0x7f35dc151140 2024-04-25T12:22:21.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.150+0000 7f35e23d3640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f35dc0cd530 con 0x7f35c80039c0 2024-04-25T12:22:21.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.150+0000 7f35e23d3640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f35dc15e860 con 0x7f35dc154890 2024-04-25T12:22:21.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.150+0000 7f35e0970640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35dc151140 0x7f35dc15d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.150+0000 7f35e0970640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35dc151140 0x7f35dc15d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38650/0 (socket says 172.21.15.86:38650) 2024-04-25T12:22:21.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.150+0000 7f35e0970640 1 -- 172.21.15.86:0/2416565919 learned_addr learned my addr 172.21.15.86:0/2416565919 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:21.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.150+0000 7f35db7fe640 1 --2- 172.21.15.86:0/2416565919 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f35dc154890 0x7f35dc1f0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.150+0000 7f35dbfff640 1 --2- 172.21.15.86:0/2416565919 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35c80039c0 0x7f35dc156c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.150+0000 7f35e0970640 1 -- 172.21.15.86:0/2416565919 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f35dc154890 msgr2=0x7f35dc1f0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:21.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.150+0000 7f35e0970640 1 --2- 172.21.15.86:0/2416565919 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f35dc154890 0x7f35dc1f0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.150+0000 7f35e0970640 1 -- 172.21.15.86:0/2416565919 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35c80039c0 msgr2=0x7f35dc156c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:21.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.150+0000 7f35e0970640 1 --2- 172.21.15.86:0/2416565919 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35c80039c0 0x7f35dc156c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.150+0000 7f35e0970640 1 -- 172.21.15.86:0/2416565919 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35dc1f12a0 con 0x7f35dc151140 2024-04-25T12:22:21.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.150+0000 7f35e0970640 1 --2- 172.21.15.86:0/2416565919 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35dc151140 0x7f35dc15d730 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f35dc06d2c0 tx=0x7f35d40101c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:21.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.150+0000 7f35d8ff9640 1 -- 172.21.15.86:0/2416565919 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d4010b80 con 0x7f35dc151140 2024-04-25T12:22:21.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.150+0000 7f35d8ff9640 1 -- 172.21.15.86:0/2416565919 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35d4010d20 con 0x7f35dc151140 2024-04-25T12:22:21.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.150+0000 7f35e23d3640 1 -- 172.21.15.86:0/2416565919 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35dc1542f0 con 0x7f35dc151140 2024-04-25T12:22:21.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.150+0000 7f35d8ff9640 1 -- 172.21.15.86:0/2416565919 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d4003be0 con 0x7f35dc151140 2024-04-25T12:22:21.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.150+0000 7f35e23d3640 1 -- 172.21.15.86:0/2416565919 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35dc1545b0 con 0x7f35dc151140 2024-04-25T12:22:21.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.150+0000 7f35d8ff9640 1 -- 172.21.15.86:0/2416565919 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f35d401e020 con 0x7f35dc151140 2024-04-25T12:22:21.158 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.150+0000 7f35d8ff9640 1 --2- 172.21.15.86:0/2416565919 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f35bc0683b0 0x7f35bc06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.158 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.150+0000 7f35d8ff9640 1 -- 172.21.15.86:0/2416565919 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f35d40872d0 con 0x7f35dc151140 2024-04-25T12:22:21.158 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.150+0000 7f35dbfff640 1 --2- 172.21.15.86:0/2416565919 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f35bc0683b0 0x7f35bc06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.158 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.154+0000 7f35dbfff640 1 --2- 172.21.15.86:0/2416565919 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f35bc0683b0 0x7f35bc06a870 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f35cc0ae000 tx=0x7f35cc0b4040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:21.158 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.154+0000 7f35e5555000 1 Processor -- start 2024-04-25T12:22:21.159 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.154+0000 7f35e5555000 1 -- start start 2024-04-25T12:22:21.159 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.154+0000 7f35e5555000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bec7d05190 0x55bec7d05570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.159 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.154+0000 7f35e5555000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bec7d05ab0 0x55bec7d40080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.159 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.154+0000 7f35e5555000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55bec7d405c0 0x55bec7d409a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.159 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.154+0000 7f35e5555000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55bec7b4e420 con 0x55bec7d05ab0 2024-04-25T12:22:21.159 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.154+0000 7f35e5555000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55bec7ae8bf0 con 0x55bec7d05190 2024-04-25T12:22:21.159 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.154+0000 7f35e5555000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x55bec7b4a3e0 con 0x55bec7d405c0 2024-04-25T12:22:21.159 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.154+0000 7f35db7fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bec7d05ab0 0x55bec7d40080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.159 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.154+0000 7f35db7fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bec7d05ab0 0x55bec7d40080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38656/0 (socket says 172.21.15.86:38656) 2024-04-25T12:22:21.159 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.154+0000 7f35db7fe640 1 -- 172.21.15.86:0/757198663 learned_addr learned my addr 172.21.15.86:0/757198663 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:21.159 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.154+0000 7f35dbfff640 1 --2- 172.21.15.86:0/757198663 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bec7d05190 0x55bec7d05570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.159 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.154+0000 7f35e0970640 1 --2- 172.21.15.86:0/757198663 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55bec7d405c0 0x55bec7d409a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.159 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.154+0000 7f35db7fe640 1 -- 172.21.15.86:0/757198663 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55bec7d405c0 msgr2=0x55bec7d409a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:21.159 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.154+0000 7f35db7fe640 1 --2- 172.21.15.86:0/757198663 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55bec7d405c0 0x55bec7d409a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.160 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.154+0000 7f35db7fe640 1 -- 172.21.15.86:0/757198663 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bec7d05190 msgr2=0x55bec7d05570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:21.160 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.154+0000 7f35db7fe640 1 --2- 172.21.15.86:0/757198663 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bec7d05190 0x55bec7d05570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.160 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.154+0000 7f35db7fe640 1 -- 172.21.15.86:0/757198663 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bec7bf6450 con 0x55bec7d05ab0 2024-04-25T12:22:21.160 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.154+0000 7f35dbfff640 1 --2- 172.21.15.86:0/757198663 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bec7d05190 0x55bec7d05570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:22:21.160 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.154+0000 7f35db7fe640 1 --2- 172.21.15.86:0/757198663 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bec7d05ab0 0x55bec7d40080 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f35c4009c50 tx=0x7f35c4014780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f815a998cc4538 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:21.160 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.154+0000 7f35d1ffb640 1 -- 172.21.15.86:0/757198663 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35c4022070 con 0x55bec7d05ab0 2024-04-25T12:22:21.160 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.154+0000 7f35d1ffb640 1 -- 172.21.15.86:0/757198663 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35c401d440 con 0x55bec7d05ab0 2024-04-25T12:22:21.160 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.154+0000 7f35d1ffb640 1 -- 172.21.15.86:0/757198663 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35c401d830 con 0x55bec7d05ab0 2024-04-25T12:22:21.160 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.154+0000 7f35e5555000 1 -- 172.21.15.86:0/757198663 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bec7d05ab0 msgr2=0x55bec7d40080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:21.160 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.154+0000 7f35e5555000 1 --2- 172.21.15.86:0/757198663 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bec7d05ab0 0x55bec7d40080 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f35c4009c50 tx=0x7f35c4014780 comp rx=0 tx=0).stop 2024-04-25T12:22:21.160 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.154+0000 7f35e5555000 1 -- 172.21.15.86:0/757198663 shutdown_connections 2024-04-25T12:22:21.160 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.154+0000 7f35e5555000 1 --2- 172.21.15.86:0/757198663 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55bec7d405c0 0x55bec7d409a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.160 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.154+0000 7f35e5555000 1 --2- 172.21.15.86:0/757198663 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bec7d05ab0 0x55bec7d40080 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.160 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.154+0000 7f35e5555000 1 --2- 172.21.15.86:0/757198663 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bec7d05190 0x55bec7d05570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.160 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.154+0000 7f35e5555000 1 -- 172.21.15.86:0/757198663 >> 172.21.15.86:0/757198663 conn(0x55bec7d3ce40 msgr2=0x55bec7d3f260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:21.161 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.154+0000 7f35e5555000 1 -- 172.21.15.86:0/757198663 shutdown_connections 2024-04-25T12:22:21.161 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.154+0000 7f35e5555000 1 -- 172.21.15.86:0/757198663 wait complete. 2024-04-25T12:22:21.161 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.154+0000 7f35e5555000 1 -- start start 2024-04-25T12:22:21.161 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.154+0000 7f35e5555000 1 Processor -- start 2024-04-25T12:22:21.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.154+0000 7f35e5555000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bec7d05190 0x55bec7d01bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.154+0000 7f35e5555000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bec7d05ab0 0x55bec7d020f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.154+0000 7f35e5555000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55bec7d405c0 0x55bec7d02630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.154+0000 7f35e5555000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55bec7aeeec0 con 0x55bec7d05190 2024-04-25T12:22:21.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.154+0000 7f35e5555000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55bec7bcf120 con 0x55bec7d05ab0 2024-04-25T12:22:21.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.154+0000 7f35e5555000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x55bec7b59350 con 0x55bec7d405c0 2024-04-25T12:22:21.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.154+0000 7f35e5555000 10 client.0 _ll_register_callbacks cb 0x55bec7b2b4d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T12:22:21.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.154+0000 7f35dbfff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bec7d05190 0x55bec7d01bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.154+0000 7f35dbfff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bec7d05190 0x55bec7d01bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38670/0 (socket says 172.21.15.86:38670) 2024-04-25T12:22:21.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.154+0000 7f35dbfff640 1 -- 172.21.15.86:0/2612820417 learned_addr learned my addr 172.21.15.86:0/2612820417 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:21.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.158+0000 7f35e0970640 1 --2- 172.21.15.86:0/2612820417 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55bec7d405c0 0x55bec7d02630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.158+0000 7f35db7fe640 1 --2- 172.21.15.86:0/2612820417 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bec7d05ab0 0x55bec7d020f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.158+0000 7f35dbfff640 1 -- 172.21.15.86:0/2612820417 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55bec7d405c0 msgr2=0x55bec7d02630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:21.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.158+0000 7f35dbfff640 1 --2- 172.21.15.86:0/2612820417 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55bec7d405c0 0x55bec7d02630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.158+0000 7f35dbfff640 1 -- 172.21.15.86:0/2612820417 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bec7d05ab0 msgr2=0x55bec7d020f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:21.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.158+0000 7f35dbfff640 1 --2- 172.21.15.86:0/2612820417 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bec7d05ab0 0x55bec7d020f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.158+0000 7f35dbfff640 1 -- 172.21.15.86:0/2612820417 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bec7b93f80 con 0x55bec7d05190 2024-04-25T12:22:21.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.158+0000 7f35db7fe640 1 --2- 172.21.15.86:0/2612820417 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bec7d05ab0 0x55bec7d020f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:22:21.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.158+0000 7f35dbfff640 1 --2- 172.21.15.86:0/2612820417 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bec7d05190 0x55bec7d01bb0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f35cc01f450 tx=0x7f35cc01c1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=497fcd0aa4def686 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:21.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.158+0000 7f35baffd640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-04-25T12:22:21.166 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.158+0000 7f35baffd640 1 -- 172.21.15.86:0/2612820417 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35cc0cb060 con 0x55bec7d05190 2024-04-25T12:22:21.166 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.158+0000 7f35baffd640 1 -- 172.21.15.86:0/2612820417 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f35cc005c90 con 0x55bec7d05190 2024-04-25T12:22:21.166 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.158+0000 7f35e5555000 1 -- 172.21.15.86:0/2612820417 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f35c401d440 con 0x55bec7d05190 2024-04-25T12:22:21.166 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.158+0000 7f35baffd640 1 -- 172.21.15.86:0/2612820417 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f35cc0d1050 con 0x55bec7d05190 2024-04-25T12:22:21.166 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.158+0000 7f35e5555000 10 client.4818 fetch_fsmap learned FSMap version 19 2024-04-25T12:22:21.166 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.158+0000 7f35e5555000 1 -- 172.21.15.86:0/2612820417 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55bec7b27f00 con 0x55bec7d05190 2024-04-25T12:22:21.166 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.158+0000 7f35baffd640 1 -- 172.21.15.86:0/2612820417 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35c401d440 con 0x55bec7d05190 2024-04-25T12:22:21.166 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.158+0000 7f35baffd640 1 -- 172.21.15.86:0/2612820417 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7f35cc0d4020 con 0x55bec7d05190 2024-04-25T12:22:21.166 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.158+0000 7f35e5555000 10 client.4818 fetch_fsmap finished waiting for FSMap version 19 2024-04-25T12:22:21.166 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.158+0000 7f35e5555000 10 client.4818 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T12:22:21.166 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.158+0000 7f35e5555000 20 client.4818 populate_metadata read hostname 'smithi086' 2024-04-25T12:22:21.166 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.158+0000 7f35e5555000 1 --2- 172.21.15.86:0/2612820417 >> [v2:172.21.15.86:6837/4002713597,v1:172.21.15.86:6839/4002713597] conn(0x55bec7d54d90 0x55bec7d57180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.166 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.158+0000 7f35e5555000 4 client.4818 mds_command: new command op to 4239 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T12:22:21.167 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.158+0000 7f35e5555000 1 -- 172.21.15.86:0/2612820417 --> [v2:172.21.15.86:6837/4002713597,v1:172.21.15.86:6839/4002713597] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bec7ae7bc0 con 0x55bec7d54d90 2024-04-25T12:22:21.167 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.158+0000 7f35db7fe640 1 --2- 172.21.15.86:0/2612820417 >> [v2:172.21.15.86:6837/4002713597,v1:172.21.15.86:6839/4002713597] conn(0x55bec7d54d90 0x55bec7d57180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.167 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.158+0000 7f35baffd640 10 client.4818 ms_handle_connect on v2:172.21.15.86:6837/4002713597 2024-04-25T12:22:21.167 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.158+0000 7f35db7fe640 1 --2- 172.21.15.86:0/2612820417 >> [v2:172.21.15.86:6837/4002713597,v1:172.21.15.86:6839/4002713597] conn(0x55bec7d54d90 0x55bec7d57180 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=cb5e575e0ffdbc44 server_cookie=a7a684d5ac1e5f5f in_seq=0 out_seq=0 2024-04-25T12:22:21.167 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.158+0000 7f35baffd640 1 -- 172.21.15.86:0/2612820417 <== mds.3 v2:172.21.15.86:6837/4002713597 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55bec7ae7bc0 con 0x55bec7d54d90 2024-04-25T12:22:21.167 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.158+0000 7f35baffd640 10 client.4818 handle_command_reply: tid=0 2024-04-25T12:22:21.167 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.158+0000 7f35e5555000 1 client.4818 shutdown 2024-04-25T12:22:21.167 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.158+0000 7f35e5555000 1 -- 172.21.15.86:0/2612820417 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bec7d05190 msgr2=0x55bec7d01bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:21.167 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.158+0000 7f35e5555000 1 --2- 172.21.15.86:0/2612820417 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bec7d05190 0x55bec7d01bb0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f35cc01f450 tx=0x7f35cc01c1b0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.167 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.158+0000 7f35e5555000 1 -- 172.21.15.86:0/2612820417 shutdown_connections 2024-04-25T12:22:21.167 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.158+0000 7f35e5555000 1 --2- 172.21.15.86:0/2612820417 >> [v2:172.21.15.86:6837/4002713597,v1:172.21.15.86:6839/4002713597] conn(0x55bec7d54d90 0x55bec7d57180 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.167 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.158+0000 7f35e5555000 1 --2- 172.21.15.86:0/2612820417 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55bec7d405c0 0x55bec7d02630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.167 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.158+0000 7f35e5555000 1 --2- 172.21.15.86:0/2612820417 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bec7d05ab0 0x55bec7d020f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.167 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.158+0000 7f35e5555000 1 --2- 172.21.15.86:0/2612820417 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bec7d05190 0x55bec7d01bb0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.167 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.158+0000 7f35baffd640 0 client.4818 ms_handle_reset on v2:172.21.15.86:6837/4002713597 2024-04-25T12:22:21.167 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.158+0000 7f35e5555000 1 -- 172.21.15.86:0/2612820417 >> 172.21.15.86:0/2612820417 conn(0x55bec7d3ce40 msgr2=0x55bec7d3e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:21.168 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.158+0000 7f35e5555000 1 -- 172.21.15.86:0/2612820417 shutdown_connections 2024-04-25T12:22:21.168 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.158+0000 7f35e5555000 1 -- 172.21.15.86:0/2612820417 wait complete. 2024-04-25T12:22:21.168 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.158+0000 7f35e5555000 20 client.4818 trim_cache size 0 max 16384 2024-04-25T12:22:21.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.178+0000 7f35e5555000 1 Processor -- start 2024-04-25T12:22:21.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.178+0000 7f35e5555000 1 -- start start 2024-04-25T12:22:21.181 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.178+0000 7f35e5555000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bec7d05190 0x55bec7d5a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.181 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.178+0000 7f35e5555000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55bec7d05ab0 0x55bec7d5a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.181 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.178+0000 7f35e5555000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bec7d405c0 0x55bec7dac6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.178+0000 7f35e5555000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f35dc1fee30 con 0x55bec7d405c0 2024-04-25T12:22:21.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.178+0000 7f35e5555000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f35dc1ff500 con 0x55bec7d05190 2024-04-25T12:22:21.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.178+0000 7f35e5555000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f35dc1f4ec0 con 0x55bec7d05ab0 2024-04-25T12:22:21.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.178+0000 7f35e0970640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bec7d405c0 0x55bec7dac6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.178+0000 7f35e0970640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bec7d405c0 0x55bec7dac6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38684/0 (socket says 172.21.15.86:38684) 2024-04-25T12:22:21.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.178+0000 7f35e0970640 1 -- 172.21.15.86:0/1103453179 learned_addr learned my addr 172.21.15.86:0/1103453179 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:21.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.178+0000 7f35dbfff640 1 --2- 172.21.15.86:0/1103453179 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bec7d05190 0x55bec7d5a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.178+0000 7f35db7fe640 1 --2- 172.21.15.86:0/1103453179 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55bec7d05ab0 0x55bec7d5a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.178+0000 7f35e0970640 1 -- 172.21.15.86:0/1103453179 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55bec7d05ab0 msgr2=0x55bec7d5a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:21.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.178+0000 7f35e0970640 1 --2- 172.21.15.86:0/1103453179 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55bec7d05ab0 0x55bec7d5a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.178+0000 7f35e0970640 1 -- 172.21.15.86:0/1103453179 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bec7d05190 msgr2=0x55bec7d5a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:21.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.178+0000 7f35e0970640 1 --2- 172.21.15.86:0/1103453179 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bec7d05190 0x55bec7d5a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.178+0000 7f35e0970640 1 -- 172.21.15.86:0/1103453179 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bec7ad4e80 con 0x55bec7d405c0 2024-04-25T12:22:21.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.178+0000 7f35e0970640 1 --2- 172.21.15.86:0/1103453179 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bec7d405c0 0x55bec7dac6d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f35d4056a00 tx=0x7f35d4022040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff156f46b4275750 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:21.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.178+0000 7f35d17fa640 1 -- 172.21.15.86:0/1103453179 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d4083070 con 0x55bec7d405c0 2024-04-25T12:22:21.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.178+0000 7f35d17fa640 1 -- 172.21.15.86:0/1103453179 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35d406f030 con 0x55bec7d405c0 2024-04-25T12:22:21.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.178+0000 7f35d17fa640 1 -- 172.21.15.86:0/1103453179 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d405f970 con 0x55bec7d405c0 2024-04-25T12:22:21.187 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.178+0000 7f35e5555000 1 -- 172.21.15.86:0/1103453179 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bec7d405c0 msgr2=0x55bec7dac6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:21.187 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.178+0000 7f35e5555000 1 --2- 172.21.15.86:0/1103453179 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bec7d405c0 0x55bec7dac6d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f35d4056a00 tx=0x7f35d4022040 comp rx=0 tx=0).stop 2024-04-25T12:22:21.187 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.178+0000 7f35e5555000 1 -- 172.21.15.86:0/1103453179 shutdown_connections 2024-04-25T12:22:21.187 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.178+0000 7f35e5555000 1 --2- 172.21.15.86:0/1103453179 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bec7d405c0 0x55bec7dac6d0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.187 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.178+0000 7f35e5555000 1 --2- 172.21.15.86:0/1103453179 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55bec7d05ab0 0x55bec7d5a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.187 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.178+0000 7f35e5555000 1 --2- 172.21.15.86:0/1103453179 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bec7d05190 0x55bec7d5a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.187 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.178+0000 7f35e5555000 1 -- 172.21.15.86:0/1103453179 >> 172.21.15.86:0/1103453179 conn(0x55bec7d3ce40 msgr2=0x55bec7d3b500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:21.187 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.178+0000 7f35e5555000 1 -- 172.21.15.86:0/1103453179 shutdown_connections 2024-04-25T12:22:21.188 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.178+0000 7f35e5555000 1 -- 172.21.15.86:0/1103453179 wait complete. 2024-04-25T12:22:21.188 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.178+0000 7f35e5555000 1 -- start start 2024-04-25T12:22:21.188 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.178+0000 7f35e5555000 1 Processor -- start 2024-04-25T12:22:21.188 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.182+0000 7f35e5555000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bec7d05190 0x55bec7daf4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.188 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.182+0000 7f35e5555000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55bec7d05ab0 0x55bec7dafa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.188 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.182+0000 7f35e5555000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bec7d405c0 0x55bec7db0190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.188 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.182+0000 7f35e5555000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55bec7b4d730 con 0x55bec7d405c0 2024-04-25T12:22:21.188 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.182+0000 7f35e5555000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55bec7b1a9e0 con 0x55bec7d05190 2024-04-25T12:22:21.188 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.182+0000 7f35e5555000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x55bec7b52a50 con 0x55bec7d05ab0 2024-04-25T12:22:21.188 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.182+0000 7f35e5555000 10 client.0 _ll_register_callbacks cb 0x7f35c8003700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T12:22:21.188 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.182+0000 7f35e0970640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bec7d405c0 0x55bec7db0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.188 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.182+0000 7f35e0970640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bec7d405c0 0x55bec7db0190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38700/0 (socket says 172.21.15.86:38700) 2024-04-25T12:22:21.188 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.182+0000 7f35e0970640 1 -- 172.21.15.86:0/551342006 learned_addr learned my addr 172.21.15.86:0/551342006 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:21.188 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.182+0000 7f35db7fe640 1 --2- 172.21.15.86:0/551342006 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55bec7d05ab0 0x55bec7dafa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.188 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.182+0000 7f35dbfff640 1 --2- 172.21.15.86:0/551342006 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bec7d05190 0x55bec7daf4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.188 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.182+0000 7f35e0970640 1 -- 172.21.15.86:0/551342006 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55bec7d05ab0 msgr2=0x55bec7dafa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:21.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.182+0000 7f35e0970640 1 --2- 172.21.15.86:0/551342006 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55bec7d05ab0 0x55bec7dafa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.182+0000 7f35e0970640 1 -- 172.21.15.86:0/551342006 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bec7d05190 msgr2=0x55bec7daf4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:21.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.182+0000 7f35e0970640 1 --2- 172.21.15.86:0/551342006 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bec7d05190 0x55bec7daf4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.182+0000 7f35e0970640 1 -- 172.21.15.86:0/551342006 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bec7b16b30 con 0x55bec7d405c0 2024-04-25T12:22:21.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.182+0000 7f35dbfff640 1 --2- 172.21.15.86:0/551342006 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bec7d05190 0x55bec7daf4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:22:21.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.182+0000 7f35e0970640 1 --2- 172.21.15.86:0/551342006 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bec7d405c0 0x55bec7db0190 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f35d4053160 tx=0x7f35d40852d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b2b721bd5f41016 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:21.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.182+0000 7f35baffd640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-04-25T12:22:21.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.182+0000 7f35baffd640 1 -- 172.21.15.86:0/551342006 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d4083070 con 0x55bec7d405c0 2024-04-25T12:22:21.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.182+0000 7f35baffd640 1 -- 172.21.15.86:0/551342006 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f35d4013340 con 0x55bec7d405c0 2024-04-25T12:22:21.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.182+0000 7f35e5555000 1 -- 172.21.15.86:0/551342006 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f35d406f030 con 0x55bec7d405c0 2024-04-25T12:22:21.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.182+0000 7f35baffd640 1 -- 172.21.15.86:0/551342006 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f35d407c050 con 0x55bec7d405c0 2024-04-25T12:22:21.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.182+0000 7f35e5555000 10 client.4824 fetch_fsmap learned FSMap version 19 2024-04-25T12:22:21.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.182+0000 7f35e5555000 1 -- 172.21.15.86:0/551342006 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55bec7bcf5b0 con 0x55bec7d405c0 2024-04-25T12:22:21.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.182+0000 7f35baffd640 1 -- 172.21.15.86:0/551342006 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35d406f030 con 0x55bec7d405c0 2024-04-25T12:22:21.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.182+0000 7f35baffd640 1 -- 172.21.15.86:0/551342006 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7f35d4056f60 con 0x55bec7d405c0 2024-04-25T12:22:21.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.182+0000 7f35e5555000 10 client.4824 fetch_fsmap finished waiting for FSMap version 19 2024-04-25T12:22:21.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.182+0000 7f35e5555000 10 client.4824 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T12:22:21.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.182+0000 7f35e5555000 20 client.4824 populate_metadata read hostname 'smithi086' 2024-04-25T12:22:21.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.182+0000 7f35e5555000 1 --2- 172.21.15.86:0/551342006 >> [v2:172.21.15.86:6837/4002713597,v1:172.21.15.86:6839/4002713597] conn(0x55bec7db0ac0 0x55bec7db0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.182+0000 7f35e5555000 4 client.4824 mds_command: new command op to 4239 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T12:22:21.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.182+0000 7f35e5555000 1 -- 172.21.15.86:0/551342006 --> [v2:172.21.15.86:6837/4002713597,v1:172.21.15.86:6839/4002713597] -- command(tid 0: {"prefix": "status"}) -- 0x55bec7b5be40 con 0x55bec7db0ac0 2024-04-25T12:22:21.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.182+0000 7f35dbfff640 1 --2- 172.21.15.86:0/551342006 >> [v2:172.21.15.86:6837/4002713597,v1:172.21.15.86:6839/4002713597] conn(0x55bec7db0ac0 0x55bec7db0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.182+0000 7f35baffd640 10 client.4824 ms_handle_connect on v2:172.21.15.86:6837/4002713597 2024-04-25T12:22:21.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.182+0000 7f35dbfff640 1 --2- 172.21.15.86:0/551342006 >> [v2:172.21.15.86:6837/4002713597,v1:172.21.15.86:6839/4002713597] conn(0x55bec7db0ac0 0x55bec7db0ea0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a6920754dff913f9 server_cookie=390b477142d54b5 in_seq=0 out_seq=0 2024-04-25T12:22:21.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.182+0000 7f35baffd640 1 -- 172.21.15.86:0/551342006 <== mds.3 v2:172.21.15.86:6837/4002713597 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55bec7b5be40 con 0x55bec7db0ac0 2024-04-25T12:22:21.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.182+0000 7f35baffd640 10 client.4824 handle_command_reply: tid=0 2024-04-25T12:22:21.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.182+0000 7f35e5555000 1 client.4824 shutdown 2024-04-25T12:22:21.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.182+0000 7f35e5555000 1 -- 172.21.15.86:0/551342006 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bec7d405c0 msgr2=0x55bec7db0190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:21.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.182+0000 7f35e5555000 1 --2- 172.21.15.86:0/551342006 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bec7d405c0 0x55bec7db0190 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f35d4053160 tx=0x7f35d40852d0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.182+0000 7f35e5555000 1 -- 172.21.15.86:0/551342006 shutdown_connections 2024-04-25T12:22:21.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.182+0000 7f35e5555000 1 --2- 172.21.15.86:0/551342006 >> [v2:172.21.15.86:6837/4002713597,v1:172.21.15.86:6839/4002713597] conn(0x55bec7db0ac0 0x55bec7db0ea0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.191 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.182+0000 7f35e5555000 1 --2- 172.21.15.86:0/551342006 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bec7d405c0 0x55bec7db0190 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.191 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.182+0000 7f35e5555000 1 --2- 172.21.15.86:0/551342006 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55bec7d05ab0 0x55bec7dafa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.191 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.182+0000 7f35baffd640 0 client.4824 ms_handle_reset on v2:172.21.15.86:6837/4002713597 2024-04-25T12:22:21.191 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.182+0000 7f35e5555000 1 --2- 172.21.15.86:0/551342006 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bec7d05190 0x55bec7daf4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.191 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.182+0000 7f35e5555000 1 -- 172.21.15.86:0/551342006 >> 172.21.15.86:0/551342006 conn(0x55bec7d3ce40 msgr2=0x55bec7cfe530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:21.191 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.182+0000 7f35e5555000 1 -- 172.21.15.86:0/551342006 shutdown_connections 2024-04-25T12:22:21.191 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.182+0000 7f35e5555000 1 -- 172.21.15.86:0/551342006 wait complete. 2024-04-25T12:22:21.191 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.182+0000 7f35e5555000 20 client.4824 trim_cache size 0 max 16384 2024-04-25T12:22:21.191 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-25T12:22:21.191 INFO:teuthology.orchestra.run.smithi086.stdout: "cluster_fsid": "f2ef5c0c-9576-4650-b4f7-6cb14247f62a", 2024-04-25T12:22:21.191 INFO:teuthology.orchestra.run.smithi086.stdout: "whoami": 3, 2024-04-25T12:22:21.191 INFO:teuthology.orchestra.run.smithi086.stdout: "id": 4239, 2024-04-25T12:22:21.192 INFO:teuthology.orchestra.run.smithi086.stdout: "want_state": "up:active", 2024-04-25T12:22:21.192 INFO:teuthology.orchestra.run.smithi086.stdout: "state": "up:active", 2024-04-25T12:22:21.192 INFO:teuthology.orchestra.run.smithi086.stdout: "fs_name": "cephfs", 2024-04-25T12:22:21.192 INFO:teuthology.orchestra.run.smithi086.stdout: "rank_uptime": 17.288914474999999, 2024-04-25T12:22:21.192 INFO:teuthology.orchestra.run.smithi086.stdout: "mdsmap_epoch": 19, 2024-04-25T12:22:21.192 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch": 26, 2024-04-25T12:22:21.192 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch_barrier": 26, 2024-04-25T12:22:21.192 INFO:teuthology.orchestra.run.smithi086.stdout: "uptime": 63.798822393000002 2024-04-25T12:22:21.192 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-25T12:22:21.193 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.182+0000 7f35e23d3640 1 -- 172.21.15.86:0/2416565919 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f35bc0683b0 msgr2=0x7f35bc06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:21.193 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.182+0000 7f35e23d3640 1 --2- 172.21.15.86:0/2416565919 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f35bc0683b0 0x7f35bc06a870 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f35cc0ae000 tx=0x7f35cc0b4040 comp rx=0 tx=0).stop 2024-04-25T12:22:21.193 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.182+0000 7f35e23d3640 1 -- 172.21.15.86:0/2416565919 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35dc151140 msgr2=0x7f35dc15d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:21.193 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.182+0000 7f35e23d3640 1 --2- 172.21.15.86:0/2416565919 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35dc151140 0x7f35dc15d730 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f35dc06d2c0 tx=0x7f35d40101c0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.193 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.182+0000 7f35e23d3640 1 -- 172.21.15.86:0/2416565919 shutdown_connections 2024-04-25T12:22:21.193 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.182+0000 7f35e23d3640 1 --2- 172.21.15.86:0/2416565919 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f35bc0683b0 0x7f35bc06a870 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.193 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.182+0000 7f35e23d3640 1 --2- 172.21.15.86:0/2416565919 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35dc151140 0x7f35dc15d730 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.193 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.182+0000 7f35e23d3640 1 --2- 172.21.15.86:0/2416565919 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f35dc154890 0x7f35dc1f0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.193 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.182+0000 7f35e23d3640 1 --2- 172.21.15.86:0/2416565919 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35c80039c0 0x7f35dc156c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.193 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.182+0000 7f35e23d3640 1 -- 172.21.15.86:0/2416565919 >> 172.21.15.86:0/2416565919 conn(0x7f35dc06cc30 msgr2=0x7f35dc15b650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:21.194 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.182+0000 7f35e23d3640 1 -- 172.21.15.86:0/2416565919 shutdown_connections 2024-04-25T12:22:21.194 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.182+0000 7f35e23d3640 1 -- 172.21.15.86:0/2416565919 wait complete. 2024-04-25T12:22:21.203 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-25T12:22:21.316 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.314+0000 7f3dc3864640 1 Processor -- start 2024-04-25T12:22:21.316 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.314+0000 7f3dc3864640 1 -- start start 2024-04-25T12:22:21.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.314+0000 7f3dc3864640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3dbc15ee20 0x7f3dbc0c3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.314+0000 7f3dc3864640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3dbc06f700 0x7f3dbc0c6f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.314+0000 7f3dc3864640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3dbc0c4e80 con 0x7f3dbc155300 2024-04-25T12:22:21.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.314+0000 7f3dc3864640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f3dbc0c4230 con 0x7f3dbc15ee20 2024-04-25T12:22:21.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.314+0000 7f3dc3864640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f3dbc0c5770 con 0x7f3dbc06f700 2024-04-25T12:22:21.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.314+0000 7f3dc0dff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3dbc15ee20 0x7f3dbc0c3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.314+0000 7f3dc1e01640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3dbc06f700 0x7f3dbc0c6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.314+0000 7f3dc1e01640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3dbc06f700 0x7f3dbc0c6f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.86:36612/0 (socket says 172.21.15.86:36612) 2024-04-25T12:22:21.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.314+0000 7f3dc1e01640 1 -- 172.21.15.86:0/1892510397 learned_addr learned my addr 172.21.15.86:0/1892510397 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:21.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.314+0000 7f3dc1600640 1 --1- 172.21.15.86:0/1892510397 >> v1:172.21.15.134:6789/0 conn(0x7f3dbc155300 0x7f3dbc15e710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.86:46684/0 (socket says 172.21.15.86:46684) 2024-04-25T12:22:21.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.314+0000 7f3dc1e01640 1 -- 172.21.15.86:0/1892510397 >> v2:172.21.15.134:3300/0 conn(0x7f3dbc15ee20 msgr2=0x7f3dbc0c3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:21.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.314+0000 7f3dc1e01640 1 --2- 172.21.15.86:0/1892510397 >> v2:172.21.15.134:3300/0 conn(0x7f3dbc15ee20 0x7f3dbc0c3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.314+0000 7f3dc1e01640 1 -- 172.21.15.86:0/1892510397 >> v1:172.21.15.134:6789/0 conn(0x7f3dbc155300 legacy=0x7f3dbc15e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:21.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.314+0000 7f3dc1e01640 1 -- 172.21.15.86:0/1892510397 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dbc15f320 con 0x7f3dbc06f700 2024-04-25T12:22:21.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.314+0000 7f3dc0dff640 1 --2- 172.21.15.86:0/1892510397 >> v2:172.21.15.134:3300/0 conn(0x7f3dbc15ee20 0x7f3dbc0c3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T12:22:21.320 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.318+0000 7f3dc1e01640 1 --2- 172.21.15.86:0/1892510397 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3dbc06f700 0x7f3dbc0c6f70 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3db4009e50 tx=0x7f3db401ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36161cd27324c720 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:21.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.318+0000 7f3db3fff640 1 -- 172.21.15.86:0/1892510397 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db40a57f0 con 0x7f3dbc06f700 2024-04-25T12:22:21.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.318+0000 7f3db3fff640 1 -- 172.21.15.86:0/1892510397 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3db40a5990 con 0x7f3dbc06f700 2024-04-25T12:22:21.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.318+0000 7f3db3fff640 1 -- 172.21.15.86:0/1892510397 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db40a5d60 con 0x7f3dbc06f700 2024-04-25T12:22:21.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.318+0000 7f3dc3864640 1 -- 172.21.15.86:0/1892510397 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3dbc06f700 msgr2=0x7f3dbc0c6f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:21.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.318+0000 7f3dc3864640 1 --2- 172.21.15.86:0/1892510397 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3dbc06f700 0x7f3dbc0c6f70 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3db4009e50 tx=0x7f3db401ca30 comp rx=0 tx=0).stop 2024-04-25T12:22:21.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.318+0000 7f3dc3864640 1 -- 172.21.15.86:0/1892510397 shutdown_connections 2024-04-25T12:22:21.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.318+0000 7f3dc3864640 1 --2- 172.21.15.86:0/1892510397 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3dbc06f700 0x7f3dbc0c6f70 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.318+0000 7f3dc3864640 1 --2- 172.21.15.86:0/1892510397 >> v2:172.21.15.134:3300/0 conn(0x7f3dbc15ee20 0x7f3dbc0c3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.318+0000 7f3dc3864640 1 -- 172.21.15.86:0/1892510397 >> 172.21.15.86:0/1892510397 conn(0x7f3dbc06b9d0 msgr2=0x7f3dbc06bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:21.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.318+0000 7f3dc3864640 1 -- 172.21.15.86:0/1892510397 shutdown_connections 2024-04-25T12:22:21.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.318+0000 7f3dc3864640 1 -- 172.21.15.86:0/1892510397 wait complete. 2024-04-25T12:22:21.323 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.322+0000 7f3dc3864640 1 Processor -- start 2024-04-25T12:22:21.323 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.322+0000 7f3dc3864640 1 -- start start 2024-04-25T12:22:21.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.322+0000 7f3dc3864640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3dbc06f700 0x7f3dbc157680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.322+0000 7f3dc3864640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3dbc155300 0x7f3dbc146630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.322+0000 7f3dc3864640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3dbc15ee20 0x7f3dbc156530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.322+0000 7f3dc3864640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3dbc0681d0 con 0x7f3dbc15ee20 2024-04-25T12:22:21.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.322+0000 7f3dc3864640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3dbc15f600 con 0x7f3dbc06f700 2024-04-25T12:22:21.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.322+0000 7f3dc3864640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f3dbc068350 con 0x7f3dbc155300 2024-04-25T12:22:21.326 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.322+0000 7f3dc1e01640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3dbc15ee20 0x7f3dbc156530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.326 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.322+0000 7f3dc1e01640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3dbc15ee20 0x7f3dbc156530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38716/0 (socket says 172.21.15.86:38716) 2024-04-25T12:22:21.326 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.322+0000 7f3dc1e01640 1 -- 172.21.15.86:0/3659657310 learned_addr learned my addr 172.21.15.86:0/3659657310 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:21.326 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.322+0000 7f3dc1600640 1 --2- 172.21.15.86:0/3659657310 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3dbc06f700 0x7f3dbc157680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.326 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.322+0000 7f3dc0dff640 1 --2- 172.21.15.86:0/3659657310 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3dbc155300 0x7f3dbc146630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.326 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.322+0000 7f3dc1e01640 1 -- 172.21.15.86:0/3659657310 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3dbc155300 msgr2=0x7f3dbc146630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:21.326 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.322+0000 7f3dc1e01640 1 --2- 172.21.15.86:0/3659657310 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3dbc155300 0x7f3dbc146630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.326 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.322+0000 7f3dc1e01640 1 -- 172.21.15.86:0/3659657310 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3dbc06f700 msgr2=0x7f3dbc157680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:21.326 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.322+0000 7f3dc1e01640 1 --2- 172.21.15.86:0/3659657310 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3dbc06f700 0x7f3dbc157680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.326 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.322+0000 7f3dc1e01640 1 -- 172.21.15.86:0/3659657310 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dbc1571d0 con 0x7f3dbc15ee20 2024-04-25T12:22:21.326 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.322+0000 7f3dc1e01640 1 --2- 172.21.15.86:0/3659657310 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3dbc15ee20 0x7f3dbc156530 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f3db40af040 tx=0x7f3db40197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:21.326 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.322+0000 7f3db1ffb640 1 -- 172.21.15.86:0/3659657310 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db40bc020 con 0x7f3dbc15ee20 2024-04-25T12:22:21.326 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.322+0000 7f3db1ffb640 1 -- 172.21.15.86:0/3659657310 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3db40b8670 con 0x7f3dbc15ee20 2024-04-25T12:22:21.327 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.322+0000 7f3dc3864640 1 -- 172.21.15.86:0/3659657310 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dbc0cb870 con 0x7f3dbc15ee20 2024-04-25T12:22:21.327 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.322+0000 7f3db1ffb640 1 -- 172.21.15.86:0/3659657310 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db40b8a40 con 0x7f3dbc15ee20 2024-04-25T12:22:21.327 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.322+0000 7f3dc3864640 1 -- 172.21.15.86:0/3659657310 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dbc0cb390 con 0x7f3dbc15ee20 2024-04-25T12:22:21.328 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.322+0000 7f3db1ffb640 1 -- 172.21.15.86:0/3659657310 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3db40bf020 con 0x7f3dbc15ee20 2024-04-25T12:22:21.328 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.322+0000 7f3db1ffb640 1 --2- 172.21.15.86:0/3659657310 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f3da0068380 0x7f3da006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.328 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.322+0000 7f3db1ffb640 1 -- 172.21.15.86:0/3659657310 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f3db4121e30 con 0x7f3dbc15ee20 2024-04-25T12:22:21.328 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.322+0000 7f3dc1600640 1 --2- 172.21.15.86:0/3659657310 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f3da0068380 0x7f3da006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.328 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.326+0000 7f3dc1600640 1 --2- 172.21.15.86:0/3659657310 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f3da0068380 0x7f3da006a840 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3db8000f70 tx=0x7f3db8007cd0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:21.328 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.326+0000 7f3dc69e6000 1 Processor -- start 2024-04-25T12:22:21.328 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.326+0000 7f3dc69e6000 1 -- start start 2024-04-25T12:22:21.330 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.326+0000 7f3dc69e6000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55c6f0c81190 0x55c6f0c81570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.331 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.326+0000 7f3dc69e6000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c6f0c81ab0 0x55c6f0cbc080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.331 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.326+0000 7f3dc69e6000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c6f0cbc5c0 0x55c6f0cbc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.331 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.326+0000 7f3dc69e6000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55c6f0aca420 con 0x55c6f0c81ab0 2024-04-25T12:22:21.331 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.326+0000 7f3dc69e6000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55c6f0a64bf0 con 0x55c6f0cbc5c0 2024-04-25T12:22:21.331 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.326+0000 7f3dc69e6000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x55c6f0ac63e0 con 0x55c6f0c81190 2024-04-25T12:22:21.331 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.326+0000 7f3dc0dff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c6f0c81ab0 0x55c6f0cbc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.331 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.326+0000 7f3dc0dff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c6f0c81ab0 0x55c6f0cbc080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38728/0 (socket says 172.21.15.86:38728) 2024-04-25T12:22:21.331 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.326+0000 7f3dc0dff640 1 -- 172.21.15.86:0/3294025556 learned_addr learned my addr 172.21.15.86:0/3294025556 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:21.331 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.326+0000 7f3dc1e01640 1 --2- 172.21.15.86:0/3294025556 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c6f0cbc5c0 0x55c6f0cbc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.331 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.326+0000 7f3dc1600640 1 --2- 172.21.15.86:0/3294025556 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55c6f0c81190 0x55c6f0c81570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.331 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.326+0000 7f3dc0dff640 1 -- 172.21.15.86:0/3294025556 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55c6f0c81190 msgr2=0x55c6f0c81570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:21.331 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.326+0000 7f3dc0dff640 1 --2- 172.21.15.86:0/3294025556 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55c6f0c81190 0x55c6f0c81570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.331 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.326+0000 7f3dc0dff640 1 -- 172.21.15.86:0/3294025556 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c6f0cbc5c0 msgr2=0x55c6f0cbc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:21.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.326+0000 7f3dc0dff640 1 --2- 172.21.15.86:0/3294025556 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c6f0cbc5c0 0x55c6f0cbc9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.326+0000 7f3dc0dff640 1 -- 172.21.15.86:0/3294025556 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6f0b72450 con 0x55c6f0c81ab0 2024-04-25T12:22:21.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.326+0000 7f3dc1e01640 1 --2- 172.21.15.86:0/3294025556 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c6f0cbc5c0 0x55c6f0cbc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:22:21.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.326+0000 7f3dc0dff640 1 --2- 172.21.15.86:0/3294025556 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c6f0c81ab0 0x55c6f0cbc080 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3dac009b10 tx=0x7f3dac009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da2dab146fc19cd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:21.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.326+0000 7f3da6ffd640 1 -- 172.21.15.86:0/3294025556 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dac019070 con 0x55c6f0c81ab0 2024-04-25T12:22:21.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.326+0000 7f3da6ffd640 1 -- 172.21.15.86:0/3294025556 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dac011bf0 con 0x55c6f0c81ab0 2024-04-25T12:22:21.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.326+0000 7f3da6ffd640 1 -- 172.21.15.86:0/3294025556 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dac015460 con 0x55c6f0c81ab0 2024-04-25T12:22:21.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.326+0000 7f3dc69e6000 1 -- 172.21.15.86:0/3294025556 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c6f0c81ab0 msgr2=0x55c6f0cbc080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:21.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.326+0000 7f3dc69e6000 1 --2- 172.21.15.86:0/3294025556 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c6f0c81ab0 0x55c6f0cbc080 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3dac009b10 tx=0x7f3dac009190 comp rx=0 tx=0).stop 2024-04-25T12:22:21.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.326+0000 7f3dc69e6000 1 -- 172.21.15.86:0/3294025556 shutdown_connections 2024-04-25T12:22:21.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.326+0000 7f3dc69e6000 1 --2- 172.21.15.86:0/3294025556 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c6f0cbc5c0 0x55c6f0cbc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.326+0000 7f3dc69e6000 1 --2- 172.21.15.86:0/3294025556 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c6f0c81ab0 0x55c6f0cbc080 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.326+0000 7f3dc69e6000 1 --2- 172.21.15.86:0/3294025556 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55c6f0c81190 0x55c6f0c81570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.326+0000 7f3dc69e6000 1 -- 172.21.15.86:0/3294025556 >> 172.21.15.86:0/3294025556 conn(0x55c6f0cb8e40 msgr2=0x55c6f0cbb260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:21.333 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.326+0000 7f3dc69e6000 1 -- 172.21.15.86:0/3294025556 shutdown_connections 2024-04-25T12:22:21.333 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.326+0000 7f3dc69e6000 1 -- 172.21.15.86:0/3294025556 wait complete. 2024-04-25T12:22:21.333 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.326+0000 7f3dc69e6000 1 -- start start 2024-04-25T12:22:21.333 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.326+0000 7f3dc69e6000 1 Processor -- start 2024-04-25T12:22:21.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.330+0000 7f3dc69e6000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c6f0c81190 0x55c6f0c7dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.330+0000 7f3dc69e6000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c6f0c81ab0 0x55c6f0c7e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.330+0000 7f3dc69e6000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55c6f0cbc5c0 0x55c6f0c7e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.330+0000 7f3dc69e6000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55c6f0a6aec0 con 0x55c6f0c81190 2024-04-25T12:22:21.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.330+0000 7f3dc69e6000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55c6f0b4b120 con 0x55c6f0c81ab0 2024-04-25T12:22:21.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.330+0000 7f3dc69e6000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x55c6f0ad5350 con 0x55c6f0cbc5c0 2024-04-25T12:22:21.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.330+0000 7f3dc69e6000 10 client.0 _ll_register_callbacks cb 0x55c6f0aa74d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T12:22:21.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.330+0000 7f3dc1600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c6f0c81190 0x55c6f0c7dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.330+0000 7f3dc1600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c6f0c81190 0x55c6f0c7dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38744/0 (socket says 172.21.15.86:38744) 2024-04-25T12:22:21.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.330+0000 7f3dc1600640 1 -- 172.21.15.86:0/2107924762 learned_addr learned my addr 172.21.15.86:0/2107924762 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:21.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.330+0000 7f3dc1e01640 1 --2- 172.21.15.86:0/2107924762 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55c6f0cbc5c0 0x55c6f0c7e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.330+0000 7f3dc0dff640 1 --2- 172.21.15.86:0/2107924762 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c6f0c81ab0 0x55c6f0c7e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.330+0000 7f3dc1600640 1 -- 172.21.15.86:0/2107924762 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55c6f0cbc5c0 msgr2=0x55c6f0c7e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:21.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.330+0000 7f3dc1600640 1 --2- 172.21.15.86:0/2107924762 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55c6f0cbc5c0 0x55c6f0c7e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.330+0000 7f3dc1600640 1 -- 172.21.15.86:0/2107924762 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c6f0c81ab0 msgr2=0x55c6f0c7e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:21.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.330+0000 7f3dc1600640 1 --2- 172.21.15.86:0/2107924762 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c6f0c81ab0 0x55c6f0c7e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.330+0000 7f3dc1600640 1 -- 172.21.15.86:0/2107924762 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6f0b0ff80 con 0x55c6f0c81190 2024-04-25T12:22:21.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.330+0000 7f3dc1600640 1 --2- 172.21.15.86:0/2107924762 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c6f0c81190 0x55c6f0c7dbd0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3db8007870 tx=0x7f3db8000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fad0e4bce572a90b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:21.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.330+0000 7f3d9bfff640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-04-25T12:22:21.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.330+0000 7f3d9bfff640 1 -- 172.21.15.86:0/2107924762 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db8005260 con 0x55c6f0c81190 2024-04-25T12:22:21.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.330+0000 7f3dc69e6000 1 -- 172.21.15.86:0/2107924762 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3dac011bf0 con 0x55c6f0c81190 2024-04-25T12:22:21.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.330+0000 7f3d9bfff640 1 -- 172.21.15.86:0/2107924762 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f3db8005400 con 0x55c6f0c81190 2024-04-25T12:22:21.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.330+0000 7f3d9bfff640 1 -- 172.21.15.86:0/2107924762 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f3db8005600 con 0x55c6f0c81190 2024-04-25T12:22:21.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.330+0000 7f3dc69e6000 10 client.4833 fetch_fsmap learned FSMap version 19 2024-04-25T12:22:21.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.330+0000 7f3dc69e6000 1 -- 172.21.15.86:0/2107924762 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55c6f0aa3f00 con 0x55c6f0c81190 2024-04-25T12:22:21.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.330+0000 7f3d9bfff640 1 -- 172.21.15.86:0/2107924762 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dac011bf0 con 0x55c6f0c81190 2024-04-25T12:22:21.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.330+0000 7f3d9bfff640 1 -- 172.21.15.86:0/2107924762 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7f3db8014740 con 0x55c6f0c81190 2024-04-25T12:22:21.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.330+0000 7f3dc69e6000 10 client.4833 fetch_fsmap finished waiting for FSMap version 19 2024-04-25T12:22:21.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.330+0000 7f3dc69e6000 10 client.4833 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T12:22:21.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.330+0000 7f3dc69e6000 20 client.4833 populate_metadata read hostname 'smithi086' 2024-04-25T12:22:21.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.330+0000 7f3dc69e6000 1 --2- 172.21.15.86:0/2107924762 >> [v2:172.21.15.134:6832/3114005030,v1:172.21.15.134:6833/3114005030] conn(0x55c6f0cd0d90 0x55c6f0cd3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.330+0000 7f3dc69e6000 4 client.4833 mds_command: new command op to 4245 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T12:22:21.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.330+0000 7f3dc69e6000 1 -- 172.21.15.86:0/2107924762 --> [v2:172.21.15.134:6832/3114005030,v1:172.21.15.134:6833/3114005030] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c6f0a63bc0 con 0x55c6f0cd0d90 2024-04-25T12:22:21.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.330+0000 7f3dc0dff640 1 --2- 172.21.15.86:0/2107924762 >> [v2:172.21.15.134:6832/3114005030,v1:172.21.15.134:6833/3114005030] conn(0x55c6f0cd0d90 0x55c6f0cd3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.330+0000 7f3d9bfff640 10 client.4833 ms_handle_connect on v2:172.21.15.134:6832/3114005030 2024-04-25T12:22:21.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.330+0000 7f3dc0dff640 1 --2- 172.21.15.86:0/2107924762 >> [v2:172.21.15.134:6832/3114005030,v1:172.21.15.134:6833/3114005030] conn(0x55c6f0cd0d90 0x55c6f0cd3180 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a92ad7b452c630be server_cookie=c3dedd5ba9b4e6c in_seq=0 out_seq=0 2024-04-25T12:22:21.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.334+0000 7f3d9bfff640 1 -- 172.21.15.86:0/2107924762 <== mds.2 v2:172.21.15.134:6832/3114005030 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55c6f0a63bc0 con 0x55c6f0cd0d90 2024-04-25T12:22:21.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.334+0000 7f3d9bfff640 10 client.4833 handle_command_reply: tid=0 2024-04-25T12:22:21.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.334+0000 7f3dc69e6000 1 client.4833 shutdown 2024-04-25T12:22:21.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.334+0000 7f3dc69e6000 1 -- 172.21.15.86:0/2107924762 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c6f0c81190 msgr2=0x55c6f0c7dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:21.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.334+0000 7f3dc69e6000 1 --2- 172.21.15.86:0/2107924762 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c6f0c81190 0x55c6f0c7dbd0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3db8007870 tx=0x7f3db8000bd0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.334+0000 7f3dc69e6000 1 -- 172.21.15.86:0/2107924762 shutdown_connections 2024-04-25T12:22:21.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.334+0000 7f3dc69e6000 1 --2- 172.21.15.86:0/2107924762 >> [v2:172.21.15.134:6832/3114005030,v1:172.21.15.134:6833/3114005030] conn(0x55c6f0cd0d90 0x55c6f0cd3180 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.334+0000 7f3dc69e6000 1 --2- 172.21.15.86:0/2107924762 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55c6f0cbc5c0 0x55c6f0c7e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.334+0000 7f3dc69e6000 1 --2- 172.21.15.86:0/2107924762 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c6f0c81ab0 0x55c6f0c7e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.334+0000 7f3d9bfff640 0 client.4833 ms_handle_reset on v2:172.21.15.134:6832/3114005030 2024-04-25T12:22:21.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.334+0000 7f3dc69e6000 1 --2- 172.21.15.86:0/2107924762 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c6f0c81190 0x55c6f0c7dbd0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.334+0000 7f3dc69e6000 1 -- 172.21.15.86:0/2107924762 >> 172.21.15.86:0/2107924762 conn(0x55c6f0cb8e40 msgr2=0x55c6f0cba1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:21.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.334+0000 7f3dc69e6000 1 -- 172.21.15.86:0/2107924762 shutdown_connections 2024-04-25T12:22:21.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.334+0000 7f3dc69e6000 1 -- 172.21.15.86:0/2107924762 wait complete. 2024-04-25T12:22:21.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.334+0000 7f3dc69e6000 20 client.4833 trim_cache size 0 max 16384 2024-04-25T12:22:21.356 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.350+0000 7f3dc69e6000 1 Processor -- start 2024-04-25T12:22:21.356 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.350+0000 7f3dc69e6000 1 -- start start 2024-04-25T12:22:21.357 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.350+0000 7f3dc69e6000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c6f0c81190 0x55c6f0cb7500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.357 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.350+0000 7f3dc69e6000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c6f0c81ab0 0x55c6f0cb7a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.357 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.350+0000 7f3dc69e6000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55c6f0cbc5c0 0x55c6f0d286d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.357 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.350+0000 7f3dc69e6000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3dbc201990 con 0x55c6f0c81190 2024-04-25T12:22:21.357 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.350+0000 7f3dc69e6000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3dbc202060 con 0x55c6f0c81ab0 2024-04-25T12:22:21.357 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.350+0000 7f3dc69e6000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f3dbc1f8370 con 0x55c6f0cbc5c0 2024-04-25T12:22:21.357 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.350+0000 7f3dc1600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c6f0c81190 0x55c6f0cb7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.357 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.350+0000 7f3dc1600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c6f0c81190 0x55c6f0cb7500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38754/0 (socket says 172.21.15.86:38754) 2024-04-25T12:22:21.357 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.350+0000 7f3dc1600640 1 -- 172.21.15.86:0/902516093 learned_addr learned my addr 172.21.15.86:0/902516093 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:21.357 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.354+0000 7f3dc1600640 1 -- 172.21.15.86:0/902516093 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55c6f0cbc5c0 msgr2=0x55c6f0d286d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:21.357 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.354+0000 7f3dc1600640 1 --2- 172.21.15.86:0/902516093 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55c6f0cbc5c0 0x55c6f0d286d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.358 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.354+0000 7f3dc1600640 1 -- 172.21.15.86:0/902516093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c6f0c81ab0 msgr2=0x55c6f0cb7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:21.358 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.354+0000 7f3dc1600640 1 --2- 172.21.15.86:0/902516093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c6f0c81ab0 0x55c6f0cb7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.358 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.354+0000 7f3dc1600640 1 -- 172.21.15.86:0/902516093 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6f0a50e80 con 0x55c6f0c81190 2024-04-25T12:22:21.358 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.354+0000 7f3dc1600640 1 --2- 172.21.15.86:0/902516093 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c6f0c81190 0x55c6f0cb7500 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3db8001060 tx=0x7f3db8009070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=568f7679ef1a0ca7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:21.358 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.354+0000 7f3da67fc640 1 -- 172.21.15.86:0/902516093 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db8030070 con 0x55c6f0c81190 2024-04-25T12:22:21.358 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.354+0000 7f3da67fc640 1 -- 172.21.15.86:0/902516093 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3db8005b80 con 0x55c6f0c81190 2024-04-25T12:22:21.358 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.354+0000 7f3da67fc640 1 -- 172.21.15.86:0/902516093 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db8005260 con 0x55c6f0c81190 2024-04-25T12:22:21.358 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.354+0000 7f3dc69e6000 1 -- 172.21.15.86:0/902516093 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c6f0c81190 msgr2=0x55c6f0cb7500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:21.358 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.354+0000 7f3dc69e6000 1 --2- 172.21.15.86:0/902516093 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c6f0c81190 0x55c6f0cb7500 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3db8001060 tx=0x7f3db8009070 comp rx=0 tx=0).stop 2024-04-25T12:22:21.358 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.354+0000 7f3dc69e6000 1 -- 172.21.15.86:0/902516093 shutdown_connections 2024-04-25T12:22:21.358 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.354+0000 7f3dc69e6000 1 --2- 172.21.15.86:0/902516093 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55c6f0cbc5c0 0x55c6f0d286d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.358 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.354+0000 7f3dc69e6000 1 --2- 172.21.15.86:0/902516093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c6f0c81ab0 0x55c6f0cb7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.358 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.354+0000 7f3dc69e6000 1 --2- 172.21.15.86:0/902516093 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c6f0c81190 0x55c6f0cb7500 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.358 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.354+0000 7f3dc69e6000 1 -- 172.21.15.86:0/902516093 >> 172.21.15.86:0/902516093 conn(0x55c6f0cb8e40 msgr2=0x55c6f0cd63d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:21.359 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.354+0000 7f3dc69e6000 1 -- 172.21.15.86:0/902516093 shutdown_connections 2024-04-25T12:22:21.359 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.354+0000 7f3dc69e6000 1 -- 172.21.15.86:0/902516093 wait complete. 2024-04-25T12:22:21.359 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.354+0000 7f3dc69e6000 1 -- start start 2024-04-25T12:22:21.359 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.354+0000 7f3dc69e6000 1 Processor -- start 2024-04-25T12:22:21.363 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.354+0000 7f3dc69e6000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c6f0c81190 0x55c6f0cf1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.363 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.354+0000 7f3dc69e6000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c6f0c81ab0 0x55c6f0cf22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.363 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.354+0000 7f3dc69e6000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55c6f0cbc5c0 0x55c6f0cf2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.363 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.354+0000 7f3dc69e6000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55c6f0ac9730 con 0x55c6f0c81ab0 2024-04-25T12:22:21.363 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.354+0000 7f3dc69e6000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55c6f0a969e0 con 0x55c6f0c81190 2024-04-25T12:22:21.363 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.354+0000 7f3dc69e6000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x55c6f0acea50 con 0x55c6f0cbc5c0 2024-04-25T12:22:21.363 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.354+0000 7f3dc69e6000 10 client.0 _ll_register_callbacks cb 0x7f3db8005aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T12:22:21.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.354+0000 7f3dc0dff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c6f0c81ab0 0x55c6f0cf22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.354+0000 7f3dc0dff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c6f0c81ab0 0x55c6f0cf22c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38766/0 (socket says 172.21.15.86:38766) 2024-04-25T12:22:21.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.354+0000 7f3dc0dff640 1 -- 172.21.15.86:0/890343250 learned_addr learned my addr 172.21.15.86:0/890343250 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:21.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.354+0000 7f3dc0dff640 1 -- 172.21.15.86:0/890343250 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55c6f0cbc5c0 msgr2=0x55c6f0cf2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:21.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.354+0000 7f3dc0dff640 1 --2- 172.21.15.86:0/890343250 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55c6f0cbc5c0 0x55c6f0cf2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.354+0000 7f3dc0dff640 1 -- 172.21.15.86:0/890343250 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c6f0c81190 msgr2=0x55c6f0cf1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:21.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.354+0000 7f3dc1600640 1 --2- 172.21.15.86:0/890343250 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c6f0c81190 0x55c6f0cf1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.354+0000 7f3dc0dff640 1 --2- 172.21.15.86:0/890343250 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c6f0c81190 0x55c6f0cf1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.354+0000 7f3dc0dff640 1 -- 172.21.15.86:0/890343250 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6f0a92b30 con 0x55c6f0c81ab0 2024-04-25T12:22:21.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.354+0000 7f3dc0dff640 1 --2- 172.21.15.86:0/890343250 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c6f0c81ab0 0x55c6f0cf22c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3dac009a60 tx=0x7f3dac004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3885a6163aa04348 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:21.365 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.354+0000 7f3d9bfff640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-04-25T12:22:21.365 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.354+0000 7f3d9bfff640 1 -- 172.21.15.86:0/890343250 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dac019040 con 0x55c6f0c81ab0 2024-04-25T12:22:21.365 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.354+0000 7f3d9bfff640 1 -- 172.21.15.86:0/890343250 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f3dac02c280 con 0x55c6f0c81ab0 2024-04-25T12:22:21.365 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.354+0000 7f3dc69e6000 1 -- 172.21.15.86:0/890343250 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3db8005b80 con 0x55c6f0c81ab0 2024-04-25T12:22:21.365 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.354+0000 7f3d9bfff640 1 -- 172.21.15.86:0/890343250 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f3dac035050 con 0x55c6f0c81ab0 2024-04-25T12:22:21.365 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.354+0000 7f3dc69e6000 10 client.4839 fetch_fsmap learned FSMap version 19 2024-04-25T12:22:21.365 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.354+0000 7f3dc69e6000 1 -- 172.21.15.86:0/890343250 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55c6f0b4b5b0 con 0x55c6f0c81ab0 2024-04-25T12:22:21.365 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.354+0000 7f3d9bfff640 1 -- 172.21.15.86:0/890343250 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3db8005b80 con 0x55c6f0c81ab0 2024-04-25T12:22:21.365 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.354+0000 7f3d9bfff640 1 -- 172.21.15.86:0/890343250 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7f3dac038020 con 0x55c6f0c81ab0 2024-04-25T12:22:21.365 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.354+0000 7f3dc69e6000 10 client.4839 fetch_fsmap finished waiting for FSMap version 19 2024-04-25T12:22:21.365 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.354+0000 7f3dc69e6000 10 client.4839 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T12:22:21.365 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.354+0000 7f3dc69e6000 20 client.4839 populate_metadata read hostname 'smithi086' 2024-04-25T12:22:21.365 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.354+0000 7f3dc69e6000 1 --2- 172.21.15.86:0/890343250 >> [v2:172.21.15.134:6832/3114005030,v1:172.21.15.134:6833/3114005030] conn(0x55c6f0d37c30 0x55c6f0d3a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.366 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.354+0000 7f3dc69e6000 4 client.4839 mds_command: new command op to 4245 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T12:22:21.366 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.354+0000 7f3dc69e6000 1 -- 172.21.15.86:0/890343250 --> [v2:172.21.15.134:6832/3114005030,v1:172.21.15.134:6833/3114005030] -- command(tid 0: {"prefix": "status"}) -- 0x55c6f0ad7e40 con 0x55c6f0d37c30 2024-04-25T12:22:21.366 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.358+0000 7f3dc1600640 1 --2- 172.21.15.86:0/890343250 >> [v2:172.21.15.134:6832/3114005030,v1:172.21.15.134:6833/3114005030] conn(0x55c6f0d37c30 0x55c6f0d3a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.366 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.358+0000 7f3dc1600640 1 --2- 172.21.15.86:0/890343250 >> [v2:172.21.15.134:6832/3114005030,v1:172.21.15.134:6833/3114005030] conn(0x55c6f0d37c30 0x55c6f0d3a020 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=77428df507e32a65 server_cookie=98465d8006343da in_seq=0 out_seq=0 2024-04-25T12:22:21.366 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.358+0000 7f3d9bfff640 10 client.4839 ms_handle_connect on v2:172.21.15.134:6832/3114005030 2024-04-25T12:22:21.366 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.358+0000 7f3d9bfff640 1 -- 172.21.15.86:0/890343250 <== mds.2 v2:172.21.15.134:6832/3114005030 1 ==== command_reply(tid 0: 0 ) ==== 8+0+319 (crc 0 0 0) 0x55c6f0ad7e40 con 0x55c6f0d37c30 2024-04-25T12:22:21.366 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.358+0000 7f3d9bfff640 10 client.4839 handle_command_reply: tid=0 2024-04-25T12:22:21.366 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.358+0000 7f3dc69e6000 1 client.4839 shutdown 2024-04-25T12:22:21.366 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.358+0000 7f3dc69e6000 1 -- 172.21.15.86:0/890343250 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c6f0c81ab0 msgr2=0x55c6f0cf22c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:21.366 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.358+0000 7f3dc69e6000 1 --2- 172.21.15.86:0/890343250 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c6f0c81ab0 0x55c6f0cf22c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3dac009a60 tx=0x7f3dac004740 comp rx=0 tx=0).stop 2024-04-25T12:22:21.366 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.358+0000 7f3dc69e6000 1 -- 172.21.15.86:0/890343250 shutdown_connections 2024-04-25T12:22:21.366 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.358+0000 7f3dc69e6000 1 --2- 172.21.15.86:0/890343250 >> [v2:172.21.15.134:6832/3114005030,v1:172.21.15.134:6833/3114005030] conn(0x55c6f0d37c30 0x55c6f0d3a020 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.358+0000 7f3dc69e6000 1 --2- 172.21.15.86:0/890343250 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55c6f0cbc5c0 0x55c6f0cf2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.358+0000 7f3dc69e6000 1 --2- 172.21.15.86:0/890343250 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c6f0c81ab0 0x55c6f0cf22c0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.358+0000 7f3d9bfff640 0 client.4839 ms_handle_reset on v2:172.21.15.134:6832/3114005030 2024-04-25T12:22:21.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.358+0000 7f3dc69e6000 1 --2- 172.21.15.86:0/890343250 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c6f0c81190 0x55c6f0cf1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.358+0000 7f3dc69e6000 1 -- 172.21.15.86:0/890343250 >> 172.21.15.86:0/890343250 conn(0x55c6f0cb8e40 msgr2=0x55c6f0cd57e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:21.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.358+0000 7f3dc69e6000 1 -- 172.21.15.86:0/890343250 shutdown_connections 2024-04-25T12:22:21.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.358+0000 7f3dc69e6000 1 -- 172.21.15.86:0/890343250 wait complete. 2024-04-25T12:22:21.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.358+0000 7f3dc69e6000 20 client.4839 trim_cache size 0 max 16384 2024-04-25T12:22:21.367 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-25T12:22:21.368 INFO:teuthology.orchestra.run.smithi086.stdout: "cluster_fsid": "f2ef5c0c-9576-4650-b4f7-6cb14247f62a", 2024-04-25T12:22:21.368 INFO:teuthology.orchestra.run.smithi086.stdout: "whoami": 2, 2024-04-25T12:22:21.368 INFO:teuthology.orchestra.run.smithi086.stdout: "id": 4245, 2024-04-25T12:22:21.368 INFO:teuthology.orchestra.run.smithi086.stdout: "want_state": "up:active", 2024-04-25T12:22:21.368 INFO:teuthology.orchestra.run.smithi086.stdout: "state": "up:active", 2024-04-25T12:22:21.368 INFO:teuthology.orchestra.run.smithi086.stdout: "fs_name": "cephfs", 2024-04-25T12:22:21.368 INFO:teuthology.orchestra.run.smithi086.stdout: "rank_uptime": 23.031302339, 2024-04-25T12:22:21.368 INFO:teuthology.orchestra.run.smithi086.stdout: "mdsmap_epoch": 19, 2024-04-25T12:22:21.368 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch": 26, 2024-04-25T12:22:21.368 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch_barrier": 26, 2024-04-25T12:22:21.368 INFO:teuthology.orchestra.run.smithi086.stdout: "uptime": 63.961169667 2024-04-25T12:22:21.368 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-25T12:22:21.369 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.358+0000 7f3dc3864640 1 -- 172.21.15.86:0/3659657310 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f3da0068380 msgr2=0x7f3da006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:21.369 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.358+0000 7f3dc3864640 1 --2- 172.21.15.86:0/3659657310 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f3da0068380 0x7f3da006a840 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3db8000f70 tx=0x7f3db8007cd0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.358+0000 7f3dc3864640 1 -- 172.21.15.86:0/3659657310 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3dbc15ee20 msgr2=0x7f3dbc156530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:21.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.358+0000 7f3dc3864640 1 --2- 172.21.15.86:0/3659657310 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3dbc15ee20 0x7f3dbc156530 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f3db40af040 tx=0x7f3db40197d0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.358+0000 7f3dc3864640 1 -- 172.21.15.86:0/3659657310 shutdown_connections 2024-04-25T12:22:21.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.358+0000 7f3dc3864640 1 --2- 172.21.15.86:0/3659657310 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f3da0068380 0x7f3da006a840 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.358+0000 7f3dc3864640 1 --2- 172.21.15.86:0/3659657310 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3dbc15ee20 0x7f3dbc156530 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.358+0000 7f3dc3864640 1 --2- 172.21.15.86:0/3659657310 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3dbc155300 0x7f3dbc146630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.358+0000 7f3dc3864640 1 --2- 172.21.15.86:0/3659657310 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3dbc06f700 0x7f3dbc157680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.358+0000 7f3dc3864640 1 -- 172.21.15.86:0/3659657310 >> 172.21.15.86:0/3659657310 conn(0x7f3dbc06b9d0 msgr2=0x7f3dbc1534a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:21.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.358+0000 7f3dc3864640 1 -- 172.21.15.86:0/3659657310 shutdown_connections 2024-04-25T12:22:21.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.358+0000 7f3dc3864640 1 -- 172.21.15.86:0/3659657310 wait complete. 2024-04-25T12:22:21.378 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-25T12:22:21.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.486+0000 7ff4970c9640 1 Processor -- start 2024-04-25T12:22:21.491 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.486+0000 7ff4970c9640 1 -- start start 2024-04-25T12:22:21.492 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.490+0000 7ff4970c9640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff490152240 0x7ff490158950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.492 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.490+0000 7ff4970c9640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff490152620 con 0x7ff4900c6030 2024-04-25T12:22:21.492 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.490+0000 7ff4970c9640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4900c8ae0 con 0x7ff4900c8640 2024-04-25T12:22:21.492 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.490+0000 7ff4970c9640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7ff490158e90 con 0x7ff490152240 2024-04-25T12:22:21.492 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.490+0000 7ff494e65640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff490152240 0x7ff490158950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.493 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.490+0000 7ff494e65640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff490152240 0x7ff490158950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38782/0 (socket says 172.21.15.86:38782) 2024-04-25T12:22:21.493 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.490+0000 7ff494e65640 1 -- 172.21.15.86:0/829249721 learned_addr learned my addr 172.21.15.86:0/829249721 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:21.493 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.490+0000 7ff495666640 1 --1- 172.21.15.86:0/829249721 >> v1:172.21.15.86:6789/0 conn(0x7ff4900c6030 0x7ff4900c6440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:43316/0 (socket says 172.21.15.86:43316) 2024-04-25T12:22:21.493 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.490+0000 7ff494e65640 1 -- 172.21.15.86:0/829249721 >> v1:172.21.15.134:6789/0 conn(0x7ff4900c8640 legacy=0x7ff4900cd640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:21.493 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.490+0000 7ff494e65640 1 -- 172.21.15.86:0/829249721 >> v1:172.21.15.86:6789/0 conn(0x7ff4900c6030 legacy=0x7ff4900c6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:21.493 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.490+0000 7ff494e65640 1 -- 172.21.15.86:0/829249721 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff49015b480 con 0x7ff490152240 2024-04-25T12:22:21.493 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.490+0000 7ff48f7fe640 1 -- 172.21.15.86:0/829249721 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3231937126 0 0) 0x7ff490152620 con 0x7ff4900c6030 2024-04-25T12:22:21.494 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.490+0000 7ff494e65640 1 --2- 172.21.15.86:0/829249721 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff490152240 0x7ff490158950 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff480009870 tx=0x7ff48001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c41464571d53568 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:21.494 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.490+0000 7ff48f7fe640 1 -- 172.21.15.86:0/829249721 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4800b5070 con 0x7ff490152240 2024-04-25T12:22:21.494 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.490+0000 7ff48f7fe640 1 -- 172.21.15.86:0/829249721 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4800a8a10 con 0x7ff490152240 2024-04-25T12:22:21.494 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.490+0000 7ff48f7fe640 1 -- 172.21.15.86:0/829249721 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4800a8de0 con 0x7ff490152240 2024-04-25T12:22:21.495 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.490+0000 7ff4970c9640 1 -- 172.21.15.86:0/829249721 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff490152240 msgr2=0x7ff490158950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:21.495 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.490+0000 7ff4970c9640 1 --2- 172.21.15.86:0/829249721 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff490152240 0x7ff490158950 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff480009870 tx=0x7ff48001ed10 comp rx=0 tx=0).stop 2024-04-25T12:22:21.495 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.494+0000 7ff4970c9640 1 -- 172.21.15.86:0/829249721 shutdown_connections 2024-04-25T12:22:21.495 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.494+0000 7ff4970c9640 1 --2- 172.21.15.86:0/829249721 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff490152240 0x7ff490158950 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.495 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.494+0000 7ff4970c9640 1 -- 172.21.15.86:0/829249721 >> 172.21.15.86:0/829249721 conn(0x7ff49006fca0 msgr2=0x7ff4900700b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:21.496 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.494+0000 7ff4970c9640 1 -- 172.21.15.86:0/829249721 shutdown_connections 2024-04-25T12:22:21.496 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.494+0000 7ff4970c9640 1 -- 172.21.15.86:0/829249721 wait complete. 2024-04-25T12:22:21.496 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.494+0000 7ff4970c9640 1 Processor -- start 2024-04-25T12:22:21.496 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.494+0000 7ff4970c9640 1 -- start start 2024-04-25T12:22:21.498 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.494+0000 7ff4970c9640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4900c6030 0x7ff4901f15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.498 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.494+0000 7ff4970c9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4900c8640 0x7ff490156b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.499 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.494+0000 7ff4970c9640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff490152240 0x7ff49015a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.499 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.494+0000 7ff4970c9640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff49015bd20 con 0x7ff4900c6030 2024-04-25T12:22:21.499 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.494+0000 7ff4970c9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff49015ba40 con 0x7ff4900c8640 2024-04-25T12:22:21.499 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.494+0000 7ff4970c9640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7ff49015c000 con 0x7ff490152240 2024-04-25T12:22:21.499 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.494+0000 7ff494e65640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4900c6030 0x7ff4901f15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.499 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.494+0000 7ff494e65640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4900c6030 0x7ff4901f15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38796/0 (socket says 172.21.15.86:38796) 2024-04-25T12:22:21.499 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.494+0000 7ff494e65640 1 -- 172.21.15.86:0/2373260994 learned_addr learned my addr 172.21.15.86:0/2373260994 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:21.499 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.494+0000 7ff495666640 1 --2- 172.21.15.86:0/2373260994 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff490152240 0x7ff49015a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.499 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.494+0000 7ff494e65640 1 -- 172.21.15.86:0/2373260994 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff490152240 msgr2=0x7ff49015a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:21.499 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.494+0000 7ff48ffff640 1 --2- 172.21.15.86:0/2373260994 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4900c8640 0x7ff490156b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.499 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.494+0000 7ff494e65640 1 --2- 172.21.15.86:0/2373260994 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff490152240 0x7ff49015a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.499 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.494+0000 7ff494e65640 1 -- 172.21.15.86:0/2373260994 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4900c8640 msgr2=0x7ff490156b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:21.499 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.494+0000 7ff494e65640 1 --2- 172.21.15.86:0/2373260994 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4900c8640 0x7ff490156b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.500 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.494+0000 7ff494e65640 1 -- 172.21.15.86:0/2373260994 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4900ca030 con 0x7ff4900c6030 2024-04-25T12:22:21.500 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.494+0000 7ff494e65640 1 --2- 172.21.15.86:0/2373260994 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4900c6030 0x7ff4901f15a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff48001b920 tx=0x7ff48001bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:21.500 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.494+0000 7ff48d7fa640 1 -- 172.21.15.86:0/2373260994 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4800b5070 con 0x7ff4900c6030 2024-04-25T12:22:21.500 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.494+0000 7ff48d7fa640 1 -- 172.21.15.86:0/2373260994 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4800b0c20 con 0x7ff4900c6030 2024-04-25T12:22:21.500 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.494+0000 7ff4970c9640 1 -- 172.21.15.86:0/2373260994 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff490157080 con 0x7ff4900c6030 2024-04-25T12:22:21.500 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.494+0000 7ff48d7fa640 1 -- 172.21.15.86:0/2373260994 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4800bb410 con 0x7ff4900c6030 2024-04-25T12:22:21.500 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.494+0000 7ff4970c9640 1 -- 172.21.15.86:0/2373260994 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4901516d0 con 0x7ff4900c6030 2024-04-25T12:22:21.501 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.498+0000 7ff48d7fa640 1 -- 172.21.15.86:0/2373260994 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff4800c2060 con 0x7ff4900c6030 2024-04-25T12:22:21.501 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.498+0000 7ff48d7fa640 1 --2- 172.21.15.86:0/2373260994 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7ff47c0683b0 0x7ff47c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.501 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.498+0000 7ff48d7fa640 1 -- 172.21.15.86:0/2373260994 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7ff480123f70 con 0x7ff4900c6030 2024-04-25T12:22:21.501 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.498+0000 7ff48ffff640 1 --2- 172.21.15.86:0/2373260994 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7ff47c0683b0 0x7ff47c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.501 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.498+0000 7ff48ffff640 1 --2- 172.21.15.86:0/2373260994 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7ff47c0683b0 0x7ff47c06a870 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff49014eaf0 tx=0x7ff484009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:21.501 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.498+0000 7ff49a24b000 1 Processor -- start 2024-04-25T12:22:21.501 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.498+0000 7ff49a24b000 1 -- start start 2024-04-25T12:22:21.503 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.498+0000 7ff49a24b000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556f89f62190 0x556f89f62570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.504 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.498+0000 7ff49a24b000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556f89f62ab0 0x556f89f9d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.504 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.498+0000 7ff49a24b000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556f89f9d5c0 0x556f89f9d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.504 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.498+0000 7ff49a24b000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x556f89dab420 con 0x556f89f62ab0 2024-04-25T12:22:21.504 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.498+0000 7ff49a24b000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x556f89d45bf0 con 0x556f89f9d5c0 2024-04-25T12:22:21.504 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.498+0000 7ff49a24b000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x556f89da73e0 con 0x556f89f62190 2024-04-25T12:22:21.504 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.498+0000 7ff48ffff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556f89f62ab0 0x556f89f9d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.504 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.498+0000 7ff48ffff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556f89f62ab0 0x556f89f9d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38810/0 (socket says 172.21.15.86:38810) 2024-04-25T12:22:21.504 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.498+0000 7ff48ffff640 1 -- 172.21.15.86:0/2264456459 learned_addr learned my addr 172.21.15.86:0/2264456459 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:21.504 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.498+0000 7ff48ffff640 1 -- 172.21.15.86:0/2264456459 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556f89f62190 msgr2=0x556f89f62570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:21.504 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.498+0000 7ff48ffff640 1 --2- 172.21.15.86:0/2264456459 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556f89f62190 0x556f89f62570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.504 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.498+0000 7ff48ffff640 1 -- 172.21.15.86:0/2264456459 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556f89f9d5c0 msgr2=0x556f89f9d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:21.504 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.498+0000 7ff48ffff640 1 --2- 172.21.15.86:0/2264456459 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556f89f9d5c0 0x556f89f9d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.504 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.498+0000 7ff48ffff640 1 -- 172.21.15.86:0/2264456459 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f89e53450 con 0x556f89f62ab0 2024-04-25T12:22:21.505 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.498+0000 7ff48ffff640 1 --2- 172.21.15.86:0/2264456459 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556f89f62ab0 0x556f89f9d080 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff48400d7e0 tx=0x7ff484010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acb626b7a279d5e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:21.505 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.498+0000 7ff4767fc640 1 -- 172.21.15.86:0/2264456459 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff484005220 con 0x556f89f62ab0 2024-04-25T12:22:21.505 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.498+0000 7ff4767fc640 1 -- 172.21.15.86:0/2264456459 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4840053c0 con 0x556f89f62ab0 2024-04-25T12:22:21.505 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.498+0000 7ff4767fc640 1 -- 172.21.15.86:0/2264456459 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff484014ba0 con 0x556f89f62ab0 2024-04-25T12:22:21.505 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.502+0000 7ff49a24b000 1 -- 172.21.15.86:0/2264456459 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556f89f62ab0 msgr2=0x556f89f9d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:21.505 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.502+0000 7ff49a24b000 1 --2- 172.21.15.86:0/2264456459 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556f89f62ab0 0x556f89f9d080 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff48400d7e0 tx=0x7ff484010000 comp rx=0 tx=0).stop 2024-04-25T12:22:21.505 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.502+0000 7ff49a24b000 1 -- 172.21.15.86:0/2264456459 shutdown_connections 2024-04-25T12:22:21.505 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.502+0000 7ff49a24b000 1 --2- 172.21.15.86:0/2264456459 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556f89f9d5c0 0x556f89f9d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.505 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.502+0000 7ff49a24b000 1 --2- 172.21.15.86:0/2264456459 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556f89f62ab0 0x556f89f9d080 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.505 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.502+0000 7ff49a24b000 1 --2- 172.21.15.86:0/2264456459 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556f89f62190 0x556f89f62570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.505 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.502+0000 7ff49a24b000 1 -- 172.21.15.86:0/2264456459 >> 172.21.15.86:0/2264456459 conn(0x556f89f99e40 msgr2=0x556f89f9c260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:21.505 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.502+0000 7ff49a24b000 1 -- 172.21.15.86:0/2264456459 shutdown_connections 2024-04-25T12:22:21.505 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.502+0000 7ff49a24b000 1 -- 172.21.15.86:0/2264456459 wait complete. 2024-04-25T12:22:21.505 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.502+0000 7ff49a24b000 1 -- start start 2024-04-25T12:22:21.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.502+0000 7ff49a24b000 1 Processor -- start 2024-04-25T12:22:21.509 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.502+0000 7ff49a24b000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556f89f62190 0x556f89f5ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.509 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.502+0000 7ff49a24b000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556f89f62ab0 0x556f89f5f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.509 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.502+0000 7ff49a24b000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556f89f9d5c0 0x556f89f5f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.509 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.502+0000 7ff49a24b000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x556f89d4bec0 con 0x556f89f62190 2024-04-25T12:22:21.509 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.502+0000 7ff49a24b000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x556f89e2c120 con 0x556f89f9d5c0 2024-04-25T12:22:21.509 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.502+0000 7ff49a24b000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x556f89db6350 con 0x556f89f62ab0 2024-04-25T12:22:21.509 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.502+0000 7ff49a24b000 10 client.0 _ll_register_callbacks cb 0x556f89d884d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T12:22:21.510 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.502+0000 7ff494e65640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556f89f62190 0x556f89f5ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.510 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.502+0000 7ff494e65640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556f89f62190 0x556f89f5ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38818/0 (socket says 172.21.15.86:38818) 2024-04-25T12:22:21.510 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.502+0000 7ff494e65640 1 -- 172.21.15.86:0/4220319091 learned_addr learned my addr 172.21.15.86:0/4220319091 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:21.510 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.502+0000 7ff48ffff640 1 --2- 172.21.15.86:0/4220319091 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556f89f62ab0 0x556f89f5f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.510 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.502+0000 7ff494e65640 1 -- 172.21.15.86:0/4220319091 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556f89f62ab0 msgr2=0x556f89f5f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:21.510 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.502+0000 7ff494e65640 1 --2- 172.21.15.86:0/4220319091 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556f89f62ab0 0x556f89f5f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.510 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.502+0000 7ff494e65640 1 -- 172.21.15.86:0/4220319091 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556f89f9d5c0 msgr2=0x556f89f5f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:21.510 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.502+0000 7ff494e65640 1 --2- 172.21.15.86:0/4220319091 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556f89f9d5c0 0x556f89f5f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.510 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.502+0000 7ff494e65640 1 -- 172.21.15.86:0/4220319091 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f89df0f80 con 0x556f89f62190 2024-04-25T12:22:21.510 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.502+0000 7ff494e65640 1 --2- 172.21.15.86:0/4220319091 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556f89f62190 0x556f89f5ebb0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff4800efe90 tx=0x7ff4800f3630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6f77d9dc8d596aa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:21.510 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.502+0000 7ff46f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-04-25T12:22:21.510 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.502+0000 7ff46f7fe640 1 -- 172.21.15.86:0/4220319091 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4800afe80 con 0x556f89f62190 2024-04-25T12:22:21.510 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.502+0000 7ff46f7fe640 1 -- 172.21.15.86:0/4220319091 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7ff4800fa0b0 con 0x556f89f62190 2024-04-25T12:22:21.510 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.502+0000 7ff49a24b000 1 -- 172.21.15.86:0/4220319091 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4840053c0 con 0x556f89f62190 2024-04-25T12:22:21.511 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.502+0000 7ff46f7fe640 1 -- 172.21.15.86:0/4220319091 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ff4800f3a30 con 0x556f89f62190 2024-04-25T12:22:21.511 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.502+0000 7ff49a24b000 10 client.4854 fetch_fsmap learned FSMap version 19 2024-04-25T12:22:21.511 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.502+0000 7ff49a24b000 1 -- 172.21.15.86:0/4220319091 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x556f89d84f00 con 0x556f89f62190 2024-04-25T12:22:21.511 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.502+0000 7ff46f7fe640 1 -- 172.21.15.86:0/4220319091 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4840053c0 con 0x556f89f62190 2024-04-25T12:22:21.511 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.502+0000 7ff46f7fe640 1 -- 172.21.15.86:0/4220319091 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7ff48010f020 con 0x556f89f62190 2024-04-25T12:22:21.511 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.502+0000 7ff49a24b000 10 client.4854 fetch_fsmap finished waiting for FSMap version 19 2024-04-25T12:22:21.511 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.502+0000 7ff49a24b000 10 client.4854 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T12:22:21.511 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.502+0000 7ff49a24b000 20 client.4854 populate_metadata read hostname 'smithi086' 2024-04-25T12:22:21.511 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.502+0000 7ff49a24b000 1 --2- 172.21.15.86:0/4220319091 >> [v2:172.21.15.134:6835/1079608447,v1:172.21.15.134:6837/1079608447] conn(0x556f89fb1d90 0x556f89fb4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.511 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.502+0000 7ff49a24b000 4 client.4854 mds_command: new command op to 4262 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T12:22:21.511 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.502+0000 7ff49a24b000 1 -- 172.21.15.86:0/4220319091 --> [v2:172.21.15.134:6835/1079608447,v1:172.21.15.134:6837/1079608447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556f89d44bc0 con 0x556f89fb1d90 2024-04-25T12:22:21.511 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.502+0000 7ff48ffff640 1 --2- 172.21.15.86:0/4220319091 >> [v2:172.21.15.134:6835/1079608447,v1:172.21.15.134:6837/1079608447] conn(0x556f89fb1d90 0x556f89fb4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.511 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.502+0000 7ff46f7fe640 10 client.4854 ms_handle_connect on v2:172.21.15.134:6835/1079608447 2024-04-25T12:22:21.511 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.502+0000 7ff48ffff640 1 --2- 172.21.15.86:0/4220319091 >> [v2:172.21.15.134:6835/1079608447,v1:172.21.15.134:6837/1079608447] conn(0x556f89fb1d90 0x556f89fb4180 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=af5c1a16d1fea14 server_cookie=4515848bfb0d41ee in_seq=0 out_seq=0 2024-04-25T12:22:21.512 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.506+0000 7ff46f7fe640 1 -- 172.21.15.86:0/4220319091 <== mds.1 v2:172.21.15.134:6835/1079608447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x556f89d44bc0 con 0x556f89fb1d90 2024-04-25T12:22:21.512 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.506+0000 7ff46f7fe640 10 client.4854 handle_command_reply: tid=0 2024-04-25T12:22:21.512 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.506+0000 7ff49a24b000 1 client.4854 shutdown 2024-04-25T12:22:21.512 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.506+0000 7ff49a24b000 1 -- 172.21.15.86:0/4220319091 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556f89f62190 msgr2=0x556f89f5ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:21.512 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.506+0000 7ff49a24b000 1 --2- 172.21.15.86:0/4220319091 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556f89f62190 0x556f89f5ebb0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff4800efe90 tx=0x7ff4800f3630 comp rx=0 tx=0).stop 2024-04-25T12:22:21.512 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.506+0000 7ff49a24b000 1 -- 172.21.15.86:0/4220319091 shutdown_connections 2024-04-25T12:22:21.512 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.506+0000 7ff49a24b000 1 --2- 172.21.15.86:0/4220319091 >> [v2:172.21.15.134:6835/1079608447,v1:172.21.15.134:6837/1079608447] conn(0x556f89fb1d90 0x556f89fb4180 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.512 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.506+0000 7ff49a24b000 1 --2- 172.21.15.86:0/4220319091 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556f89f9d5c0 0x556f89f5f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.512 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.506+0000 7ff49a24b000 1 --2- 172.21.15.86:0/4220319091 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556f89f62ab0 0x556f89f5f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.512 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.506+0000 7ff49a24b000 1 --2- 172.21.15.86:0/4220319091 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556f89f62190 0x556f89f5ebb0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.512 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.506+0000 7ff46f7fe640 0 client.4854 ms_handle_reset on v2:172.21.15.134:6835/1079608447 2024-04-25T12:22:21.512 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.506+0000 7ff49a24b000 1 -- 172.21.15.86:0/4220319091 >> 172.21.15.86:0/4220319091 conn(0x556f89f99e40 msgr2=0x556f89f9b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:21.512 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.506+0000 7ff49a24b000 1 -- 172.21.15.86:0/4220319091 shutdown_connections 2024-04-25T12:22:21.512 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.506+0000 7ff49a24b000 1 -- 172.21.15.86:0/4220319091 wait complete. 2024-04-25T12:22:21.512 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.506+0000 7ff49a24b000 20 client.4854 trim_cache size 0 max 16384 2024-04-25T12:22:21.526 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.522+0000 7ff49a24b000 1 Processor -- start 2024-04-25T12:22:21.526 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.522+0000 7ff49a24b000 1 -- start start 2024-04-25T12:22:21.528 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.526+0000 7ff49a24b000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556f89f62190 0x556f89f97e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.528 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.526+0000 7ff49a24b000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556f89f62ab0 0x556f89f983d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.526+0000 7ff49a24b000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556f89f9d5c0 0x556f8a014af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.526+0000 7ff49a24b000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff4901febb0 con 0x556f89f62190 2024-04-25T12:22:21.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.526+0000 7ff49a24b000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff4901f4e70 con 0x556f89f62ab0 2024-04-25T12:22:21.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.526+0000 7ff49a24b000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x556f89d779e0 con 0x556f89f9d5c0 2024-04-25T12:22:21.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.526+0000 7ff494e65640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556f89f62190 0x556f89f97e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.526+0000 7ff494e65640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556f89f62190 0x556f89f97e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38822/0 (socket says 172.21.15.86:38822) 2024-04-25T12:22:21.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.526+0000 7ff494e65640 1 -- 172.21.15.86:0/1539102280 learned_addr learned my addr 172.21.15.86:0/1539102280 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:21.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.526+0000 7ff494e65640 1 -- 172.21.15.86:0/1539102280 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556f89f9d5c0 msgr2=0x556f8a014af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:21.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.526+0000 7ff494e65640 1 --2- 172.21.15.86:0/1539102280 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556f89f9d5c0 0x556f8a014af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.526+0000 7ff494e65640 1 -- 172.21.15.86:0/1539102280 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556f89f62ab0 msgr2=0x556f89f983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:21.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.526+0000 7ff494e65640 1 --2- 172.21.15.86:0/1539102280 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556f89f62ab0 0x556f89f983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.526+0000 7ff494e65640 1 -- 172.21.15.86:0/1539102280 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f89d31e80 con 0x556f89f62190 2024-04-25T12:22:21.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.526+0000 7ff494e65640 1 --2- 172.21.15.86:0/1539102280 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556f89f62190 0x556f89f97e90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff48009b530 tx=0x7ff48010a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a73a9bd654b24695 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:21.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.526+0000 7ff475ffb640 1 -- 172.21.15.86:0/1539102280 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4800afe80 con 0x556f89f62190 2024-04-25T12:22:21.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.526+0000 7ff475ffb640 1 -- 172.21.15.86:0/1539102280 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4800fc610 con 0x556f89f62190 2024-04-25T12:22:21.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.526+0000 7ff475ffb640 1 -- 172.21.15.86:0/1539102280 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4800fc3c0 con 0x556f89f62190 2024-04-25T12:22:21.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.526+0000 7ff49a24b000 1 -- 172.21.15.86:0/1539102280 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556f89f62190 msgr2=0x556f89f97e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:21.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.526+0000 7ff49a24b000 1 --2- 172.21.15.86:0/1539102280 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556f89f62190 0x556f89f97e90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff48009b530 tx=0x7ff48010a000 comp rx=0 tx=0).stop 2024-04-25T12:22:21.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.526+0000 7ff49a24b000 1 -- 172.21.15.86:0/1539102280 shutdown_connections 2024-04-25T12:22:21.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.526+0000 7ff49a24b000 1 --2- 172.21.15.86:0/1539102280 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556f89f9d5c0 0x556f8a014af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.526+0000 7ff49a24b000 1 --2- 172.21.15.86:0/1539102280 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556f89f62ab0 0x556f89f983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.526+0000 7ff49a24b000 1 --2- 172.21.15.86:0/1539102280 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556f89f62190 0x556f89f97e90 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.526+0000 7ff49a24b000 1 -- 172.21.15.86:0/1539102280 >> 172.21.15.86:0/1539102280 conn(0x556f89f99e40 msgr2=0x556f89f5bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:21.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.526+0000 7ff49a24b000 1 -- 172.21.15.86:0/1539102280 shutdown_connections 2024-04-25T12:22:21.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.526+0000 7ff49a24b000 1 -- 172.21.15.86:0/1539102280 wait complete. 2024-04-25T12:22:21.534 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.526+0000 7ff49a24b000 1 -- start start 2024-04-25T12:22:21.534 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.526+0000 7ff49a24b000 1 Processor -- start 2024-04-25T12:22:21.534 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.526+0000 7ff49a24b000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556f89f62190 0x556f8a0148e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.534 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.526+0000 7ff49a24b000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556f89f62ab0 0x556f8a014e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.535 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.526+0000 7ff49a24b000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556f89f9d5c0 0x556f8a015580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.535 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.526+0000 7ff49a24b000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x556f89dafa50 con 0x556f89f62ab0 2024-04-25T12:22:21.535 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.526+0000 7ff49a24b000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x556f89daa730 con 0x556f89f9d5c0 2024-04-25T12:22:21.535 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.526+0000 7ff49a24b000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x556f89db8630 con 0x556f89f62190 2024-04-25T12:22:21.535 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.526+0000 7ff49a24b000 10 client.0 _ll_register_callbacks cb 0x7ff4800f3800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T12:22:21.535 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.526+0000 7ff48ffff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556f89f62ab0 0x556f8a014e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.535 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.526+0000 7ff48ffff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556f89f62ab0 0x556f8a014e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38824/0 (socket says 172.21.15.86:38824) 2024-04-25T12:22:21.535 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.526+0000 7ff48ffff640 1 -- 172.21.15.86:0/3563318773 learned_addr learned my addr 172.21.15.86:0/3563318773 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:21.535 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.526+0000 7ff48ffff640 1 -- 172.21.15.86:0/3563318773 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556f89f62190 msgr2=0x556f8a0148e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:21.535 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.526+0000 7ff48ffff640 1 --2- 172.21.15.86:0/3563318773 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556f89f62190 0x556f8a0148e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.535 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.526+0000 7ff48ffff640 1 -- 172.21.15.86:0/3563318773 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556f89f9d5c0 msgr2=0x556f8a015580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:21.535 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.526+0000 7ff48ffff640 1 --2- 172.21.15.86:0/3563318773 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556f89f9d5c0 0x556f8a015580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.535 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.526+0000 7ff48ffff640 1 -- 172.21.15.86:0/3563318773 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f89d73b30 con 0x556f89f62ab0 2024-04-25T12:22:21.536 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.526+0000 7ff48ffff640 1 --2- 172.21.15.86:0/3563318773 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556f89f62ab0 0x556f8a014e20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff48400d780 tx=0x7ff484003770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acff8b57462e8aca server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:21.536 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.526+0000 7ff46f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-04-25T12:22:21.536 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.526+0000 7ff46f7fe640 1 -- 172.21.15.86:0/3563318773 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff484005020 con 0x556f89f62ab0 2024-04-25T12:22:21.536 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.526+0000 7ff46f7fe640 1 -- 172.21.15.86:0/3563318773 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7ff4840051c0 con 0x556f89f62ab0 2024-04-25T12:22:21.536 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.526+0000 7ff49a24b000 1 -- 172.21.15.86:0/3563318773 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4800fc610 con 0x556f89f62ab0 2024-04-25T12:22:21.536 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.526+0000 7ff46f7fe640 1 -- 172.21.15.86:0/3563318773 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ff4840053c0 con 0x556f89f62ab0 2024-04-25T12:22:21.536 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.526+0000 7ff49a24b000 10 client.4860 fetch_fsmap learned FSMap version 19 2024-04-25T12:22:21.536 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.526+0000 7ff49a24b000 1 -- 172.21.15.86:0/3563318773 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x556f89e2c5b0 con 0x556f89f62ab0 2024-04-25T12:22:21.536 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.526+0000 7ff46f7fe640 1 -- 172.21.15.86:0/3563318773 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4800fc610 con 0x556f89f62ab0 2024-04-25T12:22:21.536 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.530+0000 7ff46f7fe640 1 -- 172.21.15.86:0/3563318773 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7ff484004610 con 0x556f89f62ab0 2024-04-25T12:22:21.536 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.530+0000 7ff49a24b000 10 client.4860 fetch_fsmap finished waiting for FSMap version 19 2024-04-25T12:22:21.536 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.530+0000 7ff49a24b000 10 client.4860 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T12:22:21.536 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.530+0000 7ff49a24b000 20 client.4860 populate_metadata read hostname 'smithi086' 2024-04-25T12:22:21.536 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.530+0000 7ff49a24b000 1 --2- 172.21.15.86:0/3563318773 >> [v2:172.21.15.134:6835/1079608447,v1:172.21.15.134:6837/1079608447] conn(0x556f8a015ee0 0x556f8a0162c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.536 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.530+0000 7ff49a24b000 4 client.4860 mds_command: new command op to 4262 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T12:22:21.537 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.530+0000 7ff49a24b000 1 -- 172.21.15.86:0/3563318773 --> [v2:172.21.15.134:6835/1079608447,v1:172.21.15.134:6837/1079608447] -- command(tid 0: {"prefix": "status"}) -- 0x556f89db8e40 con 0x556f8a015ee0 2024-04-25T12:22:21.537 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.530+0000 7ff494e65640 1 --2- 172.21.15.86:0/3563318773 >> [v2:172.21.15.134:6835/1079608447,v1:172.21.15.134:6837/1079608447] conn(0x556f8a015ee0 0x556f8a0162c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.537 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.530+0000 7ff46f7fe640 10 client.4860 ms_handle_connect on v2:172.21.15.134:6835/1079608447 2024-04-25T12:22:21.537 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.530+0000 7ff494e65640 1 --2- 172.21.15.86:0/3563318773 >> [v2:172.21.15.134:6835/1079608447,v1:172.21.15.134:6837/1079608447] conn(0x556f8a015ee0 0x556f8a0162c0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=66fe11acc87e1340 server_cookie=ba0209d0cf9f9567 in_seq=0 out_seq=0 2024-04-25T12:22:21.537 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.530+0000 7ff46f7fe640 1 -- 172.21.15.86:0/3563318773 <== mds.1 v2:172.21.15.134:6835/1079608447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x556f89db8e40 con 0x556f8a015ee0 2024-04-25T12:22:21.537 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.530+0000 7ff46f7fe640 10 client.4860 handle_command_reply: tid=0 2024-04-25T12:22:21.537 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.530+0000 7ff49a24b000 1 client.4860 shutdown 2024-04-25T12:22:21.537 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.530+0000 7ff49a24b000 1 -- 172.21.15.86:0/3563318773 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556f89f62ab0 msgr2=0x556f8a014e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:21.537 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.530+0000 7ff49a24b000 1 --2- 172.21.15.86:0/3563318773 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556f89f62ab0 0x556f8a014e20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff48400d780 tx=0x7ff484003770 comp rx=0 tx=0).stop 2024-04-25T12:22:21.537 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.530+0000 7ff49a24b000 1 -- 172.21.15.86:0/3563318773 shutdown_connections 2024-04-25T12:22:21.537 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.530+0000 7ff49a24b000 1 --2- 172.21.15.86:0/3563318773 >> [v2:172.21.15.134:6835/1079608447,v1:172.21.15.134:6837/1079608447] conn(0x556f8a015ee0 0x556f8a0162c0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.537 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.530+0000 7ff49a24b000 1 --2- 172.21.15.86:0/3563318773 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556f89f9d5c0 0x556f8a015580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.530+0000 7ff49a24b000 1 --2- 172.21.15.86:0/3563318773 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556f89f62ab0 0x556f8a014e20 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.530+0000 7ff46f7fe640 0 client.4860 ms_handle_reset on v2:172.21.15.134:6835/1079608447 2024-04-25T12:22:21.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.530+0000 7ff49a24b000 1 --2- 172.21.15.86:0/3563318773 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556f89f62190 0x556f8a0148e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.530+0000 7ff49a24b000 1 -- 172.21.15.86:0/3563318773 >> 172.21.15.86:0/3563318773 conn(0x556f89f99e40 msgr2=0x556f89f5b110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:21.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.530+0000 7ff49a24b000 1 -- 172.21.15.86:0/3563318773 shutdown_connections 2024-04-25T12:22:21.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.530+0000 7ff49a24b000 1 -- 172.21.15.86:0/3563318773 wait complete. 2024-04-25T12:22:21.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.530+0000 7ff49a24b000 20 client.4860 trim_cache size 0 max 16384 2024-04-25T12:22:21.538 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-25T12:22:21.538 INFO:teuthology.orchestra.run.smithi086.stdout: "cluster_fsid": "f2ef5c0c-9576-4650-b4f7-6cb14247f62a", 2024-04-25T12:22:21.538 INFO:teuthology.orchestra.run.smithi086.stdout: "whoami": 1, 2024-04-25T12:22:21.538 INFO:teuthology.orchestra.run.smithi086.stdout: "id": 4262, 2024-04-25T12:22:21.539 INFO:teuthology.orchestra.run.smithi086.stdout: "want_state": "up:active", 2024-04-25T12:22:21.539 INFO:teuthology.orchestra.run.smithi086.stdout: "state": "up:active", 2024-04-25T12:22:21.539 INFO:teuthology.orchestra.run.smithi086.stdout: "fs_name": "cephfs", 2024-04-25T12:22:21.539 INFO:teuthology.orchestra.run.smithi086.stdout: "rank_uptime": 29.264464533999998, 2024-04-25T12:22:21.539 INFO:teuthology.orchestra.run.smithi086.stdout: "mdsmap_epoch": 19, 2024-04-25T12:22:21.539 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch": 26, 2024-04-25T12:22:21.539 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch_barrier": 26, 2024-04-25T12:22:21.539 INFO:teuthology.orchestra.run.smithi086.stdout: "uptime": 64.126088233000004 2024-04-25T12:22:21.539 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-25T12:22:21.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.530+0000 7ff4970c9640 1 -- 172.21.15.86:0/2373260994 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7ff47c0683b0 msgr2=0x7ff47c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:21.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.530+0000 7ff4970c9640 1 --2- 172.21.15.86:0/2373260994 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7ff47c0683b0 0x7ff47c06a870 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff49014eaf0 tx=0x7ff484009040 comp rx=0 tx=0).stop 2024-04-25T12:22:21.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.530+0000 7ff4970c9640 1 -- 172.21.15.86:0/2373260994 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4900c6030 msgr2=0x7ff4901f15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:21.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.530+0000 7ff4970c9640 1 --2- 172.21.15.86:0/2373260994 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4900c6030 0x7ff4901f15a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff48001b920 tx=0x7ff48001bab0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.530+0000 7ff4970c9640 1 -- 172.21.15.86:0/2373260994 shutdown_connections 2024-04-25T12:22:21.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.530+0000 7ff4970c9640 1 --2- 172.21.15.86:0/2373260994 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff490152240 0x7ff49015a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.530+0000 7ff4970c9640 1 --2- 172.21.15.86:0/2373260994 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4900c8640 0x7ff490156b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.530+0000 7ff4970c9640 1 --2- 172.21.15.86:0/2373260994 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7ff47c0683b0 0x7ff47c06a870 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.530+0000 7ff4970c9640 1 --2- 172.21.15.86:0/2373260994 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4900c6030 0x7ff4901f15a0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.530+0000 7ff4970c9640 1 -- 172.21.15.86:0/2373260994 >> 172.21.15.86:0/2373260994 conn(0x7ff49006fca0 msgr2=0x7ff4900c6410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:21.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.530+0000 7ff4970c9640 1 -- 172.21.15.86:0/2373260994 shutdown_connections 2024-04-25T12:22:21.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.530+0000 7ff4970c9640 1 -- 172.21.15.86:0/2373260994 wait complete. 2024-04-25T12:22:21.549 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-04-25T12:22:21.658 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.654+0000 7f5baeff8640 1 Processor -- start 2024-04-25T12:22:21.658 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.654+0000 7f5baeff8640 1 -- start start 2024-04-25T12:22:21.660 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.658+0000 7f5baeff8640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5ba81596b0 0x7f5ba8163380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.660 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.658+0000 7f5baeff8640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ba81638c0 con 0x7f5ba80c8040 2024-04-25T12:22:21.660 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.658+0000 7f5baeff8640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ba8159a90 con 0x7f5ba815f3d0 2024-04-25T12:22:21.660 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.658+0000 7f5baeff8640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f5ba815f880 con 0x7f5ba81596b0 2024-04-25T12:22:21.660 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.658+0000 7f5bacd94640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5ba81596b0 0x7f5ba8163380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.660 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.658+0000 7f5bacd94640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5ba81596b0 0x7f5ba8163380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38840/0 (socket says 172.21.15.86:38840) 2024-04-25T12:22:21.660 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.658+0000 7f5bacd94640 1 -- 172.21.15.86:0/744714768 learned_addr learned my addr 172.21.15.86:0/744714768 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:21.660 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.658+0000 7f5bacd94640 1 -- 172.21.15.86:0/744714768 >> v1:172.21.15.134:6789/0 conn(0x7f5ba815f3d0 legacy=0x7f5ba806cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:21.660 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.658+0000 7f5bacd94640 1 -- 172.21.15.86:0/744714768 >> v1:172.21.15.86:6789/0 conn(0x7f5ba80c8040 legacy=0x7f5ba8072790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:21.660 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.658+0000 7f5bacd94640 1 -- 172.21.15.86:0/744714768 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ba815fb60 con 0x7f5ba81596b0 2024-04-25T12:22:21.662 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.658+0000 7f5bacd94640 1 --2- 172.21.15.86:0/744714768 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ba81596b0 0x7f5ba8163380 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5ba0009e50 tx=0x7f5ba001f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4d942fbf4181e22 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:21.662 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.658+0000 7f5ba77fe640 1 -- 172.21.15.86:0/744714768 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba00b4070 con 0x7f5ba81596b0 2024-04-25T12:22:21.662 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.658+0000 7f5ba77fe640 1 -- 172.21.15.86:0/744714768 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ba00af400 con 0x7f5ba81596b0 2024-04-25T12:22:21.662 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.658+0000 7f5ba77fe640 1 -- 172.21.15.86:0/744714768 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba00af7d0 con 0x7f5ba81596b0 2024-04-25T12:22:21.663 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.658+0000 7f5baeff8640 1 -- 172.21.15.86:0/744714768 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ba81596b0 msgr2=0x7f5ba8163380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:21.663 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.658+0000 7f5baeff8640 1 --2- 172.21.15.86:0/744714768 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ba81596b0 0x7f5ba8163380 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5ba0009e50 tx=0x7f5ba001f1e0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.663 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.658+0000 7f5baeff8640 1 -- 172.21.15.86:0/744714768 shutdown_connections 2024-04-25T12:22:21.663 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.658+0000 7f5baeff8640 1 --2- 172.21.15.86:0/744714768 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ba81596b0 0x7f5ba8163380 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.663 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.658+0000 7f5baeff8640 1 -- 172.21.15.86:0/744714768 >> 172.21.15.86:0/744714768 conn(0x7f5ba80ca540 msgr2=0x7f5ba80ca950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:21.663 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.658+0000 7f5baeff8640 1 -- 172.21.15.86:0/744714768 shutdown_connections 2024-04-25T12:22:21.663 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.658+0000 7f5baeff8640 1 -- 172.21.15.86:0/744714768 wait complete. 2024-04-25T12:22:21.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.662+0000 7f5baeff8640 1 Processor -- start 2024-04-25T12:22:21.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.662+0000 7f5baeff8640 1 -- start start 2024-04-25T12:22:21.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.662+0000 7f5baeff8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ba80c8040 0x7f5ba8158600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.662+0000 7f5baeff8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5ba81596b0 0x7f5ba81f8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.662+0000 7f5baeff8640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ba815f3d0 0x7f5ba814d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.662+0000 7f5baeff8640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f5ba8072270 con 0x7f5ba815f3d0 2024-04-25T12:22:21.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.662+0000 7f5baeff8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5ba8160120 con 0x7f5ba80c8040 2024-04-25T12:22:21.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.662+0000 7f5baeff8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f5ba806d5f0 con 0x7f5ba81596b0 2024-04-25T12:22:21.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.662+0000 7f5bad595640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ba815f3d0 0x7f5ba814d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.662+0000 7f5bad595640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ba815f3d0 0x7f5ba814d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38842/0 (socket says 172.21.15.86:38842) 2024-04-25T12:22:21.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.662+0000 7f5bad595640 1 -- 172.21.15.86:0/3520938848 learned_addr learned my addr 172.21.15.86:0/3520938848 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:21.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.662+0000 7f5ba7fff640 1 --2- 172.21.15.86:0/3520938848 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5ba81596b0 0x7f5ba81f8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.662+0000 7f5bacd94640 1 --2- 172.21.15.86:0/3520938848 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ba80c8040 0x7f5ba8158600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.662+0000 7f5bad595640 1 -- 172.21.15.86:0/3520938848 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5ba81596b0 msgr2=0x7f5ba81f8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:21.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.662+0000 7f5bad595640 1 --2- 172.21.15.86:0/3520938848 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5ba81596b0 0x7f5ba81f8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.662+0000 7f5bad595640 1 -- 172.21.15.86:0/3520938848 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ba80c8040 msgr2=0x7f5ba8158600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:21.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.662+0000 7f5bad595640 1 --2- 172.21.15.86:0/3520938848 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ba80c8040 0x7f5ba8158600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.662+0000 7f5bad595640 1 -- 172.21.15.86:0/3520938848 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ba81eb210 con 0x7f5ba815f3d0 2024-04-25T12:22:21.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.662+0000 7f5bacd94640 1 --2- 172.21.15.86:0/3520938848 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ba80c8040 0x7f5ba8158600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:22:21.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.662+0000 7f5bad595640 1 --2- 172.21.15.86:0/3520938848 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ba815f3d0 0x7f5ba814d760 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c00c3c0 tx=0x7f5b9c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:21.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.662+0000 7f5ba57fa640 1 -- 172.21.15.86:0/3520938848 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b9c0052d0 con 0x7f5ba815f3d0 2024-04-25T12:22:21.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.662+0000 7f5ba57fa640 1 -- 172.21.15.86:0/3520938848 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b9c005470 con 0x7f5ba815f3d0 2024-04-25T12:22:21.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.662+0000 7f5baeff8640 1 -- 172.21.15.86:0/3520938848 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ba81eb4d0 con 0x7f5ba815f3d0 2024-04-25T12:22:21.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.662+0000 7f5ba57fa640 1 -- 172.21.15.86:0/3520938848 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b9c007240 con 0x7f5ba815f3d0 2024-04-25T12:22:21.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.662+0000 7f5baeff8640 1 -- 172.21.15.86:0/3520938848 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ba81e8ab0 con 0x7f5ba815f3d0 2024-04-25T12:22:21.670 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.662+0000 7f5ba57fa640 1 -- 172.21.15.86:0/3520938848 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5b9c0073e0 con 0x7f5ba815f3d0 2024-04-25T12:22:21.670 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.666+0000 7f5ba57fa640 1 --2- 172.21.15.86:0/3520938848 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f5b94068380 0x7f5b9406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.670 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.666+0000 7f5ba57fa640 1 -- 172.21.15.86:0/3520938848 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f5b9c086220 con 0x7f5ba815f3d0 2024-04-25T12:22:21.670 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.666+0000 7f5bacd94640 1 --2- 172.21.15.86:0/3520938848 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f5b94068380 0x7f5b9406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.666+0000 7f5bacd94640 1 --2- 172.21.15.86:0/3520938848 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f5b94068380 0x7f5b9406a840 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5ba00b1000 tx=0x7f5ba00aa000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:21.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.666+0000 7f5bb217a000 1 Processor -- start 2024-04-25T12:22:21.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.666+0000 7f5bb217a000 1 -- start start 2024-04-25T12:22:21.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.666+0000 7f5bb217a000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560df6e24190 0x560df6e24570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.666+0000 7f5bb217a000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x560df6e24ab0 0x560df6e5f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.666+0000 7f5bb217a000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560df6e5f5c0 0x560df6e5f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.666+0000 7f5bb217a000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x560df6c6d420 con 0x560df6e5f5c0 2024-04-25T12:22:21.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.666+0000 7f5bb217a000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x560df6c07bf0 con 0x560df6e24190 2024-04-25T12:22:21.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.666+0000 7f5bb217a000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x560df6c693e0 con 0x560df6e24ab0 2024-04-25T12:22:21.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.666+0000 7f5bad595640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560df6e5f5c0 0x560df6e5f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.666+0000 7f5bad595640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560df6e5f5c0 0x560df6e5f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38844/0 (socket says 172.21.15.86:38844) 2024-04-25T12:22:21.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.666+0000 7f5bad595640 1 -- 172.21.15.86:0/3591317535 learned_addr learned my addr 172.21.15.86:0/3591317535 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:21.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.666+0000 7f5ba7fff640 1 --2- 172.21.15.86:0/3591317535 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x560df6e24ab0 0x560df6e5f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.666+0000 7f5bacd94640 1 --2- 172.21.15.86:0/3591317535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560df6e24190 0x560df6e24570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.666+0000 7f5bad595640 1 -- 172.21.15.86:0/3591317535 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x560df6e24ab0 msgr2=0x560df6e5f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:21.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.666+0000 7f5bad595640 1 --2- 172.21.15.86:0/3591317535 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x560df6e24ab0 0x560df6e5f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.666+0000 7f5bad595640 1 -- 172.21.15.86:0/3591317535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560df6e24190 msgr2=0x560df6e24570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:21.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.666+0000 7f5bad595640 1 --2- 172.21.15.86:0/3591317535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560df6e24190 0x560df6e24570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.666+0000 7f5bad595640 1 -- 172.21.15.86:0/3591317535 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560df6d15450 con 0x560df6e5f5c0 2024-04-25T12:22:21.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.666+0000 7f5bacd94640 1 --2- 172.21.15.86:0/3591317535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560df6e24190 0x560df6e24570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:22:21.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.666+0000 7f5bad595640 1 --2- 172.21.15.86:0/3591317535 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560df6e5f5c0 0x560df6e5f9a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c052140 tx=0x7f5b9c055930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3959ea971709d2c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:21.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.666+0000 7f5b8e7fc640 1 -- 172.21.15.86:0/3591317535 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b9c05e8c0 con 0x560df6e5f5c0 2024-04-25T12:22:21.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.666+0000 7f5b8e7fc640 1 -- 172.21.15.86:0/3591317535 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b9c053fe0 con 0x560df6e5f5c0 2024-04-25T12:22:21.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.666+0000 7f5b8e7fc640 1 -- 172.21.15.86:0/3591317535 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b9c052350 con 0x560df6e5f5c0 2024-04-25T12:22:21.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.666+0000 7f5bb217a000 1 -- 172.21.15.86:0/3591317535 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560df6e5f5c0 msgr2=0x560df6e5f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:21.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.666+0000 7f5bb217a000 1 --2- 172.21.15.86:0/3591317535 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560df6e5f5c0 0x560df6e5f9a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c052140 tx=0x7f5b9c055930 comp rx=0 tx=0).stop 2024-04-25T12:22:21.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.666+0000 7f5bb217a000 1 -- 172.21.15.86:0/3591317535 shutdown_connections 2024-04-25T12:22:21.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.666+0000 7f5bb217a000 1 --2- 172.21.15.86:0/3591317535 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560df6e5f5c0 0x560df6e5f9a0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.666+0000 7f5bb217a000 1 --2- 172.21.15.86:0/3591317535 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x560df6e24ab0 0x560df6e5f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.666+0000 7f5bb217a000 1 --2- 172.21.15.86:0/3591317535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560df6e24190 0x560df6e24570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.666+0000 7f5bb217a000 1 -- 172.21.15.86:0/3591317535 >> 172.21.15.86:0/3591317535 conn(0x560df6e5be40 msgr2=0x560df6e5e260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:21.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.666+0000 7f5bb217a000 1 -- 172.21.15.86:0/3591317535 shutdown_connections 2024-04-25T12:22:21.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.666+0000 7f5bb217a000 1 -- 172.21.15.86:0/3591317535 wait complete. 2024-04-25T12:22:21.676 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.666+0000 7f5bb217a000 1 -- start start 2024-04-25T12:22:21.676 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.670+0000 7f5bb217a000 1 Processor -- start 2024-04-25T12:22:21.676 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.670+0000 7f5bb217a000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560df6e24190 0x560df6e20bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.676 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.670+0000 7f5bb217a000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x560df6e24ab0 0x560df6e21110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.670+0000 7f5bb217a000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560df6e5f5c0 0x560df6e21650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.670+0000 7f5bb217a000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x560df6c0dec0 con 0x560df6e24190 2024-04-25T12:22:21.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.670+0000 7f5bb217a000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x560df6cee120 con 0x560df6e5f5c0 2024-04-25T12:22:21.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.670+0000 7f5bb217a000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x560df6c78350 con 0x560df6e24ab0 2024-04-25T12:22:21.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.670+0000 7f5bb217a000 10 client.0 _ll_register_callbacks cb 0x560df6c4a4d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T12:22:21.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.670+0000 7f5bacd94640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560df6e24190 0x560df6e20bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.670+0000 7f5bacd94640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560df6e24190 0x560df6e20bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38850/0 (socket says 172.21.15.86:38850) 2024-04-25T12:22:21.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.670+0000 7f5bacd94640 1 -- 172.21.15.86:0/1775301060 learned_addr learned my addr 172.21.15.86:0/1775301060 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:21.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.670+0000 7f5bacd94640 1 -- 172.21.15.86:0/1775301060 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x560df6e24ab0 msgr2=0x560df6e21110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:21.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.670+0000 7f5bacd94640 1 --2- 172.21.15.86:0/1775301060 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x560df6e24ab0 0x560df6e21110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.670+0000 7f5bad595640 1 --2- 172.21.15.86:0/1775301060 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560df6e5f5c0 0x560df6e21650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.670+0000 7f5bacd94640 1 -- 172.21.15.86:0/1775301060 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560df6e5f5c0 msgr2=0x560df6e21650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:21.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.670+0000 7f5bacd94640 1 --2- 172.21.15.86:0/1775301060 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560df6e5f5c0 0x560df6e21650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.670+0000 7f5bacd94640 1 -- 172.21.15.86:0/1775301060 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560df6cb2f80 con 0x560df6e24190 2024-04-25T12:22:21.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.670+0000 7f5bacd94640 1 --2- 172.21.15.86:0/1775301060 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560df6e24190 0x560df6e20bd0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f5ba00b2040 tx=0x7f5ba001da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebf45ee24135193 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:21.677 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.670+0000 7f5b877fe640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-04-25T12:22:21.678 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.670+0000 7f5b877fe640 1 -- 172.21.15.86:0/1775301060 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba00b4040 con 0x560df6e24190 2024-04-25T12:22:21.678 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.670+0000 7f5b877fe640 1 -- 172.21.15.86:0/1775301060 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f5ba00b9900 con 0x560df6e24190 2024-04-25T12:22:21.678 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.670+0000 7f5bb217a000 1 -- 172.21.15.86:0/1775301060 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b9c053fe0 con 0x560df6e24190 2024-04-25T12:22:21.678 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.670+0000 7f5b877fe640 1 -- 172.21.15.86:0/1775301060 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f5ba00d2050 con 0x560df6e24190 2024-04-25T12:22:21.678 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.670+0000 7f5bb217a000 10 client.4875 fetch_fsmap learned FSMap version 19 2024-04-25T12:22:21.678 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.670+0000 7f5bb217a000 1 -- 172.21.15.86:0/1775301060 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x560df6c46f00 con 0x560df6e24190 2024-04-25T12:22:21.678 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.670+0000 7f5b877fe640 1 -- 172.21.15.86:0/1775301060 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b9c053fe0 con 0x560df6e24190 2024-04-25T12:22:21.678 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.670+0000 7f5b877fe640 1 -- 172.21.15.86:0/1775301060 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7f5ba00d5020 con 0x560df6e24190 2024-04-25T12:22:21.678 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.670+0000 7f5bb217a000 10 client.4875 fetch_fsmap finished waiting for FSMap version 19 2024-04-25T12:22:21.678 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.670+0000 7f5bb217a000 10 client.4875 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-25T12:22:21.678 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.670+0000 7f5bb217a000 20 client.4875 populate_metadata read hostname 'smithi086' 2024-04-25T12:22:21.678 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.670+0000 7f5bb217a000 1 --2- 172.21.15.86:0/1775301060 >> [v2:172.21.15.134:6834/3044511437,v1:172.21.15.134:6836/3044511437] conn(0x560df6e73d90 0x560df6e76180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.678 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.670+0000 7f5bb217a000 4 client.4875 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T12:22:21.678 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.670+0000 7f5bb217a000 1 -- 172.21.15.86:0/1775301060 --> [v2:172.21.15.134:6834/3044511437,v1:172.21.15.134:6836/3044511437] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560df6c06bc0 con 0x560df6e73d90 2024-04-25T12:22:21.679 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.670+0000 7f5ba7fff640 1 --2- 172.21.15.86:0/1775301060 >> [v2:172.21.15.134:6834/3044511437,v1:172.21.15.134:6836/3044511437] conn(0x560df6e73d90 0x560df6e76180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.679 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.670+0000 7f5b877fe640 10 client.4875 ms_handle_connect on v2:172.21.15.134:6834/3044511437 2024-04-25T12:22:21.679 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.670+0000 7f5ba7fff640 1 --2- 172.21.15.86:0/1775301060 >> [v2:172.21.15.134:6834/3044511437,v1:172.21.15.134:6836/3044511437] conn(0x560df6e73d90 0x560df6e76180 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f7754b508d97a06 server_cookie=8d0c48e98edeec38 in_seq=0 out_seq=0 2024-04-25T12:22:21.679 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.674+0000 7f5b877fe640 1 -- 172.21.15.86:0/1775301060 <== mds.0 v2:172.21.15.134:6834/3044511437 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x560df6c06bc0 con 0x560df6e73d90 2024-04-25T12:22:21.679 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.674+0000 7f5b877fe640 10 client.4875 handle_command_reply: tid=0 2024-04-25T12:22:21.679 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.674+0000 7f5bb217a000 1 client.4875 shutdown 2024-04-25T12:22:21.679 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.674+0000 7f5bb217a000 1 -- 172.21.15.86:0/1775301060 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560df6e24190 msgr2=0x560df6e20bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:21.679 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.674+0000 7f5bb217a000 1 --2- 172.21.15.86:0/1775301060 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560df6e24190 0x560df6e20bd0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f5ba00b2040 tx=0x7f5ba001da20 comp rx=0 tx=0).stop 2024-04-25T12:22:21.679 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.674+0000 7f5bb217a000 1 -- 172.21.15.86:0/1775301060 shutdown_connections 2024-04-25T12:22:21.679 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.674+0000 7f5bb217a000 1 --2- 172.21.15.86:0/1775301060 >> [v2:172.21.15.134:6834/3044511437,v1:172.21.15.134:6836/3044511437] conn(0x560df6e73d90 0x560df6e76180 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.679 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.674+0000 7f5bb217a000 1 --2- 172.21.15.86:0/1775301060 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560df6e5f5c0 0x560df6e21650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.679 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.674+0000 7f5b877fe640 0 client.4875 ms_handle_reset on v2:172.21.15.134:6834/3044511437 2024-04-25T12:22:21.679 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.674+0000 7f5bb217a000 1 --2- 172.21.15.86:0/1775301060 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x560df6e24ab0 0x560df6e21110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.679 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.674+0000 7f5bb217a000 1 --2- 172.21.15.86:0/1775301060 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560df6e24190 0x560df6e20bd0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.679 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.674+0000 7f5bb217a000 1 -- 172.21.15.86:0/1775301060 >> 172.21.15.86:0/1775301060 conn(0x560df6e5be40 msgr2=0x560df6e5d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:21.679 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.674+0000 7f5bb217a000 1 -- 172.21.15.86:0/1775301060 shutdown_connections 2024-04-25T12:22:21.679 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.674+0000 7f5bb217a000 1 -- 172.21.15.86:0/1775301060 wait complete. 2024-04-25T12:22:21.680 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.674+0000 7f5bb217a000 20 client.4875 trim_cache size 0 max 16384 2024-04-25T12:22:21.693 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.690+0000 7f5bb217a000 1 Processor -- start 2024-04-25T12:22:21.693 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.690+0000 7f5bb217a000 1 -- start start 2024-04-25T12:22:21.695 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.690+0000 7f5bb217a000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560df6e24190 0x560df6e59e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.696 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.690+0000 7f5bb217a000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x560df6e24ab0 0x560df6e5a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.696 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.690+0000 7f5bb217a000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560df6e5f5c0 0x560df6e76180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.696 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.690+0000 7f5bb217a000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f5ba8202e30 con 0x560df6e24190 2024-04-25T12:22:21.696 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.690+0000 7f5bb217a000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5ba8203500 con 0x560df6e5f5c0 2024-04-25T12:22:21.696 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.690+0000 7f5bb217a000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f5ba82015a0 con 0x560df6e24ab0 2024-04-25T12:22:21.696 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.690+0000 7f5bacd94640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560df6e24190 0x560df6e59e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.696 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.690+0000 7f5bacd94640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560df6e24190 0x560df6e59e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38860/0 (socket says 172.21.15.86:38860) 2024-04-25T12:22:21.696 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.690+0000 7f5bacd94640 1 -- 172.21.15.86:0/1934565116 learned_addr learned my addr 172.21.15.86:0/1934565116 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:21.696 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.690+0000 7f5bacd94640 1 -- 172.21.15.86:0/1934565116 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x560df6e24ab0 msgr2=0x560df6e5a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:21.696 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.690+0000 7f5bacd94640 1 --2- 172.21.15.86:0/1934565116 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x560df6e24ab0 0x560df6e5a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.696 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.690+0000 7f5bacd94640 1 -- 172.21.15.86:0/1934565116 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560df6e5f5c0 msgr2=0x560df6e76180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:21.696 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.690+0000 7f5bacd94640 1 --2- 172.21.15.86:0/1934565116 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560df6e5f5c0 0x560df6e76180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.696 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.690+0000 7f5bacd94640 1 -- 172.21.15.86:0/1934565116 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560df6bf3e80 con 0x560df6e24190 2024-04-25T12:22:21.696 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.690+0000 7f5bacd94640 1 --2- 172.21.15.86:0/1934565116 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560df6e24190 0x560df6e59e90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5ba001bdf0 tx=0x7f5ba00bd070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24b27b4f70b1fc6c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:21.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.690+0000 7f5b8dffb640 1 -- 172.21.15.86:0/1934565116 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba00b9c90 con 0x560df6e24190 2024-04-25T12:22:21.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.690+0000 7f5b8dffb640 1 -- 172.21.15.86:0/1934565116 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ba00ca070 con 0x560df6e24190 2024-04-25T12:22:21.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.690+0000 7f5b8dffb640 1 -- 172.21.15.86:0/1934565116 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba00039a0 con 0x560df6e24190 2024-04-25T12:22:21.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.694+0000 7f5bb217a000 1 -- 172.21.15.86:0/1934565116 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560df6e24190 msgr2=0x560df6e59e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:21.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.694+0000 7f5bb217a000 1 --2- 172.21.15.86:0/1934565116 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560df6e24190 0x560df6e59e90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5ba001bdf0 tx=0x7f5ba00bd070 comp rx=0 tx=0).stop 2024-04-25T12:22:21.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.694+0000 7f5bb217a000 1 -- 172.21.15.86:0/1934565116 shutdown_connections 2024-04-25T12:22:21.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.694+0000 7f5bb217a000 1 --2- 172.21.15.86:0/1934565116 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560df6e5f5c0 0x560df6e76180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.694+0000 7f5bb217a000 1 --2- 172.21.15.86:0/1934565116 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x560df6e24ab0 0x560df6e5a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.694+0000 7f5bb217a000 1 --2- 172.21.15.86:0/1934565116 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560df6e24190 0x560df6e59e90 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.694+0000 7f5bb217a000 1 -- 172.21.15.86:0/1934565116 >> 172.21.15.86:0/1934565116 conn(0x560df6e5be40 msgr2=0x560df6e1dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:21.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.694+0000 7f5bb217a000 1 -- 172.21.15.86:0/1934565116 shutdown_connections 2024-04-25T12:22:21.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.694+0000 7f5bb217a000 1 -- 172.21.15.86:0/1934565116 wait complete. 2024-04-25T12:22:21.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.694+0000 7f5bb217a000 1 -- start start 2024-04-25T12:22:21.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.694+0000 7f5bb217a000 1 Processor -- start 2024-04-25T12:22:21.701 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.694+0000 7f5bb217a000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560df6e24190 0x560df6e788a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.701 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.694+0000 7f5bb217a000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x560df6e24ab0 0x560df6e94d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.701 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.694+0000 7f5bb217a000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560df6e5f5c0 0x560df6e952c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.701 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.694+0000 7f5bb217a000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x560df6c6c730 con 0x560df6e5f5c0 2024-04-25T12:22:21.701 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.694+0000 7f5bb217a000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x560df6c399e0 con 0x560df6e24190 2024-04-25T12:22:21.701 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.694+0000 7f5bb217a000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x560df6c71a50 con 0x560df6e24ab0 2024-04-25T12:22:21.701 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.694+0000 7f5bb217a000 10 client.0 _ll_register_callbacks cb 0x7f5ba00b2070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T12:22:21.701 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.694+0000 7f5bad595640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560df6e5f5c0 0x560df6e952c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.701 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.694+0000 7f5bad595640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560df6e5f5c0 0x560df6e952c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38872/0 (socket says 172.21.15.86:38872) 2024-04-25T12:22:21.702 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.694+0000 7f5bad595640 1 -- 172.21.15.86:0/2729969672 learned_addr learned my addr 172.21.15.86:0/2729969672 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:21.702 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.694+0000 7f5bad595640 1 -- 172.21.15.86:0/2729969672 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x560df6e24ab0 msgr2=0x560df6e94d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:21.702 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.694+0000 7f5bad595640 1 --2- 172.21.15.86:0/2729969672 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x560df6e24ab0 0x560df6e94d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.702 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.694+0000 7f5bad595640 1 -- 172.21.15.86:0/2729969672 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560df6e24190 msgr2=0x560df6e788a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:21.702 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.694+0000 7f5bad595640 1 --2- 172.21.15.86:0/2729969672 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560df6e24190 0x560df6e788a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.702 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.694+0000 7f5bad595640 1 -- 172.21.15.86:0/2729969672 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560df6c35b30 con 0x560df6e5f5c0 2024-04-25T12:22:21.702 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.694+0000 7f5bad595640 1 --2- 172.21.15.86:0/2729969672 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560df6e5f5c0 0x560df6e952c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c0559e0 tx=0x7f5b9c084220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e15d23bf4e3acb83 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:21.702 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.694+0000 7f5b877fe640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-04-25T12:22:21.702 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.694+0000 7f5b877fe640 1 -- 172.21.15.86:0/2729969672 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b9c051f80 con 0x560df6e5f5c0 2024-04-25T12:22:21.702 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.694+0000 7f5b877fe640 1 -- 172.21.15.86:0/2729969672 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f5b9c052350 con 0x560df6e5f5c0 2024-04-25T12:22:21.702 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.694+0000 7f5bb217a000 1 -- 172.21.15.86:0/2729969672 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ba00ca070 con 0x560df6e5f5c0 2024-04-25T12:22:21.702 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.694+0000 7f5b877fe640 1 -- 172.21.15.86:0/2729969672 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f5b9c05e8c0 con 0x560df6e5f5c0 2024-04-25T12:22:21.702 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.694+0000 7f5bb217a000 10 client.4881 fetch_fsmap learned FSMap version 19 2024-04-25T12:22:21.702 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.694+0000 7f5bb217a000 1 -- 172.21.15.86:0/2729969672 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x560df6cee5b0 con 0x560df6e5f5c0 2024-04-25T12:22:21.702 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.694+0000 7f5b877fe640 1 -- 172.21.15.86:0/2729969672 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ba00ca070 con 0x560df6e5f5c0 2024-04-25T12:22:21.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.694+0000 7f5b877fe640 1 -- 172.21.15.86:0/2729969672 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7f5b9c074b70 con 0x560df6e5f5c0 2024-04-25T12:22:21.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.694+0000 7f5bb217a000 10 client.4881 fetch_fsmap finished waiting for FSMap version 19 2024-04-25T12:22:21.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.694+0000 7f5bb217a000 10 client.4881 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-25T12:22:21.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.694+0000 7f5bb217a000 20 client.4881 populate_metadata read hostname 'smithi086' 2024-04-25T12:22:21.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.694+0000 7f5bb217a000 1 --2- 172.21.15.86:0/2729969672 >> [v2:172.21.15.134:6834/3044511437,v1:172.21.15.134:6836/3044511437] conn(0x560df6ed4170 0x560df6ed4550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:21.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.694+0000 7f5bb217a000 4 client.4881 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T12:22:21.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.694+0000 7f5bb217a000 1 -- 172.21.15.86:0/2729969672 --> [v2:172.21.15.134:6834/3044511437,v1:172.21.15.134:6836/3044511437] -- command(tid 0: {"prefix": "status"}) -- 0x560df6c7ae40 con 0x560df6ed4170 2024-04-25T12:22:21.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.694+0000 7f5bacd94640 1 --2- 172.21.15.86:0/2729969672 >> [v2:172.21.15.134:6834/3044511437,v1:172.21.15.134:6836/3044511437] conn(0x560df6ed4170 0x560df6ed4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:21.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.694+0000 7f5b877fe640 10 client.4881 ms_handle_connect on v2:172.21.15.134:6834/3044511437 2024-04-25T12:22:21.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.694+0000 7f5bacd94640 1 --2- 172.21.15.86:0/2729969672 >> [v2:172.21.15.134:6834/3044511437,v1:172.21.15.134:6836/3044511437] conn(0x560df6ed4170 0x560df6ed4550 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b86aa26ddff40827 server_cookie=fc67a99801c3a2fa in_seq=0 out_seq=0 2024-04-25T12:22:21.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.698+0000 7f5b877fe640 1 -- 172.21.15.86:0/2729969672 <== mds.0 v2:172.21.15.134:6834/3044511437 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x560df6c7ae40 con 0x560df6ed4170 2024-04-25T12:22:21.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.698+0000 7f5b877fe640 10 client.4881 handle_command_reply: tid=0 2024-04-25T12:22:21.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.698+0000 7f5bb217a000 1 client.4881 shutdown 2024-04-25T12:22:21.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.698+0000 7f5bb217a000 1 -- 172.21.15.86:0/2729969672 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560df6e5f5c0 msgr2=0x560df6e952c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:21.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.698+0000 7f5bb217a000 1 --2- 172.21.15.86:0/2729969672 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560df6e5f5c0 0x560df6e952c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c0559e0 tx=0x7f5b9c084220 comp rx=0 tx=0).stop 2024-04-25T12:22:21.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.698+0000 7f5bb217a000 1 -- 172.21.15.86:0/2729969672 shutdown_connections 2024-04-25T12:22:21.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.698+0000 7f5bb217a000 1 --2- 172.21.15.86:0/2729969672 >> [v2:172.21.15.134:6834/3044511437,v1:172.21.15.134:6836/3044511437] conn(0x560df6ed4170 0x560df6ed4550 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.698+0000 7f5bb217a000 1 --2- 172.21.15.86:0/2729969672 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560df6e5f5c0 0x560df6e952c0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.698+0000 7f5bb217a000 1 --2- 172.21.15.86:0/2729969672 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x560df6e24ab0 0x560df6e94d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.698+0000 7f5b877fe640 0 client.4881 ms_handle_reset on v2:172.21.15.134:6834/3044511437 2024-04-25T12:22:21.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.698+0000 7f5bb217a000 1 --2- 172.21.15.86:0/2729969672 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560df6e24190 0x560df6e788a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.698+0000 7f5bb217a000 1 -- 172.21.15.86:0/2729969672 >> 172.21.15.86:0/2729969672 conn(0x560df6e5be40 msgr2=0x560df6e59600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:21.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.698+0000 7f5bb217a000 1 -- 172.21.15.86:0/2729969672 shutdown_connections 2024-04-25T12:22:21.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.698+0000 7f5bb217a000 1 -- 172.21.15.86:0/2729969672 wait complete. 2024-04-25T12:22:21.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.698+0000 7f5bb217a000 20 client.4881 trim_cache size 0 max 16384 2024-04-25T12:22:21.704 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-25T12:22:21.705 INFO:teuthology.orchestra.run.smithi086.stdout: "cluster_fsid": "f2ef5c0c-9576-4650-b4f7-6cb14247f62a", 2024-04-25T12:22:21.705 INFO:teuthology.orchestra.run.smithi086.stdout: "whoami": 0, 2024-04-25T12:22:21.705 INFO:teuthology.orchestra.run.smithi086.stdout: "id": 4294, 2024-04-25T12:22:21.705 INFO:teuthology.orchestra.run.smithi086.stdout: "want_state": "up:active", 2024-04-25T12:22:21.705 INFO:teuthology.orchestra.run.smithi086.stdout: "state": "up:active", 2024-04-25T12:22:21.705 INFO:teuthology.orchestra.run.smithi086.stdout: "fs_name": "cephfs", 2024-04-25T12:22:21.705 INFO:teuthology.orchestra.run.smithi086.stdout: "rank_uptime": 57.562403441000001, 2024-04-25T12:22:21.705 INFO:teuthology.orchestra.run.smithi086.stdout: "mdsmap_epoch": 19, 2024-04-25T12:22:21.705 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch": 26, 2024-04-25T12:22:21.705 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch_barrier": 26, 2024-04-25T12:22:21.705 INFO:teuthology.orchestra.run.smithi086.stdout: "uptime": 64.293318244999995 2024-04-25T12:22:21.705 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-25T12:22:21.706 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.698+0000 7f5baeff8640 1 -- 172.21.15.86:0/3520938848 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f5b94068380 msgr2=0x7f5b9406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:21.706 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.698+0000 7f5baeff8640 1 --2- 172.21.15.86:0/3520938848 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f5b94068380 0x7f5b9406a840 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5ba00b1000 tx=0x7f5ba00aa000 comp rx=0 tx=0).stop 2024-04-25T12:22:21.706 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.698+0000 7f5baeff8640 1 -- 172.21.15.86:0/3520938848 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ba815f3d0 msgr2=0x7f5ba814d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:21.706 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.698+0000 7f5baeff8640 1 --2- 172.21.15.86:0/3520938848 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ba815f3d0 0x7f5ba814d760 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c00c3c0 tx=0x7f5b9c00c880 comp rx=0 tx=0).stop 2024-04-25T12:22:21.706 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.698+0000 7f5baeff8640 1 -- 172.21.15.86:0/3520938848 shutdown_connections 2024-04-25T12:22:21.706 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.698+0000 7f5baeff8640 1 --2- 172.21.15.86:0/3520938848 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f5b94068380 0x7f5b9406a840 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.706 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.698+0000 7f5baeff8640 1 --2- 172.21.15.86:0/3520938848 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ba815f3d0 0x7f5ba814d760 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.707 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.698+0000 7f5baeff8640 1 --2- 172.21.15.86:0/3520938848 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5ba81596b0 0x7f5ba81f8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.707 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.698+0000 7f5baeff8640 1 --2- 172.21.15.86:0/3520938848 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ba80c8040 0x7f5ba8158600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:21.707 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.698+0000 7f5baeff8640 1 -- 172.21.15.86:0/3520938848 >> 172.21.15.86:0/3520938848 conn(0x7f5ba80ca540 msgr2=0x7f5ba8157470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:21.707 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.698+0000 7f5baeff8640 1 -- 172.21.15.86:0/3520938848 shutdown_connections 2024-04-25T12:22:21.707 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:21.698+0000 7f5baeff8640 1 -- 172.21.15.86:0/3520938848 wait complete. 2024-04-25T12:22:21.715 INFO:teuthology.run_tasks:Running task sequential... 2024-04-25T12:22:21.724 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-25T12:22:21.725 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-25T12:22:21.725 INFO:teuthology.task.print:Enabling mgr modules 2024-04-25T12:22:21.725 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-25T12:22:21.735 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-25T12:22:21.735 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-04-25T12:22:21.736 INFO:tasks.ceph_fuse:client.0 config is {} 2024-04-25T12:22:21.736 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T12:22:21.736 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T12:22:21.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:22:21.736 DEBUG:teuthology.orchestra.run.smithi086:> ip netns list 2024-04-25T12:22:21.741 INFO:teuthology.orchestra.run.smithi086.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-04-25T12:22:21.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:22:21.741 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T12:22:21.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:22:21.799 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link delete ceph-brx 2024-04-25T12:22:22.001 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-25T12:22:22.001 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T12:22:22.119 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.114+0000 7f7de1a80640 1 Processor -- start 2024-04-25T12:22:22.119 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.114+0000 7f7de1a80640 1 -- start start 2024-04-25T12:22:22.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.118+0000 7f7de1a80640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7ddc14fbc0 0x7f7ddc06f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:22.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.118+0000 7f7de1a80640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7ddc14ffa0 0x7f7ddc0c8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:22.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.118+0000 7f7de1a80640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ddc0c5d70 con 0x7f7ddc074100 2024-04-25T12:22:22.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.118+0000 7f7de1a80640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f7ddc0c6050 con 0x7f7ddc14ffa0 2024-04-25T12:22:22.121 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.118+0000 7f7de1a80640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f7ddc0c6330 con 0x7f7ddc14fbc0 2024-04-25T12:22:22.121 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.118+0000 7f7ddaffd640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7ddc14ffa0 0x7f7ddc0c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:22.121 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.118+0000 7f7ddaffd640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7ddc14ffa0 0x7f7ddc0c8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38876/0 (socket says 172.21.15.86:38876) 2024-04-25T12:22:22.121 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.118+0000 7f7ddaffd640 1 -- 172.21.15.86:0/1203606957 learned_addr learned my addr 172.21.15.86:0/1203606957 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:22.121 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.118+0000 7f7ddaffd640 1 -- 172.21.15.86:0/1203606957 >> v2:172.21.15.134:3300/0 conn(0x7f7ddc14fbc0 msgr2=0x7f7ddc06f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:22.121 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.118+0000 7f7ddaffd640 1 --2- 172.21.15.86:0/1203606957 >> v2:172.21.15.134:3300/0 conn(0x7f7ddc14fbc0 0x7f7ddc06f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:22.121 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.118+0000 7f7ddaffd640 1 -- 172.21.15.86:0/1203606957 >> v1:172.21.15.134:6789/0 conn(0x7f7ddc074100 legacy=0x7f7ddc0c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:22.121 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.118+0000 7f7ddaffd640 1 -- 172.21.15.86:0/1203606957 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ddc0c6610 con 0x7f7ddc14ffa0 2024-04-25T12:22:22.123 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.118+0000 7f7ddaffd640 1 --2- 172.21.15.86:0/1203606957 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ddc14ffa0 0x7f7ddc0c8220 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7dd0009870 tx=0x7f7dd001c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7449b4f7d4eaf737 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:22.123 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.118+0000 7f7dda7fc640 1 -- 172.21.15.86:0/1203606957 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd00aa660 con 0x7f7ddc14ffa0 2024-04-25T12:22:22.123 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.118+0000 7f7dda7fc640 1 -- 172.21.15.86:0/1203606957 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dd00af070 con 0x7f7ddc14ffa0 2024-04-25T12:22:22.123 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.118+0000 7f7dda7fc640 1 -- 172.21.15.86:0/1203606957 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd00aaa20 con 0x7f7ddc14ffa0 2024-04-25T12:22:22.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.122+0000 7f7de1a80640 1 -- 172.21.15.86:0/1203606957 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ddc14ffa0 msgr2=0x7f7ddc0c8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:22.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.122+0000 7f7de1a80640 1 --2- 172.21.15.86:0/1203606957 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ddc14ffa0 0x7f7ddc0c8220 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7dd0009870 tx=0x7f7dd001c4e0 comp rx=0 tx=0).stop 2024-04-25T12:22:22.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.122+0000 7f7de1a80640 1 -- 172.21.15.86:0/1203606957 shutdown_connections 2024-04-25T12:22:22.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.122+0000 7f7de1a80640 1 --2- 172.21.15.86:0/1203606957 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ddc14ffa0 0x7f7ddc0c8220 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:22.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.122+0000 7f7de1a80640 1 --2- 172.21.15.86:0/1203606957 >> v2:172.21.15.134:3300/0 conn(0x7f7ddc14fbc0 0x7f7ddc06f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:22.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.122+0000 7f7de1a80640 1 -- 172.21.15.86:0/1203606957 >> 172.21.15.86:0/1203606957 conn(0x7f7ddc06b9d0 msgr2=0x7f7ddc06bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:22.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.122+0000 7f7de1a80640 1 -- 172.21.15.86:0/1203606957 shutdown_connections 2024-04-25T12:22:22.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.122+0000 7f7de1a80640 1 -- 172.21.15.86:0/1203606957 wait complete. 2024-04-25T12:22:22.125 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.122+0000 7f7de1a80640 1 Processor -- start 2024-04-25T12:22:22.125 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.122+0000 7f7de1a80640 1 -- start start 2024-04-25T12:22:22.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.122+0000 7f7de1a80640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ddc074100 0x7f7ddc15ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:22.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.122+0000 7f7de1a80640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7ddc14fbc0 0x7f7ddc14d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:22.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.122+0000 7f7de1a80640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ddc14ffa0 0x7f7ddc1518f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:22.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.122+0000 7f7de1a80640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7ddc166420 con 0x7f7ddc14ffa0 2024-04-25T12:22:22.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.122+0000 7f7de1a80640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7ddc1662a0 con 0x7f7ddc074100 2024-04-25T12:22:22.128 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.122+0000 7f7de1a80640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f7ddc1665a0 con 0x7f7ddc14fbc0 2024-04-25T12:22:22.128 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.122+0000 7f7ddbfff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ddc14ffa0 0x7f7ddc1518f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:22.128 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.122+0000 7f7ddbfff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ddc14ffa0 0x7f7ddc1518f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38878/0 (socket says 172.21.15.86:38878) 2024-04-25T12:22:22.128 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.122+0000 7f7ddbfff640 1 -- 172.21.15.86:0/2734503764 learned_addr learned my addr 172.21.15.86:0/2734503764 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:22.128 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.122+0000 7f7ddb7fe640 1 --2- 172.21.15.86:0/2734503764 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ddc074100 0x7f7ddc15ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:22.128 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.122+0000 7f7ddaffd640 1 --2- 172.21.15.86:0/2734503764 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7ddc14fbc0 0x7f7ddc14d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:22.128 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.122+0000 7f7ddbfff640 1 -- 172.21.15.86:0/2734503764 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7ddc14fbc0 msgr2=0x7f7ddc14d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:22.128 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.122+0000 7f7ddbfff640 1 --2- 172.21.15.86:0/2734503764 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7ddc14fbc0 0x7f7ddc14d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:22.128 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.122+0000 7f7ddbfff640 1 -- 172.21.15.86:0/2734503764 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ddc074100 msgr2=0x7f7ddc15ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:22.128 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.122+0000 7f7ddbfff640 1 --2- 172.21.15.86:0/2734503764 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ddc074100 0x7f7ddc15ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:22.128 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.122+0000 7f7ddbfff640 1 -- 172.21.15.86:0/2734503764 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ddc1f4a80 con 0x7f7ddc14ffa0 2024-04-25T12:22:22.128 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.122+0000 7f7ddbfff640 1 --2- 172.21.15.86:0/2734503764 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ddc14ffa0 0x7f7ddc1518f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7dd400c780 tx=0x7f7dd400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:22.128 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.122+0000 7f7dc3fff640 1 -- 172.21.15.86:0/2734503764 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd4017070 con 0x7f7ddc14ffa0 2024-04-25T12:22:22.128 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.122+0000 7f7dc3fff640 1 -- 172.21.15.86:0/2734503764 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dd4003db0 con 0x7f7ddc14ffa0 2024-04-25T12:22:22.129 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.122+0000 7f7dc3fff640 1 -- 172.21.15.86:0/2734503764 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd40052b0 con 0x7f7ddc14ffa0 2024-04-25T12:22:22.129 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.126+0000 7f7de1a80640 1 -- 172.21.15.86:0/2734503764 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ddc1f4d60 con 0x7f7ddc14ffa0 2024-04-25T12:22:22.129 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.126+0000 7f7de1a80640 1 -- 172.21.15.86:0/2734503764 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ddc1f5320 con 0x7f7ddc14ffa0 2024-04-25T12:22:22.130 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.126+0000 7f7de1a80640 1 -- 172.21.15.86:0/2734503764 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ddc075df0 con 0x7f7ddc14ffa0 2024-04-25T12:22:22.130 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.126+0000 7f7dc3fff640 1 -- 172.21.15.86:0/2734503764 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7dd4006b20 con 0x7f7ddc14ffa0 2024-04-25T12:22:22.130 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.126+0000 7f7dc3fff640 1 --2- 172.21.15.86:0/2734503764 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f7dc8068380 0x7f7dc806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:22.130 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.126+0000 7f7ddb7fe640 1 --2- 172.21.15.86:0/2734503764 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f7dc8068380 0x7f7dc806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:22.130 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.126+0000 7f7dc3fff640 1 -- 172.21.15.86:0/2734503764 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f7dd4086250 con 0x7f7ddc14ffa0 2024-04-25T12:22:22.130 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.126+0000 7f7ddb7fe640 1 --2- 172.21.15.86:0/2734503764 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f7dc8068380 0x7f7dc806a840 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc006fd0 tx=0x7f7dcc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:22.133 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.130+0000 7f7dc3fff640 1 -- 172.21.15.86:0/2734503764 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7dd4055dd0 con 0x7f7ddc14ffa0 2024-04-25T12:22:22.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.314+0000 7f7de1a80640 1 -- 172.21.15.86:0/2734503764 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f7ddc149c50 con 0x7f7ddc14ffa0 2024-04-25T12:22:22.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.314+0000 7f7dc3fff640 1 -- 172.21.15.86:0/2734503764 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v19) ==== 53+0+88 (secure 0 0 0) 0x7f7dd405a0d0 con 0x7f7ddc14ffa0 2024-04-25T12:22:22.319 INFO:teuthology.orchestra.run.smithi086.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-25T12:22:22.321 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.318+0000 7f7de1a80640 1 -- 172.21.15.86:0/2734503764 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f7dc8068380 msgr2=0x7f7dc806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:22.321 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.318+0000 7f7de1a80640 1 --2- 172.21.15.86:0/2734503764 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f7dc8068380 0x7f7dc806a840 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc006fd0 tx=0x7f7dcc008040 comp rx=0 tx=0).stop 2024-04-25T12:22:22.321 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.318+0000 7f7de1a80640 1 -- 172.21.15.86:0/2734503764 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ddc14ffa0 msgr2=0x7f7ddc1518f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:22.321 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.318+0000 7f7de1a80640 1 --2- 172.21.15.86:0/2734503764 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ddc14ffa0 0x7f7ddc1518f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7dd400c780 tx=0x7f7dd400cc40 comp rx=0 tx=0).stop 2024-04-25T12:22:22.321 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.318+0000 7f7de1a80640 1 -- 172.21.15.86:0/2734503764 shutdown_connections 2024-04-25T12:22:22.321 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.318+0000 7f7de1a80640 1 --2- 172.21.15.86:0/2734503764 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f7dc8068380 0x7f7dc806a840 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:22.321 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.318+0000 7f7de1a80640 1 --2- 172.21.15.86:0/2734503764 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ddc14ffa0 0x7f7ddc1518f0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:22.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.318+0000 7f7de1a80640 1 --2- 172.21.15.86:0/2734503764 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7ddc14fbc0 0x7f7ddc14d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:22.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.318+0000 7f7de1a80640 1 --2- 172.21.15.86:0/2734503764 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ddc074100 0x7f7ddc15ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:22.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.318+0000 7f7de1a80640 1 -- 172.21.15.86:0/2734503764 >> 172.21.15.86:0/2734503764 conn(0x7f7ddc06b9d0 msgr2=0x7f7ddc14a120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:22.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.318+0000 7f7de1a80640 1 -- 172.21.15.86:0/2734503764 shutdown_connections 2024-04-25T12:22:22.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22.318+0000 7f7de1a80640 1 -- 172.21.15.86:0/2734503764 wait complete. 2024-04-25T12:22:22.336 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T12:22:22.336 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T12:22:22.336 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi086.front.sepia.ceph.com 2024-04-25T12:22:22.336 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T12:22:22.336 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T12:22:22.336 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T12:22:22.336 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T12:22:22.337 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T12:22:22.337 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T12:22:22.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:22:22.337 DEBUG:teuthology.orchestra.run.smithi086:> ip addr 2024-04-25T12:22:22.342 INFO:teuthology.orchestra.run.smithi086.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T12:22:22.342 INFO:teuthology.orchestra.run.smithi086.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T12:22:22.343 INFO:teuthology.orchestra.run.smithi086.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T12:22:22.343 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2024-04-25T12:22:22.343 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 ::1/128 scope host 2024-04-25T12:22:22.343 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2024-04-25T12:22:22.343 INFO:teuthology.orchestra.run.smithi086.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T12:22:22.343 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f6 brd ff:ff:ff:ff:ff:ff 2024-04-25T12:22:22.343 INFO:teuthology.orchestra.run.smithi086.stdout: altname enp7s0f0 2024-04-25T12:22:22.343 INFO:teuthology.orchestra.run.smithi086.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T12:22:22.343 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f7 brd ff:ff:ff:ff:ff:ff 2024-04-25T12:22:22.343 INFO:teuthology.orchestra.run.smithi086.stdout: altname enp7s0f1 2024-04-25T12:22:22.343 INFO:teuthology.orchestra.run.smithi086.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T12:22:22.343 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:08 brd ff:ff:ff:ff:ff:ff 2024-04-25T12:22:22.343 INFO:teuthology.orchestra.run.smithi086.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T12:22:22.343 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:09 brd ff:ff:ff:ff:ff:ff 2024-04-25T12:22:22.344 INFO:teuthology.orchestra.run.smithi086.stdout: inet 172.21.15.86/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-25T12:22:22.344 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft 42443sec preferred_lft 42443sec 2024-04-25T12:22:22.344 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::ec4:7aff:fe8f:d809/64 scope link 2024-04-25T12:22:22.344 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2024-04-25T12:22:22.344 INFO:teuthology.orchestra.run.smithi086.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T12:22:22.344 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 02:42:6a:96:63:a2 brd ff:ff:ff:ff:ff:ff 2024-04-25T12:22:22.344 INFO:teuthology.orchestra.run.smithi086.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T12:22:22.344 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2024-04-25T12:22:22.344 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T12:22:22.344 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T12:22:22.344 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2024-04-25T12:22:22.345 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link add name ceph-brx type bridge 2024-04-25T12:22:22.345 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip addr flush dev ceph-brx 2024-04-25T12:22:22.345 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link set ceph-brx up 2024-04-25T12:22:22.345 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T12:22:22.345 DEBUG:teuthology.orchestra.run.smithi086:> ') 2024-04-25T12:22:22.432 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T12:22:22.464 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T12:22:22.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:22:22.470 DEBUG:teuthology.orchestra.run.smithi086:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T12:22:22.519 INFO:teuthology.orchestra.run.smithi086.stdout:1 2024-04-25T12:22:22.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:22:22.521 DEBUG:teuthology.orchestra.run.smithi086:> route 2024-04-25T12:22:22.571 INFO:teuthology.orchestra.run.smithi086.stdout:Kernel IP routing table 2024-04-25T12:22:22.571 INFO:teuthology.orchestra.run.smithi086.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T12:22:22.571 INFO:teuthology.orchestra.run.smithi086.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-25T12:22:22.571 INFO:teuthology.orchestra.run.smithi086.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T12:22:22.571 INFO:teuthology.orchestra.run.smithi086.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-25T12:22:22.571 INFO:teuthology.orchestra.run.smithi086.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T12:22:22.571 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T12:22:22.572 INFO:teuthology.orchestra.run.smithi086.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T12:22:22.572 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T12:22:22.572 INFO:teuthology.orchestra.run.smithi086.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T12:22:22.572 INFO:teuthology.orchestra.run.smithi086.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T12:22:22.572 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T12:22:22.572 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2024-04-25T12:22:22.572 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T12:22:22.572 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T12:22:22.572 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T12:22:22.572 DEBUG:teuthology.orchestra.run.smithi086:> ') 2024-04-25T12:22:22.660 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T12:22:22.685 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T12:22:22.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:22:22.691 DEBUG:teuthology.orchestra.run.smithi086:> ip netns list 2024-04-25T12:22:22.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:22:22.697 DEBUG:teuthology.orchestra.run.smithi086:> ip netns list-id 2024-04-25T12:22:22.743 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T12:22:22.743 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2024-04-25T12:22:22.743 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T12:22:22.743 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-25T12:22:22.743 DEBUG:teuthology.orchestra.run.smithi086:> ') 2024-04-25T12:22:22.833 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T12:22:22.853 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T12:22:22.859 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-25T12:22:22.859 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T12:22:22.860 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2024-04-25T12:22:22.860 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-25T12:22:22.860 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T12:22:22.860 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-25T12:22:22.860 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-25T12:22:22.860 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-25T12:22:22.860 DEBUG:teuthology.orchestra.run.smithi086:> ') 2024-04-25T12:22:22.902 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T12:22:22.945 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T12:22:22.947 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T12:22:22.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T12:22:22.957 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T12:22:22.957 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2024-04-25T12:22:22.957 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link set brx.0 up 2024-04-25T12:22:22.957 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T12:22:22.957 DEBUG:teuthology.orchestra.run.smithi086:> ') 2024-04-25T12:22:23.065 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T12:22:23.084 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T12:22:23.091 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-25T12:22:23.091 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T12:22:23.091 DEBUG:teuthology.orchestra.run.smithi086:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T12:22:23.139 INFO:teuthology.orchestra.run.smithi086.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T12:22:23.139 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T12:22:23.139 DEBUG:teuthology.orchestra.run.smithi086:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T12:22:23.187 DEBUG:teuthology.orchestra.run.smithi086:> sudo modprobe fuse 2024-04-25T12:22:23.244 DEBUG:teuthology.orchestra.run.smithi086:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T12:22:23.292 INFO:teuthology.orchestra.run.smithi086.stdout:/sys 2024-04-25T12:22:23.293 INFO:teuthology.orchestra.run.smithi086.stdout:/proc 2024-04-25T12:22:23.293 INFO:teuthology.orchestra.run.smithi086.stdout:/dev 2024-04-25T12:22:23.293 INFO:teuthology.orchestra.run.smithi086.stdout:/dev/pts 2024-04-25T12:22:23.293 INFO:teuthology.orchestra.run.smithi086.stdout:/run 2024-04-25T12:22:23.293 INFO:teuthology.orchestra.run.smithi086.stdout:/ 2024-04-25T12:22:23.293 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/kernel/security 2024-04-25T12:22:23.293 INFO:teuthology.orchestra.run.smithi086.stdout:/dev/shm 2024-04-25T12:22:23.293 INFO:teuthology.orchestra.run.smithi086.stdout:/run/lock 2024-04-25T12:22:23.294 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/fs/cgroup 2024-04-25T12:22:23.294 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/fs/pstore 2024-04-25T12:22:23.294 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/fs/bpf 2024-04-25T12:22:23.294 INFO:teuthology.orchestra.run.smithi086.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T12:22:23.294 INFO:teuthology.orchestra.run.smithi086.stdout:/dev/hugepages 2024-04-25T12:22:23.294 INFO:teuthology.orchestra.run.smithi086.stdout:/dev/mqueue 2024-04-25T12:22:23.294 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/kernel/debug 2024-04-25T12:22:23.294 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/kernel/tracing 2024-04-25T12:22:23.294 INFO:teuthology.orchestra.run.smithi086.stdout:/proc/fs/nfsd 2024-04-25T12:22:23.294 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/fs/fuse/connections 2024-04-25T12:22:23.294 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/kernel/config 2024-04-25T12:22:23.294 INFO:teuthology.orchestra.run.smithi086.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T12:22:23.295 INFO:teuthology.orchestra.run.smithi086.stdout:/run/rpc_pipefs 2024-04-25T12:22:23.295 INFO:teuthology.orchestra.run.smithi086.stdout:/run/user/1000 2024-04-25T12:22:23.295 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/ceph 2024-04-25T12:22:23.295 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T12:22:23.295 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T12:22:23.295 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T12:22:23.295 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T12:22:23.295 INFO:teuthology.orchestra.run.smithi086.stdout:/run/netns 2024-04-25T12:22:23.295 INFO:teuthology.orchestra.run.smithi086.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T12:22:23.295 INFO:teuthology.orchestra.run.smithi086.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T12:22:23.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:22:23.296 DEBUG:teuthology.orchestra.run.smithi086:> ls /sys/fs/fuse/connections 2024-04-25T12:22:23.347 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-25T12:22:23.348 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-25T12:22:23.392 DEBUG:teuthology.orchestra.run.smithi086:> sudo modprobe fuse 2024-04-25T12:22:23.406 DEBUG:teuthology.orchestra.run.smithi086:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T12:22:23.452 INFO:teuthology.orchestra.run.smithi086.stdout:/sys 2024-04-25T12:22:23.453 INFO:teuthology.orchestra.run.smithi086.stdout:/proc 2024-04-25T12:22:23.453 INFO:teuthology.orchestra.run.smithi086.stdout:/dev 2024-04-25T12:22:23.453 INFO:teuthology.orchestra.run.smithi086.stdout:/dev/pts 2024-04-25T12:22:23.453 INFO:teuthology.orchestra.run.smithi086.stdout:/run 2024-04-25T12:22:23.453 INFO:teuthology.orchestra.run.smithi086.stdout:/ 2024-04-25T12:22:23.453 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/kernel/security 2024-04-25T12:22:23.453 INFO:teuthology.orchestra.run.smithi086.stdout:/dev/shm 2024-04-25T12:22:23.453 INFO:teuthology.orchestra.run.smithi086.stdout:/run/lock 2024-04-25T12:22:23.453 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/fs/cgroup 2024-04-25T12:22:23.453 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/fs/pstore 2024-04-25T12:22:23.453 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/fs/bpf 2024-04-25T12:22:23.453 INFO:teuthology.orchestra.run.smithi086.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T12:22:23.454 INFO:teuthology.orchestra.run.smithi086.stdout:/dev/hugepages 2024-04-25T12:22:23.454 INFO:teuthology.orchestra.run.smithi086.stdout:/dev/mqueue 2024-04-25T12:22:23.454 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/kernel/debug 2024-04-25T12:22:23.454 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/kernel/tracing 2024-04-25T12:22:23.454 INFO:teuthology.orchestra.run.smithi086.stdout:/proc/fs/nfsd 2024-04-25T12:22:23.454 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/fs/fuse/connections 2024-04-25T12:22:23.454 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/kernel/config 2024-04-25T12:22:23.454 INFO:teuthology.orchestra.run.smithi086.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T12:22:23.454 INFO:teuthology.orchestra.run.smithi086.stdout:/run/rpc_pipefs 2024-04-25T12:22:23.454 INFO:teuthology.orchestra.run.smithi086.stdout:/run/user/1000 2024-04-25T12:22:23.454 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/ceph 2024-04-25T12:22:23.454 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T12:22:23.454 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T12:22:23.455 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T12:22:23.455 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T12:22:23.455 INFO:teuthology.orchestra.run.smithi086.stdout:/run/netns 2024-04-25T12:22:23.455 INFO:teuthology.orchestra.run.smithi086.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T12:22:23.457 INFO:teuthology.orchestra.run.smithi086.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T12:22:23.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:22:23.457 DEBUG:teuthology.orchestra.run.smithi086:> ls /sys/fs/fuse/connections 2024-04-25T12:22:23.474 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi086.stderr:2024-04-25T12:22:23.470+0000 7f34dd268580 -1 init, newargv = 0x556cdd656660 newargc=15 2024-04-25T12:22:23.474 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi086.stderr:ceph-fuse[36243]: starting ceph client 2024-04-25T12:22:23.494 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi086.stderr:ceph-fuse[36243]: starting fuse 2024-04-25T12:22:24.580 DEBUG:teuthology.orchestra.run.smithi086:> sudo modprobe fuse 2024-04-25T12:22:24.596 DEBUG:teuthology.orchestra.run.smithi086:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T12:22:24.645 INFO:teuthology.orchestra.run.smithi086.stdout:/sys 2024-04-25T12:22:24.645 INFO:teuthology.orchestra.run.smithi086.stdout:/proc 2024-04-25T12:22:24.645 INFO:teuthology.orchestra.run.smithi086.stdout:/dev 2024-04-25T12:22:24.645 INFO:teuthology.orchestra.run.smithi086.stdout:/dev/pts 2024-04-25T12:22:24.645 INFO:teuthology.orchestra.run.smithi086.stdout:/run 2024-04-25T12:22:24.645 INFO:teuthology.orchestra.run.smithi086.stdout:/ 2024-04-25T12:22:24.645 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/kernel/security 2024-04-25T12:22:24.645 INFO:teuthology.orchestra.run.smithi086.stdout:/dev/shm 2024-04-25T12:22:24.645 INFO:teuthology.orchestra.run.smithi086.stdout:/run/lock 2024-04-25T12:22:24.645 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/fs/cgroup 2024-04-25T12:22:24.645 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/fs/pstore 2024-04-25T12:22:24.646 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/fs/bpf 2024-04-25T12:22:24.646 INFO:teuthology.orchestra.run.smithi086.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T12:22:24.646 INFO:teuthology.orchestra.run.smithi086.stdout:/dev/hugepages 2024-04-25T12:22:24.646 INFO:teuthology.orchestra.run.smithi086.stdout:/dev/mqueue 2024-04-25T12:22:24.646 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/kernel/debug 2024-04-25T12:22:24.646 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/kernel/tracing 2024-04-25T12:22:24.646 INFO:teuthology.orchestra.run.smithi086.stdout:/proc/fs/nfsd 2024-04-25T12:22:24.646 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/fs/fuse/connections 2024-04-25T12:22:24.646 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/kernel/config 2024-04-25T12:22:24.646 INFO:teuthology.orchestra.run.smithi086.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T12:22:24.646 INFO:teuthology.orchestra.run.smithi086.stdout:/run/rpc_pipefs 2024-04-25T12:22:24.646 INFO:teuthology.orchestra.run.smithi086.stdout:/run/user/1000 2024-04-25T12:22:24.646 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/ceph 2024-04-25T12:22:24.647 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T12:22:24.647 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T12:22:24.647 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T12:22:24.647 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T12:22:24.647 INFO:teuthology.orchestra.run.smithi086.stdout:/run/netns 2024-04-25T12:22:24.647 INFO:teuthology.orchestra.run.smithi086.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T12:22:24.647 INFO:teuthology.orchestra.run.smithi086.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T12:22:24.647 INFO:teuthology.orchestra.run.smithi086.stdout:/home/ubuntu/cephtest/mnt.0 2024-04-25T12:22:24.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:22:24.648 DEBUG:teuthology.orchestra.run.smithi086:> ls /sys/fs/fuse/connections 2024-04-25T12:22:24.696 INFO:teuthology.orchestra.run.smithi086.stdout:45 2024-04-25T12:22:24.696 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-04-25T12:22:24.696 DEBUG:teuthology.orchestra.run.smithi086:> sudo stdin-killer -- python3 -c ' 2024-04-25T12:22:24.696 DEBUG:teuthology.orchestra.run.smithi086:> import glob 2024-04-25T12:22:24.696 DEBUG:teuthology.orchestra.run.smithi086:> import re 2024-04-25T12:22:24.696 DEBUG:teuthology.orchestra.run.smithi086:> import os 2024-04-25T12:22:24.696 DEBUG:teuthology.orchestra.run.smithi086:> import subprocess 2024-04-25T12:22:24.696 DEBUG:teuthology.orchestra.run.smithi086:> 2024-04-25T12:22:24.697 DEBUG:teuthology.orchestra.run.smithi086:> def _find_admin_socket(client_name): 2024-04-25T12:22:24.697 DEBUG:teuthology.orchestra.run.smithi086:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-25T12:22:24.697 DEBUG:teuthology.orchestra.run.smithi086:> files = glob.glob(asok_path) 2024-04-25T12:22:24.697 DEBUG:teuthology.orchestra.run.smithi086:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-25T12:22:24.697 DEBUG:teuthology.orchestra.run.smithi086:> 2024-04-25T12:22:24.697 DEBUG:teuthology.orchestra.run.smithi086:> # Given a non-glob path, it better be there 2024-04-25T12:22:24.697 DEBUG:teuthology.orchestra.run.smithi086:> if "*" not in asok_path: 2024-04-25T12:22:24.697 DEBUG:teuthology.orchestra.run.smithi086:> assert(len(files) == 1) 2024-04-25T12:22:24.697 DEBUG:teuthology.orchestra.run.smithi086:> return files[0] 2024-04-25T12:22:24.697 DEBUG:teuthology.orchestra.run.smithi086:> 2024-04-25T12:22:24.697 DEBUG:teuthology.orchestra.run.smithi086:> for f in files: 2024-04-25T12:22:24.697 DEBUG:teuthology.orchestra.run.smithi086:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-25T12:22:24.697 DEBUG:teuthology.orchestra.run.smithi086:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-25T12:22:24.697 DEBUG:teuthology.orchestra.run.smithi086:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-25T12:22:24.697 DEBUG:teuthology.orchestra.run.smithi086:> contents = proc_f.read() 2024-04-25T12:22:24.697 DEBUG:teuthology.orchestra.run.smithi086:> if mountpoint in contents: 2024-04-25T12:22:24.697 DEBUG:teuthology.orchestra.run.smithi086:> return f 2024-04-25T12:22:24.698 DEBUG:teuthology.orchestra.run.smithi086:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-25T12:22:24.698 DEBUG:teuthology.orchestra.run.smithi086:> 2024-04-25T12:22:24.698 DEBUG:teuthology.orchestra.run.smithi086:> print(_find_admin_socket("client.0")) 2024-04-25T12:22:24.698 DEBUG:teuthology.orchestra.run.smithi086:> ' 2024-04-25T12:22:24.824 INFO:teuthology.orchestra.run.smithi086.stdout:/var/run/ceph/ceph-client.0.36243.asok 2024-04-25T12:22:24.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T12:22:24.837 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.36243.asok 2024-04-25T12:22:24.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:22:24.837 DEBUG:teuthology.orchestra.run.smithi086:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.36243.asok status 2024-04-25T12:22:24.987 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-25T12:22:24.987 INFO:teuthology.orchestra.run.smithi086.stdout: "metadata": { 2024-04-25T12:22:24.987 INFO:teuthology.orchestra.run.smithi086.stdout: "ceph_sha1": "d69f13d827952bb07bb9b7973bca14f97d764d6f", 2024-04-25T12:22:24.987 INFO:teuthology.orchestra.run.smithi086.stdout: "ceph_version": "ceph version 19.0.0-3156-gd69f13d8 (d69f13d827952bb07bb9b7973bca14f97d764d6f) squid (dev)", 2024-04-25T12:22:24.987 INFO:teuthology.orchestra.run.smithi086.stdout: "entity_id": "0", 2024-04-25T12:22:24.987 INFO:teuthology.orchestra.run.smithi086.stdout: "hostname": "smithi086", 2024-04-25T12:22:24.987 INFO:teuthology.orchestra.run.smithi086.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-25T12:22:24.987 INFO:teuthology.orchestra.run.smithi086.stdout: "pid": "36243", 2024-04-25T12:22:24.988 INFO:teuthology.orchestra.run.smithi086.stdout: "root": "/" 2024-04-25T12:22:24.988 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-25T12:22:24.988 INFO:teuthology.orchestra.run.smithi086.stdout: "dentry_count": 0, 2024-04-25T12:22:24.988 INFO:teuthology.orchestra.run.smithi086.stdout: "dentry_pinned_count": 0, 2024-04-25T12:22:24.988 INFO:teuthology.orchestra.run.smithi086.stdout: "id": 4893, 2024-04-25T12:22:24.988 INFO:teuthology.orchestra.run.smithi086.stdout: "inst": { 2024-04-25T12:22:24.988 INFO:teuthology.orchestra.run.smithi086.stdout: "name": { 2024-04-25T12:22:24.988 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "client", 2024-04-25T12:22:24.988 INFO:teuthology.orchestra.run.smithi086.stdout: "num": 4893 2024-04-25T12:22:24.988 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-25T12:22:24.988 INFO:teuthology.orchestra.run.smithi086.stdout: "addr": { 2024-04-25T12:22:24.988 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "v1", 2024-04-25T12:22:24.988 INFO:teuthology.orchestra.run.smithi086.stdout: "addr": "192.168.0.1:0", 2024-04-25T12:22:24.989 INFO:teuthology.orchestra.run.smithi086.stdout: "nonce": 788763235 2024-04-25T12:22:24.989 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-25T12:22:24.989 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-25T12:22:24.989 INFO:teuthology.orchestra.run.smithi086.stdout: "addr": { 2024-04-25T12:22:24.989 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "v1", 2024-04-25T12:22:24.989 INFO:teuthology.orchestra.run.smithi086.stdout: "addr": "192.168.0.1:0", 2024-04-25T12:22:24.989 INFO:teuthology.orchestra.run.smithi086.stdout: "nonce": 788763235 2024-04-25T12:22:24.989 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-25T12:22:24.989 INFO:teuthology.orchestra.run.smithi086.stdout: "inst_str": "client.4893 192.168.0.1:0/788763235", 2024-04-25T12:22:24.989 INFO:teuthology.orchestra.run.smithi086.stdout: "addr_str": "192.168.0.1:0/788763235", 2024-04-25T12:22:24.989 INFO:teuthology.orchestra.run.smithi086.stdout: "inode_count": 1, 2024-04-25T12:22:24.989 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_epoch": 19, 2024-04-25T12:22:24.990 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_epoch": 26, 2024-04-25T12:22:24.990 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_epoch_barrier": 0, 2024-04-25T12:22:24.990 INFO:teuthology.orchestra.run.smithi086.stdout: "blocklisted": false, 2024-04-25T12:22:24.990 INFO:teuthology.orchestra.run.smithi086.stdout: "fs_name": "cephfs" 2024-04-25T12:22:24.990 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-25T12:22:25.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:22:25.001 DEBUG:teuthology.orchestra.run.smithi086:> stat --file-system '--printf=%T 2024-04-25T12:22:25.001 DEBUG:teuthology.orchestra.run.smithi086:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-25T12:22:25.007 INFO:teuthology.orchestra.run.smithi086.stdout:fuseblk 2024-04-25T12:22:25.007 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-25T12:22:25.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:22:25.007 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T12:22:25.066 INFO:teuthology.run_tasks:Running task quiescer... 2024-04-25T12:22:25.080 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_df40303764f976ac2e973c1ef2b40d1ebbda473b/qa/tasks/quiescer.py", line 386, in task cluster_name = ctx.config['cluster'] KeyError: 'cluster' 2024-04-25T12:22:25.325 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=b64a312726424570aee96b6eb448fb9f Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_df40303764f976ac2e973c1ef2b40d1ebbda473b/qa/tasks/quiescer.py", line 386, in task cluster_name = ctx.config['cluster'] KeyError: 'cluster' 2024-04-25T12:22:25.327 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-04-25T12:22:25.336 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-25T12:22:25.345 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-25T12:22:25.345 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-04-25T12:22:25.345 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T12:22:25.359 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-04-25T12:22:25.359 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T12:22:25.405 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T12:22:25.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.574+0000 7f097aaf2640 1 Processor -- start 2024-04-25T12:22:25.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.574+0000 7f097aaf2640 1 -- start start 2024-04-25T12:22:25.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.574+0000 7f097aaf2640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f097414fbc0 0x7f097406f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:25.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.574+0000 7f097aaf2640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f097414ffa0 0x7f09740c8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:25.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.574+0000 7f097aaf2640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09740c5d70 con 0x7f0974074100 2024-04-25T12:22:25.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.574+0000 7f097aaf2640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f09740c6050 con 0x7f097414ffa0 2024-04-25T12:22:25.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.574+0000 7f097aaf2640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f09740c6330 con 0x7f097414fbc0 2024-04-25T12:22:25.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.574+0000 7f0973fff640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f097414ffa0 0x7f09740c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:25.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.574+0000 7f0973fff640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f097414ffa0 0x7f09740c8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51112/0 (socket says 172.21.15.86:51112) 2024-04-25T12:22:25.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.574+0000 7f0973fff640 1 -- 172.21.15.86:0/2330023471 learned_addr learned my addr 172.21.15.86:0/2330023471 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:25.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.574+0000 7f097888e640 1 --2- 172.21.15.86:0/2330023471 >> v2:172.21.15.134:3300/0 conn(0x7f097414fbc0 0x7f097406f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:25.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.574+0000 7f0973fff640 1 -- 172.21.15.86:0/2330023471 >> v2:172.21.15.134:3300/0 conn(0x7f097414fbc0 msgr2=0x7f097406f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:25.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.574+0000 7f0973fff640 1 --2- 172.21.15.86:0/2330023471 >> v2:172.21.15.134:3300/0 conn(0x7f097414fbc0 0x7f097406f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:25.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.574+0000 7f0973fff640 1 -- 172.21.15.86:0/2330023471 >> v1:172.21.15.134:6789/0 conn(0x7f0974074100 legacy=0x7f09740c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:25.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.574+0000 7f0973fff640 1 -- 172.21.15.86:0/2330023471 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09740c6610 con 0x7f097414ffa0 2024-04-25T12:22:25.580 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.578+0000 7f0973fff640 1 --2- 172.21.15.86:0/2330023471 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f097414ffa0 0x7f09740c8220 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0968009870 tx=0x7f096801c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5ba97a9038e1973 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:25.580 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.578+0000 7f09737fe640 1 -- 172.21.15.86:0/2330023471 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09680aa660 con 0x7f097414ffa0 2024-04-25T12:22:25.581 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.578+0000 7f09737fe640 1 -- 172.21.15.86:0/2330023471 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09680af070 con 0x7f097414ffa0 2024-04-25T12:22:25.581 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.578+0000 7f09737fe640 1 -- 172.21.15.86:0/2330023471 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09680aaa20 con 0x7f097414ffa0 2024-04-25T12:22:25.582 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.578+0000 7f097aaf2640 1 -- 172.21.15.86:0/2330023471 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f097414ffa0 msgr2=0x7f09740c8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:25.582 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.578+0000 7f097aaf2640 1 --2- 172.21.15.86:0/2330023471 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f097414ffa0 0x7f09740c8220 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0968009870 tx=0x7f096801c4e0 comp rx=0 tx=0).stop 2024-04-25T12:22:25.582 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.578+0000 7f097aaf2640 1 -- 172.21.15.86:0/2330023471 shutdown_connections 2024-04-25T12:22:25.582 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.578+0000 7f097aaf2640 1 --2- 172.21.15.86:0/2330023471 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f097414ffa0 0x7f09740c8220 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:25.582 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.578+0000 7f097aaf2640 1 --2- 172.21.15.86:0/2330023471 >> v2:172.21.15.134:3300/0 conn(0x7f097414fbc0 0x7f097406f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:25.582 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.578+0000 7f097aaf2640 1 -- 172.21.15.86:0/2330023471 >> 172.21.15.86:0/2330023471 conn(0x7f097406b9d0 msgr2=0x7f097406bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:25.583 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.578+0000 7f097aaf2640 1 -- 172.21.15.86:0/2330023471 shutdown_connections 2024-04-25T12:22:25.583 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.578+0000 7f097aaf2640 1 -- 172.21.15.86:0/2330023471 wait complete. 2024-04-25T12:22:25.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.578+0000 7f097aaf2640 1 Processor -- start 2024-04-25T12:22:25.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.578+0000 7f097aaf2640 1 -- start start 2024-04-25T12:22:25.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.582+0000 7f097aaf2640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0974074100 0x7f097415c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:25.586 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.582+0000 7f097aaf2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f097414fbc0 0x7f097415c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:25.586 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.582+0000 7f097aaf2640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f097414ffa0 0x7f097415b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:25.586 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.582+0000 7f097aaf2640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f0974166420 con 0x7f097414ffa0 2024-04-25T12:22:25.586 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.582+0000 7f097aaf2640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f09741662a0 con 0x7f097414fbc0 2024-04-25T12:22:25.586 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.582+0000 7f097aaf2640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f09741665a0 con 0x7f0974074100 2024-04-25T12:22:25.586 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.582+0000 7f097908f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f097414ffa0 0x7f097415b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:25.587 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.582+0000 7f097908f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f097414ffa0 0x7f097415b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51116/0 (socket says 172.21.15.86:51116) 2024-04-25T12:22:25.587 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.582+0000 7f097908f640 1 -- 172.21.15.86:0/3376453539 learned_addr learned my addr 172.21.15.86:0/3376453539 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:25.587 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.582+0000 7f0973fff640 1 --2- 172.21.15.86:0/3376453539 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f097414fbc0 0x7f097415c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:25.587 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.582+0000 7f097888e640 1 --2- 172.21.15.86:0/3376453539 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0974074100 0x7f097415c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:25.587 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.582+0000 7f097908f640 1 -- 172.21.15.86:0/3376453539 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0974074100 msgr2=0x7f097415c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:25.587 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.582+0000 7f097908f640 1 --2- 172.21.15.86:0/3376453539 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0974074100 0x7f097415c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:25.587 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.582+0000 7f097908f640 1 -- 172.21.15.86:0/3376453539 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f097414fbc0 msgr2=0x7f097415c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:25.587 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.582+0000 7f097908f640 1 --2- 172.21.15.86:0/3376453539 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f097414fbc0 0x7f097415c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:25.588 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.582+0000 7f097908f640 1 -- 172.21.15.86:0/3376453539 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09741f3260 con 0x7f097414ffa0 2024-04-25T12:22:25.588 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.582+0000 7f097908f640 1 --2- 172.21.15.86:0/3376453539 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f097414ffa0 0x7f097415b0c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f096c00c7b0 tx=0x7f096c00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:25.588 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.582+0000 7f09717fa640 1 -- 172.21.15.86:0/3376453539 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f096c016020 con 0x7f097414ffa0 2024-04-25T12:22:25.588 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.582+0000 7f09717fa640 1 -- 172.21.15.86:0/3376453539 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f096c00aa90 con 0x7f097414ffa0 2024-04-25T12:22:25.588 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.582+0000 7f097aaf2640 1 -- 172.21.15.86:0/3376453539 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f097415a300 con 0x7f097414ffa0 2024-04-25T12:22:25.588 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.582+0000 7f09717fa640 1 -- 172.21.15.86:0/3376453539 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f096c00ce60 con 0x7f097414ffa0 2024-04-25T12:22:25.588 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.582+0000 7f097aaf2640 1 -- 172.21.15.86:0/3376453539 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f097415a8c0 con 0x7f097414ffa0 2024-04-25T12:22:25.588 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.582+0000 7f097aaf2640 1 -- 172.21.15.86:0/3376453539 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0974075df0 con 0x7f097414ffa0 2024-04-25T12:22:25.589 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.582+0000 7f09717fa640 1 -- 172.21.15.86:0/3376453539 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f096c019020 con 0x7f097414ffa0 2024-04-25T12:22:25.590 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.582+0000 7f09717fa640 1 --2- 172.21.15.86:0/3376453539 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f09600683b0 0x7f096006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:25.590 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.582+0000 7f09717fa640 1 -- 172.21.15.86:0/3376453539 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f096c086d10 con 0x7f097414ffa0 2024-04-25T12:22:25.590 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.582+0000 7f097888e640 1 --2- 172.21.15.86:0/3376453539 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f09600683b0 0x7f096006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:25.590 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.582+0000 7f097888e640 1 --2- 172.21.15.86:0/3376453539 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f09600683b0 0x7f096006a870 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f096400b9d0 tx=0x7f0964008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:25.591 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.586+0000 7f09717fa640 1 -- 172.21.15.86:0/3376453539 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f096c020030 con 0x7f097414ffa0 2024-04-25T12:22:25.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.750+0000 7f097aaf2640 1 -- 172.21.15.86:0/3376453539 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0974149c50 con 0x7f097414ffa0 2024-04-25T12:22:25.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.750+0000 7f09717fa640 1 -- 172.21.15.86:0/3376453539 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18905 (secure 0 0 0) 0x7f096c056ed0 con 0x7f097414ffa0 2024-04-25T12:22:25.753 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:22:25.753 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":26,"fsid":"f2ef5c0c-9576-4650-b4f7-6cb14247f62a","created":"2024-04-25T12:20:59.241733+0000","modified":"2024-04-25T12:22:04.877793+0000","last_up_change":"2024-04-25T12:21:10.939617+0000","last_in_change":"2024-04-25T12:21:01.534145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T12:21:11.839922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T12:21:21.854040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T12:21:22.406060+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T12:21:26.152386+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1f713f00-ef9f-4a6f-a620-38a8a1f8a822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6801","nonce":2812764579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6803","nonce":2812764579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6807","nonce":2812764579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6805","nonce":2812764579}]},"public_addr":"172.21.15.86:6801/2812764579","cluster_addr":"172.21.15.86:6803/2812764579","heartbeat_back_addr":"172.21.15.86:6807/2812764579","heartbeat_front_addr":"172.21.15.86:6805/2812764579","state":["exists","up"]},{"osd":1,"uuid":"baf6606d-a556-4fbe-a930-855e04ff1534","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6809","nonce":467966038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6811","nonce":467966038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6815","nonce":467966038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6813","nonce":467966038}]},"public_addr":"172.21.15.86:6809/467966038","cluster_addr":"172.21.15.86:6811/467966038","heartbeat_back_addr":"172.21.15.86:6815/467966038","heartbeat_front_addr":"172.21.15.86:6813/467966038","state":["exists","up"]},{"osd":2,"uuid":"c983d68e-6d60-434f-aed6-108420c5dd09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6817","nonce":3279762843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6820","nonce":3279762843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6825","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6827","nonce":3279762843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6824","nonce":3279762843}]},"public_addr":"172.21.15.86:6817/3279762843","cluster_addr":"172.21.15.86:6820/3279762843","heartbeat_back_addr":"172.21.15.86:6827/3279762843","heartbeat_front_addr":"172.21.15.86:6824/3279762843","state":["exists","up"]},{"osd":3,"uuid":"e77657bb-45aa-43bf-ab41-c7377eb495ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6821","nonce":2861354413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6826","nonce":2861354413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6831","nonce":2861354413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6829","nonce":2861354413}]},"public_addr":"172.21.15.86:6821/2861354413","cluster_addr":"172.21.15.86:6826/2861354413","heartbeat_back_addr":"172.21.15.86:6831/2861354413","heartbeat_front_addr":"172.21.15.86:6829/2861354413","state":["exists","up"]},{"osd":4,"uuid":"252bd300-d75a-4b00-be4b-27e6b51de4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6802","nonce":1872913602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6805","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6808","nonce":1872913602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6815","nonce":1872913602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6813","nonce":1872913602}]},"public_addr":"172.21.15.134:6802/1872913602","cluster_addr":"172.21.15.134:6808/1872913602","heartbeat_back_addr":"172.21.15.134:6815/1872913602","heartbeat_front_addr":"172.21.15.134:6813/1872913602","state":["exists","up"]},{"osd":5,"uuid":"4135da3f-7427-4409-a48e-78bd8a7b46ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6801","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6803","nonce":2261413981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6806","nonce":2261413981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6812","nonce":2261413981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6809","nonce":2261413981}]},"public_addr":"172.21.15.134:6803/2261413981","cluster_addr":"172.21.15.134:6806/2261413981","heartbeat_back_addr":"172.21.15.134:6812/2261413981","heartbeat_front_addr":"172.21.15.134:6809/2261413981","state":["exists","up"]},{"osd":6,"uuid":"b6e7a5f1-fa7e-497d-abac-a19994d26820","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6825","nonce":2841082767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6827","nonce":2841082767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6831","nonce":2841082767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6829","nonce":2841082767}]},"public_addr":"172.21.15.134:6825/2841082767","cluster_addr":"172.21.15.134:6827/2841082767","heartbeat_back_addr":"172.21.15.134:6831/2841082767","heartbeat_front_addr":"172.21.15.134:6829/2841082767","state":["exists","up"]},{"osd":7,"uuid":"c5597e50-1962-4103-9124-dd7bceb8ac97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6817","nonce":1277404274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6819","nonce":1277404274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6823","nonce":1277404274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6821","nonce":1277404274}]},"public_addr":"172.21.15.134:6817/1277404274","cluster_addr":"172.21.15.134:6819/1277404274","heartbeat_back_addr":"172.21.15.134:6823/1277404274","heartbeat_front_addr":"172.21.15.134:6821/1277404274","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.018125+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.157958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.113619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.136904+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.844514+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.872629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.775339+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.822867+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":7,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.33","mappings":[{"from":3,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T12:22:25.755 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.750+0000 7f097aaf2640 1 -- 172.21.15.86:0/3376453539 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f09600683b0 msgr2=0x7f096006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:25.755 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.750+0000 7f097aaf2640 1 --2- 172.21.15.86:0/3376453539 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f09600683b0 0x7f096006a870 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f096400b9d0 tx=0x7f0964008040 comp rx=0 tx=0).stop 2024-04-25T12:22:25.756 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.750+0000 7f097aaf2640 1 -- 172.21.15.86:0/3376453539 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f097414ffa0 msgr2=0x7f097415b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:25.756 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.750+0000 7f097aaf2640 1 --2- 172.21.15.86:0/3376453539 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f097414ffa0 0x7f097415b0c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f096c00c7b0 tx=0x7f096c00cc70 comp rx=0 tx=0).stop 2024-04-25T12:22:25.756 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.754+0000 7f097aaf2640 1 -- 172.21.15.86:0/3376453539 shutdown_connections 2024-04-25T12:22:25.756 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.754+0000 7f097aaf2640 1 --2- 172.21.15.86:0/3376453539 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f09600683b0 0x7f096006a870 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:25.756 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.754+0000 7f097aaf2640 1 --2- 172.21.15.86:0/3376453539 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f097414ffa0 0x7f097415b0c0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:25.756 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.754+0000 7f097aaf2640 1 --2- 172.21.15.86:0/3376453539 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f097414fbc0 0x7f097415c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:25.756 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.754+0000 7f097aaf2640 1 --2- 172.21.15.86:0/3376453539 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0974074100 0x7f097415c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:25.757 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.754+0000 7f097aaf2640 1 -- 172.21.15.86:0/3376453539 >> 172.21.15.86:0/3376453539 conn(0x7f097406b9d0 msgr2=0x7f097414d170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:25.757 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.754+0000 7f097aaf2640 1 -- 172.21.15.86:0/3376453539 shutdown_connections 2024-04-25T12:22:25.757 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.754+0000 7f097aaf2640 1 -- 172.21.15.86:0/3376453539 wait complete. 2024-04-25T12:22:25.773 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T12:21:11.839922+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T12:21:21.854040+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T12:21:22.406060+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T12:21:26.152386+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T12:22:25.774 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T12:22:25.899 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.898+0000 7fe67e453640 1 Processor -- start 2024-04-25T12:22:25.900 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.898+0000 7fe67e453640 1 -- start start 2024-04-25T12:22:25.902 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.898+0000 7fe67e453640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe678074100 0x7fe67806f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:25.902 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.898+0000 7fe67e453640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6780c5d70 con 0x7fe67814fbc0 2024-04-25T12:22:25.902 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.898+0000 7fe67e453640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6780c6050 con 0x7fe67814ffa0 2024-04-25T12:22:25.902 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.898+0000 7fe67e453640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fe6780c6330 con 0x7fe678074100 2024-04-25T12:22:25.902 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.898+0000 7fe677fff640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fe67814fbc0 0x7fe6780c8220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:41566/0 (socket says 172.21.15.86:41566) 2024-04-25T12:22:25.902 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.898+0000 7fe677fff640 1 -- 172.21.15.86:0/2588860535 learned_addr learned my addr 172.21.15.86:0/2588860535 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-04-25T12:22:25.903 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.898+0000 7fe67c9f0640 1 --2- 172.21.15.86:0/2588860535 >> v2:172.21.15.134:3300/0 conn(0x7fe678074100 0x7fe67806f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:25.903 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.898+0000 7fe676ffd640 1 -- 172.21.15.86:0/2588860535 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 543090562 0 0) 0x7fe6780c5d70 con 0x7fe67814fbc0 2024-04-25T12:22:25.903 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.898+0000 7fe676ffd640 1 -- 172.21.15.86:0/2588860535 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe664003530 con 0x7fe67814fbc0 2024-04-25T12:22:25.903 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.898+0000 7fe676ffd640 1 -- 172.21.15.86:0/2588860535 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3854926096 0 0) 0x7fe664003530 con 0x7fe67814fbc0 2024-04-25T12:22:25.903 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.898+0000 7fe676ffd640 1 -- 172.21.15.86:0/2588860535 >> v2:172.21.15.134:3300/0 conn(0x7fe678074100 msgr2=0x7fe67806f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:25.903 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.898+0000 7fe676ffd640 1 --2- 172.21.15.86:0/2588860535 >> v2:172.21.15.134:3300/0 conn(0x7fe678074100 0x7fe67806f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:25.903 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.898+0000 7fe676ffd640 1 -- 172.21.15.86:0/2588860535 >> v1:172.21.15.134:6789/0 conn(0x7fe67814ffa0 legacy=0x7fe6780c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:25.903 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.898+0000 7fe676ffd640 1 -- 172.21.15.86:0/2588860535 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6780c6610 con 0x7fe67814fbc0 2024-04-25T12:22:25.903 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.898+0000 7fe676ffd640 1 -- 172.21.15.86:0/2588860535 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1387950573 0 0) 0x7fe668001680 con 0x7fe67814fbc0 2024-04-25T12:22:25.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.898+0000 7fe676ffd640 1 -- 172.21.15.86:0/2588860535 >> v1:172.21.15.86:6789/0 conn(0x7fe67814fbc0 legacy=0x7fe6780c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:25.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.898+0000 7fe676ffd640 1 --2- 172.21.15.86:0/2588860535 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6640039f0 0x7fe664003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:25.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.898+0000 7fe676ffd640 1 --2- 172.21.15.86:0/2588860535 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe664004810 0x7fe664004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:25.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.898+0000 7fe676ffd640 1 --2- 172.21.15.86:0/2588860535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6640051d0 0x7fe66400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:25.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.898+0000 7fe676ffd640 1 -- 172.21.15.86:0/2588860535 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe6780c6330 con 0x7fe6640039f0 2024-04-25T12:22:25.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.898+0000 7fe676ffd640 1 -- 172.21.15.86:0/2588860535 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe66400c0a0 con 0x7fe6640051d0 2024-04-25T12:22:25.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.898+0000 7fe676ffd640 1 -- 172.21.15.86:0/2588860535 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fe66400c2a0 con 0x7fe664004810 2024-04-25T12:22:25.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.898+0000 7fe677fff640 1 --2- 172.21.15.86:0/2588860535 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6640039f0 0x7fe664003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:25.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.898+0000 7fe67c9f0640 1 --2- 172.21.15.86:0/2588860535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6640051d0 0x7fe66400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:25.905 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.898+0000 7fe6777fe640 1 --2- 172.21.15.86:0/2588860535 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe664004810 0x7fe664004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:25.905 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.898+0000 7fe677fff640 1 -- 172.21.15.86:0/2588860535 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe664004810 msgr2=0x7fe664004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:25.905 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.898+0000 7fe677fff640 1 --2- 172.21.15.86:0/2588860535 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe664004810 0x7fe664004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:25.905 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.898+0000 7fe677fff640 1 -- 172.21.15.86:0/2588860535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6640051d0 msgr2=0x7fe66400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:25.905 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.898+0000 7fe677fff640 1 --2- 172.21.15.86:0/2588860535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6640051d0 0x7fe66400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:25.905 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.898+0000 7fe677fff640 1 -- 172.21.15.86:0/2588860535 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe664003530 con 0x7fe6640039f0 2024-04-25T12:22:25.905 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.898+0000 7fe67c9f0640 1 --2- 172.21.15.86:0/2588860535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6640051d0 0x7fe66400b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:22:25.905 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.898+0000 7fe67c9f0640 1 -- 172.21.15.86:0/2588860535 reap_dead start 2024-04-25T12:22:25.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.902+0000 7fe677fff640 1 --2- 172.21.15.86:0/2588860535 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6640039f0 0x7fe664003e10 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe66800c1c0 tx=0x7fe66801cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecb00c01810c01da server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:25.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.902+0000 7fe676ffd640 1 -- 172.21.15.86:0/2588860535 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe668007d00 con 0x7fe6640039f0 2024-04-25T12:22:25.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.902+0000 7fe676ffd640 1 -- 172.21.15.86:0/2588860535 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6680a9020 con 0x7fe6640039f0 2024-04-25T12:22:25.909 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.902+0000 7fe676ffd640 1 -- 172.21.15.86:0/2588860535 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe668005b00 con 0x7fe6640039f0 2024-04-25T12:22:25.909 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.902+0000 7fe67e453640 1 -- 172.21.15.86:0/2588860535 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6640039f0 msgr2=0x7fe664003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:25.909 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.902+0000 7fe67e453640 1 --2- 172.21.15.86:0/2588860535 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6640039f0 0x7fe664003e10 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe66800c1c0 tx=0x7fe66801cc20 comp rx=0 tx=0).stop 2024-04-25T12:22:25.909 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.902+0000 7fe67e453640 1 -- 172.21.15.86:0/2588860535 shutdown_connections 2024-04-25T12:22:25.909 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.902+0000 7fe67e453640 1 --2- 172.21.15.86:0/2588860535 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6640039f0 0x7fe664003e10 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:25.909 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.902+0000 7fe67e453640 1 -- 172.21.15.86:0/2588860535 >> 172.21.15.86:0/2588860535 conn(0x7fe67806b9d0 msgr2=0x7fe67806bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:25.909 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.902+0000 7fe67e453640 1 -- 172.21.15.86:0/2588860535 shutdown_connections 2024-04-25T12:22:25.909 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.902+0000 7fe67e453640 1 -- 172.21.15.86:0/2588860535 wait complete. 2024-04-25T12:22:25.909 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.902+0000 7fe67e453640 1 Processor -- start 2024-04-25T12:22:25.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.902+0000 7fe67e453640 1 -- start start 2024-04-25T12:22:25.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.902+0000 7fe67e453640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe6640039f0 0x7fe6780caf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:25.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.902+0000 7fe67e453640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe67815ba40 0x7fe67815a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:25.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.902+0000 7fe67e453640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6781503c0 0x7fe678158e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:25.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.902+0000 7fe67e453640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe6780c75c0 con 0x7fe67815ba40 2024-04-25T12:22:25.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.902+0000 7fe67e453640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe6780c7440 con 0x7fe6781503c0 2024-04-25T12:22:25.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.902+0000 7fe67e453640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fe6780c7740 con 0x7fe6640039f0 2024-04-25T12:22:25.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.902+0000 7fe6777fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe67815ba40 0x7fe67815a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:25.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.902+0000 7fe6777fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe67815ba40 0x7fe67815a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51134/0 (socket says 172.21.15.86:51134) 2024-04-25T12:22:25.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.902+0000 7fe6777fe640 1 -- 172.21.15.86:0/2861739429 learned_addr learned my addr 172.21.15.86:0/2861739429 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:25.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.902+0000 7fe677fff640 1 --2- 172.21.15.86:0/2861739429 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe6640039f0 0x7fe6780caf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:25.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.902+0000 7fe67c9f0640 1 --2- 172.21.15.86:0/2861739429 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6781503c0 0x7fe678158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:25.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.902+0000 7fe6777fe640 1 -- 172.21.15.86:0/2861739429 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe6640039f0 msgr2=0x7fe6780caf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:25.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.902+0000 7fe6777fe640 1 --2- 172.21.15.86:0/2861739429 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe6640039f0 0x7fe6780caf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:25.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.902+0000 7fe6777fe640 1 -- 172.21.15.86:0/2861739429 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6781503c0 msgr2=0x7fe678158e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:25.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.902+0000 7fe6777fe640 1 --2- 172.21.15.86:0/2861739429 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6781503c0 0x7fe678158e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:25.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.902+0000 7fe6777fe640 1 -- 172.21.15.86:0/2861739429 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe67806be50 con 0x7fe67815ba40 2024-04-25T12:22:25.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.902+0000 7fe67c9f0640 1 --2- 172.21.15.86:0/2861739429 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6781503c0 0x7fe678158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:22:25.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.902+0000 7fe677fff640 1 --2- 172.21.15.86:0/2861739429 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe6640039f0 0x7fe6780caf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:22:25.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.906+0000 7fe6777fe640 1 --2- 172.21.15.86:0/2861739429 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe67815ba40 0x7fe67815a950 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe66000d4c0 tx=0x7fe66000d980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:25.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.906+0000 7fe674ff9640 1 -- 172.21.15.86:0/2861739429 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe660005480 con 0x7fe67815ba40 2024-04-25T12:22:25.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.906+0000 7fe674ff9640 1 -- 172.21.15.86:0/2861739429 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe660017070 con 0x7fe67815ba40 2024-04-25T12:22:25.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.906+0000 7fe67e453640 1 -- 172.21.15.86:0/2861739429 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe678151e70 con 0x7fe67815ba40 2024-04-25T12:22:25.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.906+0000 7fe674ff9640 1 -- 172.21.15.86:0/2861739429 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe660003840 con 0x7fe67815ba40 2024-04-25T12:22:25.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.906+0000 7fe67e453640 1 -- 172.21.15.86:0/2861739429 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe67815c210 con 0x7fe67815ba40 2024-04-25T12:22:25.913 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.906+0000 7fe67e453640 1 -- 172.21.15.86:0/2861739429 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe678075df0 con 0x7fe67815ba40 2024-04-25T12:22:25.913 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.906+0000 7fe674ff9640 1 -- 172.21.15.86:0/2861739429 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe6600039e0 con 0x7fe67815ba40 2024-04-25T12:22:25.913 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.906+0000 7fe674ff9640 1 --2- 172.21.15.86:0/2861739429 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fe6580683b0 0x7fe65806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:25.913 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.906+0000 7fe674ff9640 1 -- 172.21.15.86:0/2861739429 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fe660086c40 con 0x7fe67815ba40 2024-04-25T12:22:25.913 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.906+0000 7fe677fff640 1 --2- 172.21.15.86:0/2861739429 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fe6580683b0 0x7fe65806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:25.914 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.906+0000 7fe677fff640 1 --2- 172.21.15.86:0/2861739429 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fe6580683b0 0x7fe65806a870 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe6680aa000 tx=0x7fe6780c68f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:25.914 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:25.910+0000 7fe674ff9640 1 -- 172.21.15.86:0/2861739429 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe66000f2f0 con 0x7fe67815ba40 2024-04-25T12:22:26.070 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.066+0000 7fe67e453640 1 -- 172.21.15.86:0/2861739429 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe67814cb60 con 0x7fe67815ba40 2024-04-25T12:22:26.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.070+0000 7fe674ff9640 1 -- 172.21.15.86:0/2861739429 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7fe660056d70 con 0x7fe67815ba40 2024-04-25T12:22:26.071 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 1 2024-04-25T12:22:26.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.070+0000 7fe67e453640 1 -- 172.21.15.86:0/2861739429 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fe6580683b0 msgr2=0x7fe65806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:26.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.070+0000 7fe67e453640 1 --2- 172.21.15.86:0/2861739429 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fe6580683b0 0x7fe65806a870 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe6680aa000 tx=0x7fe6780c68f0 comp rx=0 tx=0).stop 2024-04-25T12:22:26.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.070+0000 7fe67e453640 1 -- 172.21.15.86:0/2861739429 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe67815ba40 msgr2=0x7fe67815a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:26.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.070+0000 7fe67e453640 1 --2- 172.21.15.86:0/2861739429 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe67815ba40 0x7fe67815a950 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe66000d4c0 tx=0x7fe66000d980 comp rx=0 tx=0).stop 2024-04-25T12:22:26.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.070+0000 7fe67e453640 1 -- 172.21.15.86:0/2861739429 shutdown_connections 2024-04-25T12:22:26.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.070+0000 7fe67e453640 1 --2- 172.21.15.86:0/2861739429 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6781503c0 0x7fe678158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:26.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.070+0000 7fe67e453640 1 --2- 172.21.15.86:0/2861739429 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fe6580683b0 0x7fe65806a870 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:26.075 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.070+0000 7fe67e453640 1 --2- 172.21.15.86:0/2861739429 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe67815ba40 0x7fe67815a950 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:26.075 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.070+0000 7fe67e453640 1 --2- 172.21.15.86:0/2861739429 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe6640039f0 0x7fe6780caf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:26.075 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.070+0000 7fe67e453640 1 -- 172.21.15.86:0/2861739429 >> 172.21.15.86:0/2861739429 conn(0x7fe67806b9d0 msgr2=0x7fe67814c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:26.075 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.070+0000 7fe67e453640 1 -- 172.21.15.86:0/2861739429 shutdown_connections 2024-04-25T12:22:26.075 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.070+0000 7fe67e453640 1 -- 172.21.15.86:0/2861739429 wait complete. 2024-04-25T12:22:26.089 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T12:22:26.207 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.206+0000 7f7a11491640 1 Processor -- start 2024-04-25T12:22:26.208 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.206+0000 7f7a11491640 1 -- start start 2024-04-25T12:22:26.209 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.206+0000 7f7a11491640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7a0c14fbc0 0x7f7a0c06f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:26.209 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.206+0000 7f7a11491640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7a0c14ffa0 0x7f7a0c0c8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:26.209 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.206+0000 7f7a11491640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7a0c074100 0x7f7a0c0c8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:26.210 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.206+0000 7f7a11491640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f7a0c0c5d70 con 0x7f7a0c074100 2024-04-25T12:22:26.210 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.206+0000 7f7a11491640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f7a0c0c6050 con 0x7f7a0c14fbc0 2024-04-25T12:22:26.210 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.206+0000 7f7a11491640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f7a0c0c6330 con 0x7f7a0c14ffa0 2024-04-25T12:22:26.210 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.206+0000 7f7a0b7fe640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7a0c074100 0x7f7a0c0c8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:26.210 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.206+0000 7f7a0b7fe640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7a0c074100 0x7f7a0c0c8760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51142/0 (socket says 172.21.15.86:51142) 2024-04-25T12:22:26.210 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.206+0000 7f7a0b7fe640 1 -- 172.21.15.86:0/3229326889 learned_addr learned my addr 172.21.15.86:0/3229326889 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:26.210 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.206+0000 7f7a027fc640 1 --2- 172.21.15.86:0/3229326889 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7a0c14ffa0 0x7f7a0c0c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:26.210 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.206+0000 7f7a0b7fe640 1 -- 172.21.15.86:0/3229326889 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7a0c14ffa0 msgr2=0x7f7a0c0c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:26.211 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.206+0000 7f7a0affd640 1 --2- 172.21.15.86:0/3229326889 >> v2:172.21.15.134:3300/0 conn(0x7f7a0c14fbc0 0x7f7a0c06f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:26.211 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.206+0000 7f7a0b7fe640 1 --2- 172.21.15.86:0/3229326889 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7a0c14ffa0 0x7f7a0c0c8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:26.211 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.206+0000 7f7a0b7fe640 1 -- 172.21.15.86:0/3229326889 >> v2:172.21.15.134:3300/0 conn(0x7f7a0c14fbc0 msgr2=0x7f7a0c06f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:26.211 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.206+0000 7f7a0b7fe640 1 --2- 172.21.15.86:0/3229326889 >> v2:172.21.15.134:3300/0 conn(0x7f7a0c14fbc0 0x7f7a0c06f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:26.211 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.206+0000 7f7a0b7fe640 1 -- 172.21.15.86:0/3229326889 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a0c0c6610 con 0x7f7a0c074100 2024-04-25T12:22:26.211 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.206+0000 7f7a027fc640 1 --2- 172.21.15.86:0/3229326889 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7a0c14ffa0 0x7f7a0c0c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:22:26.211 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.206+0000 7f7a0affd640 1 --2- 172.21.15.86:0/3229326889 >> v2:172.21.15.134:3300/0 conn(0x7f7a0c14fbc0 0x7f7a0c06f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:22:26.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.206+0000 7f7a0b7fe640 1 --2- 172.21.15.86:0/3229326889 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7a0c074100 0x7f7a0c0c8760 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c050430 tx=0x7f7a0401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de321464daed089a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:26.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.210+0000 7f7a0a7fc640 1 -- 172.21.15.86:0/3229326889 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a040aa660 con 0x7f7a0c074100 2024-04-25T12:22:26.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.210+0000 7f7a0a7fc640 1 -- 172.21.15.86:0/3229326889 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a040af070 con 0x7f7a0c074100 2024-04-25T12:22:26.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.210+0000 7f7a0a7fc640 1 -- 172.21.15.86:0/3229326889 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a040aaa20 con 0x7f7a0c074100 2024-04-25T12:22:26.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.210+0000 7f7a11491640 1 -- 172.21.15.86:0/3229326889 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7a0c074100 msgr2=0x7f7a0c0c8760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:26.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.210+0000 7f7a11491640 1 --2- 172.21.15.86:0/3229326889 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7a0c074100 0x7f7a0c0c8760 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c050430 tx=0x7f7a0401c520 comp rx=0 tx=0).stop 2024-04-25T12:22:26.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.210+0000 7f7a11491640 1 -- 172.21.15.86:0/3229326889 shutdown_connections 2024-04-25T12:22:26.214 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.210+0000 7f7a11491640 1 --2- 172.21.15.86:0/3229326889 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7a0c074100 0x7f7a0c0c8760 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:26.214 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.210+0000 7f7a11491640 1 --2- 172.21.15.86:0/3229326889 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7a0c14ffa0 0x7f7a0c0c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:26.214 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.210+0000 7f7a11491640 1 --2- 172.21.15.86:0/3229326889 >> v2:172.21.15.134:3300/0 conn(0x7f7a0c14fbc0 0x7f7a0c06f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:26.214 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.210+0000 7f7a11491640 1 -- 172.21.15.86:0/3229326889 >> 172.21.15.86:0/3229326889 conn(0x7f7a0c06b9d0 msgr2=0x7f7a0c06bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:26.214 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.210+0000 7f7a11491640 1 -- 172.21.15.86:0/3229326889 shutdown_connections 2024-04-25T12:22:26.214 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.210+0000 7f7a11491640 1 -- 172.21.15.86:0/3229326889 wait complete. 2024-04-25T12:22:26.214 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.210+0000 7f7a11491640 1 Processor -- start 2024-04-25T12:22:26.214 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.210+0000 7f7a11491640 1 -- start start 2024-04-25T12:22:26.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.210+0000 7f7a11491640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7a0c074100 0x7f7a0c152f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:26.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.210+0000 7f7a11491640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a0c14fbc0 0x7f7a0c15c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:26.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.210+0000 7f7a11491640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7a0c14ffa0 0x7f7a0c1f26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:26.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.210+0000 7f7a11491640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7a0c1592e0 con 0x7f7a0c074100 2024-04-25T12:22:26.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.210+0000 7f7a11491640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7a0c159160 con 0x7f7a0c14fbc0 2024-04-25T12:22:26.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.210+0000 7f7a11491640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f7a0c159460 con 0x7f7a0c14ffa0 2024-04-25T12:22:26.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.210+0000 7f7a0affd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7a0c074100 0x7f7a0c152f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:26.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.210+0000 7f7a0affd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7a0c074100 0x7f7a0c152f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51148/0 (socket says 172.21.15.86:51148) 2024-04-25T12:22:26.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.210+0000 7f7a0affd640 1 -- 172.21.15.86:0/3035485356 learned_addr learned my addr 172.21.15.86:0/3035485356 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:26.218 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.210+0000 7f7a0b7fe640 1 --2- 172.21.15.86:0/3035485356 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7a0c14ffa0 0x7f7a0c1f26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:26.218 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.210+0000 7f7a0affd640 1 -- 172.21.15.86:0/3035485356 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7a0c14ffa0 msgr2=0x7f7a0c1f26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:26.218 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.210+0000 7f7a0affd640 1 --2- 172.21.15.86:0/3035485356 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7a0c14ffa0 0x7f7a0c1f26c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:26.218 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.210+0000 7f7a0affd640 1 -- 172.21.15.86:0/3035485356 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a0c14fbc0 msgr2=0x7f7a0c15c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:26.218 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.210+0000 7f7a0affd640 1 --2- 172.21.15.86:0/3035485356 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a0c14fbc0 0x7f7a0c15c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:26.218 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.210+0000 7f7a0affd640 1 -- 172.21.15.86:0/3035485356 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a0c153630 con 0x7f7a0c074100 2024-04-25T12:22:26.218 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.210+0000 7f7a0affd640 1 --2- 172.21.15.86:0/3035485356 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7a0c074100 0x7f7a0c152f80 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f79fc00cee0 tx=0x7f79fc00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:26.218 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.210+0000 7f7a03fff640 1 -- 172.21.15.86:0/3035485356 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79fc01a070 con 0x7f7a0c074100 2024-04-25T12:22:26.218 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.210+0000 7f7a03fff640 1 -- 172.21.15.86:0/3035485356 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79fc00d840 con 0x7f7a0c074100 2024-04-25T12:22:26.219 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.210+0000 7f7a11491640 1 -- 172.21.15.86:0/3035485356 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a0c1504f0 con 0x7f7a0c074100 2024-04-25T12:22:26.219 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.210+0000 7f7a03fff640 1 -- 172.21.15.86:0/3035485356 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79fc00dc10 con 0x7f7a0c074100 2024-04-25T12:22:26.219 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.210+0000 7f7a11491640 1 -- 172.21.15.86:0/3035485356 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a0c150a70 con 0x7f7a0c074100 2024-04-25T12:22:26.219 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.214+0000 7f7a11491640 1 -- 172.21.15.86:0/3035485356 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a0c075df0 con 0x7f7a0c074100 2024-04-25T12:22:26.219 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.214+0000 7f7a03fff640 1 -- 172.21.15.86:0/3035485356 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f79fc01d070 con 0x7f7a0c074100 2024-04-25T12:22:26.219 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.214+0000 7f7a03fff640 1 --2- 172.21.15.86:0/3035485356 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f79ec068380 0x7f79ec06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:26.219 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.214+0000 7f7a027fc640 1 --2- 172.21.15.86:0/3035485356 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f79ec068380 0x7f79ec06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:26.219 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.214+0000 7f7a03fff640 1 -- 172.21.15.86:0/3035485356 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f79fc0875b0 con 0x7f7a0c074100 2024-04-25T12:22:26.219 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.214+0000 7f7a027fc640 1 --2- 172.21.15.86:0/3035485356 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f79ec068380 0x7f79ec06a840 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c1f6410 tx=0x7f79f4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:26.221 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.218+0000 7f7a03fff640 1 -- 172.21.15.86:0/3035485356 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f79fc0570a0 con 0x7f7a0c074100 2024-04-25T12:22:26.384 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.382+0000 7f7a11491640 1 -- 172.21.15.86:0/3035485356 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f7a0c158d30 con 0x7f7a0c074100 2024-04-25T12:22:26.385 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.382+0000 7f7a03fff640 1 -- 172.21.15.86:0/3035485356 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f79fc05b3a0 con 0x7f7a0c074100 2024-04-25T12:22:26.385 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 32 2024-04-25T12:22:26.388 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.386+0000 7f7a11491640 1 -- 172.21.15.86:0/3035485356 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f79ec068380 msgr2=0x7f79ec06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:26.388 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.386+0000 7f7a11491640 1 --2- 172.21.15.86:0/3035485356 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f79ec068380 0x7f79ec06a840 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c1f6410 tx=0x7f79f4008040 comp rx=0 tx=0).stop 2024-04-25T12:22:26.388 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.386+0000 7f7a11491640 1 -- 172.21.15.86:0/3035485356 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7a0c074100 msgr2=0x7f7a0c152f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:26.388 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.386+0000 7f7a11491640 1 --2- 172.21.15.86:0/3035485356 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7a0c074100 0x7f7a0c152f80 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f79fc00cee0 tx=0x7f79fc00a710 comp rx=0 tx=0).stop 2024-04-25T12:22:26.388 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.386+0000 7f7a11491640 1 -- 172.21.15.86:0/3035485356 shutdown_connections 2024-04-25T12:22:26.388 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.386+0000 7f7a11491640 1 --2- 172.21.15.86:0/3035485356 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7a0c14ffa0 0x7f7a0c1f26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:26.388 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.386+0000 7f7a11491640 1 --2- 172.21.15.86:0/3035485356 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a0c14fbc0 0x7f7a0c15c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:26.389 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.386+0000 7f7a11491640 1 --2- 172.21.15.86:0/3035485356 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f79ec068380 0x7f79ec06a840 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:26.389 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.386+0000 7f7a11491640 1 --2- 172.21.15.86:0/3035485356 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7a0c074100 0x7f7a0c152f80 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:26.389 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.386+0000 7f7a11491640 1 -- 172.21.15.86:0/3035485356 >> 172.21.15.86:0/3035485356 conn(0x7f7a0c06b9d0 msgr2=0x7f7a0c06e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:26.389 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.386+0000 7f7a11491640 1 -- 172.21.15.86:0/3035485356 shutdown_connections 2024-04-25T12:22:26.389 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.386+0000 7f7a11491640 1 -- 172.21.15.86:0/3035485356 wait complete. 2024-04-25T12:22:26.404 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T12:22:26.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.526+0000 7f3c2beff640 1 Processor -- start 2024-04-25T12:22:26.528 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.526+0000 7f3c2beff640 1 -- start start 2024-04-25T12:22:26.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.526+0000 7f3c2beff640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3c2414fbc0 0x7f3c2406f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:26.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.526+0000 7f3c2beff640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3c2414ffa0 0x7f3c240c8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:26.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.526+0000 7f3c2beff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3c24074100 0x7f3c240c8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:26.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.526+0000 7f3c2beff640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f3c240c5d70 con 0x7f3c2414fbc0 2024-04-25T12:22:26.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.526+0000 7f3c2beff640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f3c240c6050 con 0x7f3c24074100 2024-04-25T12:22:26.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.526+0000 7f3c2beff640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f3c240c6330 con 0x7f3c2414ffa0 2024-04-25T12:22:26.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.526+0000 7f3c29c9b640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3c2414fbc0 0x7f3c2406f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:26.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.526+0000 7f3c29c9b640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3c2414fbc0 0x7f3c2406f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51156/0 (socket says 172.21.15.86:51156) 2024-04-25T12:22:26.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.526+0000 7f3c29c9b640 1 -- 172.21.15.86:0/1871618507 learned_addr learned my addr 172.21.15.86:0/1871618507 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:26.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.526+0000 7f3c2949a640 1 --2- 172.21.15.86:0/1871618507 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3c2414ffa0 0x7f3c240c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:26.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.526+0000 7f3c2a49c640 1 --2- 172.21.15.86:0/1871618507 >> v2:172.21.15.134:3300/0 conn(0x7f3c24074100 0x7f3c240c8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:26.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.526+0000 7f3c29c9b640 1 -- 172.21.15.86:0/1871618507 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3c2414ffa0 msgr2=0x7f3c240c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:26.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.526+0000 7f3c29c9b640 1 --2- 172.21.15.86:0/1871618507 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3c2414ffa0 0x7f3c240c8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:26.531 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.526+0000 7f3c29c9b640 1 -- 172.21.15.86:0/1871618507 >> v2:172.21.15.134:3300/0 conn(0x7f3c24074100 msgr2=0x7f3c240c8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:26.531 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.526+0000 7f3c29c9b640 1 --2- 172.21.15.86:0/1871618507 >> v2:172.21.15.134:3300/0 conn(0x7f3c24074100 0x7f3c240c8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:26.531 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.526+0000 7f3c29c9b640 1 -- 172.21.15.86:0/1871618507 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c240c6610 con 0x7f3c2414fbc0 2024-04-25T12:22:26.532 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.530+0000 7f3c29c9b640 1 --2- 172.21.15.86:0/1871618507 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c2414fbc0 0x7f3c2406f700 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3c240744e0 tx=0x7f3c1401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f851f695b8e3da36 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:26.532 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.530+0000 7f3c28c99640 1 -- 172.21.15.86:0/1871618507 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c140aa660 con 0x7f3c2414fbc0 2024-04-25T12:22:26.533 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.530+0000 7f3c28c99640 1 -- 172.21.15.86:0/1871618507 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c140af070 con 0x7f3c2414fbc0 2024-04-25T12:22:26.533 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.530+0000 7f3c28c99640 1 -- 172.21.15.86:0/1871618507 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c140aaa20 con 0x7f3c2414fbc0 2024-04-25T12:22:26.534 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.530+0000 7f3c2beff640 1 -- 172.21.15.86:0/1871618507 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c2414fbc0 msgr2=0x7f3c2406f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:26.534 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.530+0000 7f3c2beff640 1 --2- 172.21.15.86:0/1871618507 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c2414fbc0 0x7f3c2406f700 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3c240744e0 tx=0x7f3c1401c520 comp rx=0 tx=0).stop 2024-04-25T12:22:26.534 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.530+0000 7f3c2beff640 1 -- 172.21.15.86:0/1871618507 shutdown_connections 2024-04-25T12:22:26.534 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.530+0000 7f3c2beff640 1 --2- 172.21.15.86:0/1871618507 >> v2:172.21.15.134:3300/0 conn(0x7f3c24074100 0x7f3c240c8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:26.534 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.530+0000 7f3c2beff640 1 --2- 172.21.15.86:0/1871618507 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3c2414ffa0 0x7f3c240c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:26.534 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.530+0000 7f3c2beff640 1 --2- 172.21.15.86:0/1871618507 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c2414fbc0 0x7f3c2406f700 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:26.534 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.530+0000 7f3c2beff640 1 -- 172.21.15.86:0/1871618507 >> 172.21.15.86:0/1871618507 conn(0x7f3c2406b9d0 msgr2=0x7f3c2406bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:26.535 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.530+0000 7f3c2beff640 1 -- 172.21.15.86:0/1871618507 shutdown_connections 2024-04-25T12:22:26.535 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.530+0000 7f3c2beff640 1 -- 172.21.15.86:0/1871618507 wait complete. 2024-04-25T12:22:26.537 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.530+0000 7f3c2beff640 1 Processor -- start 2024-04-25T12:22:26.537 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.530+0000 7f3c2beff640 1 -- start start 2024-04-25T12:22:26.537 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.534+0000 7f3c2beff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c24074100 0x7f3c2415ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:26.537 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.534+0000 7f3c2beff640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3c2414fbc0 0x7f3c24149480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:26.537 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.534+0000 7f3c2beff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c2414ffa0 0x7f3c2415c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:26.537 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.534+0000 7f3c2beff640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3c241592e0 con 0x7f3c24074100 2024-04-25T12:22:26.537 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.534+0000 7f3c2beff640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3c24159160 con 0x7f3c2414ffa0 2024-04-25T12:22:26.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.534+0000 7f3c2beff640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f3c24159460 con 0x7f3c2414fbc0 2024-04-25T12:22:26.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.534+0000 7f3c29c9b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c24074100 0x7f3c2415ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:26.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.534+0000 7f3c29c9b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c24074100 0x7f3c2415ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51164/0 (socket says 172.21.15.86:51164) 2024-04-25T12:22:26.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.534+0000 7f3c29c9b640 1 -- 172.21.15.86:0/3642698159 learned_addr learned my addr 172.21.15.86:0/3642698159 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:26.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.534+0000 7f3c2a49c640 1 --2- 172.21.15.86:0/3642698159 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c2414ffa0 0x7f3c2415c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:26.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.534+0000 7f3c2949a640 1 --2- 172.21.15.86:0/3642698159 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3c2414fbc0 0x7f3c24149480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:26.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.534+0000 7f3c29c9b640 1 -- 172.21.15.86:0/3642698159 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3c2414fbc0 msgr2=0x7f3c24149480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:26.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.534+0000 7f3c29c9b640 1 --2- 172.21.15.86:0/3642698159 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3c2414fbc0 0x7f3c24149480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:26.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.534+0000 7f3c29c9b640 1 -- 172.21.15.86:0/3642698159 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c2414ffa0 msgr2=0x7f3c2415c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:26.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.534+0000 7f3c29c9b640 1 --2- 172.21.15.86:0/3642698159 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c2414ffa0 0x7f3c2415c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:26.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.534+0000 7f3c29c9b640 1 -- 172.21.15.86:0/3642698159 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c24158650 con 0x7f3c24074100 2024-04-25T12:22:26.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.534+0000 7f3c29c9b640 1 --2- 172.21.15.86:0/3642698159 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c24074100 0x7f3c2415ee10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3c1401cdc0 tx=0x7f3c1401ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:26.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.534+0000 7f3c1a7fc640 1 -- 172.21.15.86:0/3642698159 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c140bd5f0 con 0x7f3c24074100 2024-04-25T12:22:26.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.534+0000 7f3c1a7fc640 1 -- 172.21.15.86:0/3642698159 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c140bd7b0 con 0x7f3c24074100 2024-04-25T12:22:26.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.534+0000 7f3c1a7fc640 1 -- 172.21.15.86:0/3642698159 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c140bdba0 con 0x7f3c24074100 2024-04-25T12:22:26.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.534+0000 7f3c2beff640 1 -- 172.21.15.86:0/3642698159 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c24158910 con 0x7f3c24074100 2024-04-25T12:22:26.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.534+0000 7f3c2beff640 1 -- 172.21.15.86:0/3642698159 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c241f50d0 con 0x7f3c24074100 2024-04-25T12:22:26.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.534+0000 7f3c2beff640 1 -- 172.21.15.86:0/3642698159 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c24075df0 con 0x7f3c24074100 2024-04-25T12:22:26.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.534+0000 7f3c1a7fc640 1 -- 172.21.15.86:0/3642698159 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3c140b33f0 con 0x7f3c24074100 2024-04-25T12:22:26.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.538+0000 7f3c1a7fc640 1 --2- 172.21.15.86:0/3642698159 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f3c08068400 0x7f3c0806a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:26.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.538+0000 7f3c1a7fc640 1 -- 172.21.15.86:0/3642698159 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f3c14121290 con 0x7f3c24074100 2024-04-25T12:22:26.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.538+0000 7f3c2949a640 1 --2- 172.21.15.86:0/3642698159 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f3c08068400 0x7f3c0806a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:26.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.538+0000 7f3c2949a640 1 --2- 172.21.15.86:0/3642698159 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f3c08068400 0x7f3c0806a8c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3c24149130 tx=0x7f3c20008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:26.543 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.542+0000 7f3c1a7fc640 1 -- 172.21.15.86:0/3642698159 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3c140c3060 con 0x7f3c24074100 2024-04-25T12:22:26.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.702+0000 7f3c2beff640 1 -- 172.21.15.86:0/3642698159 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f3c240c7df0 con 0x7f3c24074100 2024-04-25T12:22:26.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.702+0000 7f3c1a7fc640 1 -- 172.21.15.86:0/3642698159 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7f3c14016110 con 0x7f3c24074100 2024-04-25T12:22:26.705 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 64 2024-04-25T12:22:26.707 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.706+0000 7f3c2beff640 1 -- 172.21.15.86:0/3642698159 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f3c08068400 msgr2=0x7f3c0806a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:26.708 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.706+0000 7f3c2beff640 1 --2- 172.21.15.86:0/3642698159 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f3c08068400 0x7f3c0806a8c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3c24149130 tx=0x7f3c20008040 comp rx=0 tx=0).stop 2024-04-25T12:22:26.708 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.706+0000 7f3c2beff640 1 -- 172.21.15.86:0/3642698159 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c24074100 msgr2=0x7f3c2415ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:26.708 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.706+0000 7f3c2beff640 1 --2- 172.21.15.86:0/3642698159 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c24074100 0x7f3c2415ee10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3c1401cdc0 tx=0x7f3c1401ad60 comp rx=0 tx=0).stop 2024-04-25T12:22:26.708 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.706+0000 7f3c2beff640 1 -- 172.21.15.86:0/3642698159 shutdown_connections 2024-04-25T12:22:26.708 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.706+0000 7f3c2beff640 1 --2- 172.21.15.86:0/3642698159 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c2414ffa0 0x7f3c2415c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:26.708 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.706+0000 7f3c2beff640 1 --2- 172.21.15.86:0/3642698159 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3c2414fbc0 0x7f3c24149480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:26.708 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.706+0000 7f3c2beff640 1 --2- 172.21.15.86:0/3642698159 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f3c08068400 0x7f3c0806a8c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:26.708 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.706+0000 7f3c2beff640 1 --2- 172.21.15.86:0/3642698159 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c24074100 0x7f3c2415ee10 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:26.709 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.706+0000 7f3c2beff640 1 -- 172.21.15.86:0/3642698159 >> 172.21.15.86:0/3642698159 conn(0x7f3c2406b9d0 msgr2=0x7f3c2414e250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:26.709 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.706+0000 7f3c2beff640 1 -- 172.21.15.86:0/3642698159 shutdown_connections 2024-04-25T12:22:26.709 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.706+0000 7f3c2beff640 1 -- 172.21.15.86:0/3642698159 wait complete. 2024-04-25T12:22:26.723 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T12:22:26.844 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.842+0000 7f8cd6309640 1 Processor -- start 2024-04-25T12:22:26.844 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.842+0000 7f8cd6309640 1 -- start start 2024-04-25T12:22:26.845 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.842+0000 7f8cd6309640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8cd0144370 0x7f8cd006c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:26.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.842+0000 7f8cd6309640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8cd0073200 0x7f8cd0073620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:26.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.842+0000 7f8cd6309640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8cd00ca140 0x7f8cd00ca5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:26.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.842+0000 7f8cd6309640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f8cd015e7e0 con 0x7f8cd0144370 2024-04-25T12:22:26.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.842+0000 7f8cd6309640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f8cd015eaa0 con 0x7f8cd00ca140 2024-04-25T12:22:26.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.842+0000 7f8cd6309640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f8cd015ed80 con 0x7f8cd0073200 2024-04-25T12:22:26.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.842+0000 7f8ccffff640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8cd0144370 0x7f8cd006c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:26.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.842+0000 7f8ccffff640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8cd0144370 0x7f8cd006c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51174/0 (socket says 172.21.15.86:51174) 2024-04-25T12:22:26.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.842+0000 7f8ccffff640 1 -- 172.21.15.86:0/1233381574 learned_addr learned my addr 172.21.15.86:0/1233381574 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:26.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.842+0000 7f8ccf7fe640 1 --2- 172.21.15.86:0/1233381574 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8cd0073200 0x7f8cd0073620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:26.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.842+0000 7f8cd48a6640 1 --2- 172.21.15.86:0/1233381574 >> v2:172.21.15.134:3300/0 conn(0x7f8cd00ca140 0x7f8cd00ca5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:26.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.842+0000 7f8ccffff640 1 -- 172.21.15.86:0/1233381574 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8cd0073200 msgr2=0x7f8cd0073620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:26.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.842+0000 7f8ccffff640 1 --2- 172.21.15.86:0/1233381574 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8cd0073200 0x7f8cd0073620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:26.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.842+0000 7f8ccffff640 1 -- 172.21.15.86:0/1233381574 >> v2:172.21.15.134:3300/0 conn(0x7f8cd00ca140 msgr2=0x7f8cd00ca5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:26.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.842+0000 7f8ccffff640 1 --2- 172.21.15.86:0/1233381574 >> v2:172.21.15.134:3300/0 conn(0x7f8cd00ca140 0x7f8cd00ca5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:26.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.842+0000 7f8ccffff640 1 -- 172.21.15.86:0/1233381574 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cd015f060 con 0x7f8cd0144370 2024-04-25T12:22:26.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.842+0000 7f8cd48a6640 1 --2- 172.21.15.86:0/1233381574 >> v2:172.21.15.134:3300/0 conn(0x7f8cd00ca140 0x7f8cd00ca5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:22:26.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.846+0000 7f8ccffff640 1 --2- 172.21.15.86:0/1233381574 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8cd0144370 0x7f8cd006c4e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8cd00c85a0 tx=0x7f8cc001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9594cf6e632be66b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:26.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.846+0000 7f8cceffd640 1 -- 172.21.15.86:0/1233381574 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc00a5670 con 0x7f8cd0144370 2024-04-25T12:22:26.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.846+0000 7f8cceffd640 1 -- 172.21.15.86:0/1233381574 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cc00a5810 con 0x7f8cd0144370 2024-04-25T12:22:26.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.846+0000 7f8cceffd640 1 -- 172.21.15.86:0/1233381574 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc00a5be0 con 0x7f8cd0144370 2024-04-25T12:22:26.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.846+0000 7f8cd6309640 1 -- 172.21.15.86:0/1233381574 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8cd0144370 msgr2=0x7f8cd006c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:26.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.846+0000 7f8cd6309640 1 --2- 172.21.15.86:0/1233381574 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8cd0144370 0x7f8cd006c4e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8cd00c85a0 tx=0x7f8cc001c9f0 comp rx=0 tx=0).stop 2024-04-25T12:22:26.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.846+0000 7f8cd6309640 1 -- 172.21.15.86:0/1233381574 shutdown_connections 2024-04-25T12:22:26.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.846+0000 7f8cd6309640 1 --2- 172.21.15.86:0/1233381574 >> v2:172.21.15.134:3300/0 conn(0x7f8cd00ca140 0x7f8cd00ca5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:26.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.846+0000 7f8cd6309640 1 --2- 172.21.15.86:0/1233381574 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8cd0073200 0x7f8cd0073620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:26.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.846+0000 7f8cd6309640 1 --2- 172.21.15.86:0/1233381574 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8cd0144370 0x7f8cd006c4e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:26.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.846+0000 7f8cd6309640 1 -- 172.21.15.86:0/1233381574 >> 172.21.15.86:0/1233381574 conn(0x7f8cd006e070 msgr2=0x7f8cd006e480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:26.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.846+0000 7f8cd6309640 1 -- 172.21.15.86:0/1233381574 shutdown_connections 2024-04-25T12:22:26.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.846+0000 7f8cd6309640 1 -- 172.21.15.86:0/1233381574 wait complete. 2024-04-25T12:22:26.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.846+0000 7f8cd6309640 1 Processor -- start 2024-04-25T12:22:26.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.846+0000 7f8cd6309640 1 -- start start 2024-04-25T12:22:26.853 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.850+0000 7f8cd6309640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8cd0073200 0x7f8cd01f74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:26.853 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.850+0000 7f8cd6309640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8cd00ca140 0x7f8cd015a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:26.853 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.850+0000 7f8cd6309640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8cd0144370 0x7f8cd013adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:26.853 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.850+0000 7f8cd6309640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd0072460 con 0x7f8cd00ca140 2024-04-25T12:22:26.853 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.850+0000 7f8cd6309640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd00722e0 con 0x7f8cd0073200 2024-04-25T12:22:26.853 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.850+0000 7f8cd6309640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f8cd00725e0 con 0x7f8cd0144370 2024-04-25T12:22:26.853 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.850+0000 7f8ccf7fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8cd00ca140 0x7f8cd015a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:26.853 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.850+0000 7f8ccf7fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8cd00ca140 0x7f8cd015a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51186/0 (socket says 172.21.15.86:51186) 2024-04-25T12:22:26.853 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.850+0000 7f8ccf7fe640 1 -- 172.21.15.86:0/3561493260 learned_addr learned my addr 172.21.15.86:0/3561493260 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:26.854 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.850+0000 7f8cd48a6640 1 --2- 172.21.15.86:0/3561493260 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8cd0144370 0x7f8cd013adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:26.854 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.850+0000 7f8ccffff640 1 --2- 172.21.15.86:0/3561493260 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8cd0073200 0x7f8cd01f74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:26.854 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.850+0000 7f8ccf7fe640 1 -- 172.21.15.86:0/3561493260 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8cd0144370 msgr2=0x7f8cd013adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:26.854 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.850+0000 7f8ccf7fe640 1 --2- 172.21.15.86:0/3561493260 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8cd0144370 0x7f8cd013adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:26.854 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.850+0000 7f8ccf7fe640 1 -- 172.21.15.86:0/3561493260 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8cd0073200 msgr2=0x7f8cd01f74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:26.854 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.850+0000 7f8ccf7fe640 1 --2- 172.21.15.86:0/3561493260 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8cd0073200 0x7f8cd01f74d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:26.854 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.850+0000 7f8ccf7fe640 1 -- 172.21.15.86:0/3561493260 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cd00c4eb0 con 0x7f8cd00ca140 2024-04-25T12:22:26.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.850+0000 7f8ccf7fe640 1 --2- 172.21.15.86:0/3561493260 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8cd00ca140 0x7f8cd015a920 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8cc400d7d0 tx=0x7f8cc400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:26.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.850+0000 7f8cccff9640 1 -- 172.21.15.86:0/3561493260 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc4004030 con 0x7f8cd00ca140 2024-04-25T12:22:26.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.850+0000 7f8cccff9640 1 -- 172.21.15.86:0/3561493260 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cc40041d0 con 0x7f8cd00ca140 2024-04-25T12:22:26.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.850+0000 7f8cccff9640 1 -- 172.21.15.86:0/3561493260 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc40096a0 con 0x7f8cd00ca140 2024-04-25T12:22:26.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.850+0000 7f8cd6309640 1 -- 172.21.15.86:0/3561493260 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cd013e540 con 0x7f8cd00ca140 2024-04-25T12:22:26.856 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.850+0000 7f8cd6309640 1 -- 172.21.15.86:0/3561493260 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cd01417d0 con 0x7f8cd00ca140 2024-04-25T12:22:26.856 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.850+0000 7f8cd6309640 1 -- 172.21.15.86:0/3561493260 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cd0075df0 con 0x7f8cd00ca140 2024-04-25T12:22:26.856 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.850+0000 7f8cccff9640 1 -- 172.21.15.86:0/3561493260 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8cc4009840 con 0x7f8cd00ca140 2024-04-25T12:22:26.856 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.850+0000 7f8cccff9640 1 --2- 172.21.15.86:0/3561493260 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f8cbc068380 0x7f8cbc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:26.856 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.850+0000 7f8ccffff640 1 --2- 172.21.15.86:0/3561493260 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f8cbc068380 0x7f8cbc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:26.856 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.850+0000 7f8cccff9640 1 -- 172.21.15.86:0/3561493260 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f8cc4087140 con 0x7f8cd00ca140 2024-04-25T12:22:26.857 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.854+0000 7f8ccffff640 1 --2- 172.21.15.86:0/3561493260 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f8cbc068380 0x7f8cbc06a840 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8cc00ae000 tx=0x7f8cc00a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:26.859 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:26.854+0000 7f8cccff9640 1 -- 172.21.15.86:0/3561493260 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8cc401c360 con 0x7f8cd00ca140 2024-04-25T12:22:27.020 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.018+0000 7f8cd6309640 1 -- 172.21.15.86:0/3561493260 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f8cd00cb550 con 0x7f8cd00ca140 2024-04-25T12:22:27.020 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.018+0000 7f8cccff9640 1 -- 172.21.15.86:0/3561493260 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f8cc4057270 con 0x7f8cd00ca140 2024-04-25T12:22:27.021 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 32 2024-04-25T12:22:27.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.018+0000 7f8cd6309640 1 -- 172.21.15.86:0/3561493260 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f8cbc068380 msgr2=0x7f8cbc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:27.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.018+0000 7f8cd6309640 1 --2- 172.21.15.86:0/3561493260 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f8cbc068380 0x7f8cbc06a840 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8cc00ae000 tx=0x7f8cc00a7070 comp rx=0 tx=0).stop 2024-04-25T12:22:27.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.018+0000 7f8cd6309640 1 -- 172.21.15.86:0/3561493260 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8cd00ca140 msgr2=0x7f8cd015a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:27.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.018+0000 7f8cd6309640 1 --2- 172.21.15.86:0/3561493260 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8cd00ca140 0x7f8cd015a920 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8cc400d7d0 tx=0x7f8cc400dc90 comp rx=0 tx=0).stop 2024-04-25T12:22:27.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.018+0000 7f8cd6309640 1 -- 172.21.15.86:0/3561493260 shutdown_connections 2024-04-25T12:22:27.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.018+0000 7f8cd6309640 1 --2- 172.21.15.86:0/3561493260 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8cd0144370 0x7f8cd013adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:27.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.018+0000 7f8cd6309640 1 --2- 172.21.15.86:0/3561493260 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f8cbc068380 0x7f8cbc06a840 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:27.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.018+0000 7f8cd6309640 1 --2- 172.21.15.86:0/3561493260 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8cd00ca140 0x7f8cd015a920 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:27.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.018+0000 7f8cd6309640 1 --2- 172.21.15.86:0/3561493260 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8cd0073200 0x7f8cd01f74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:27.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.018+0000 7f8cd6309640 1 -- 172.21.15.86:0/3561493260 >> 172.21.15.86:0/3561493260 conn(0x7f8cd006e070 msgr2=0x7f8cd00c85f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:27.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.018+0000 7f8cd6309640 1 -- 172.21.15.86:0/3561493260 shutdown_connections 2024-04-25T12:22:27.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.018+0000 7f8cd6309640 1 -- 172.21.15.86:0/3561493260 wait complete. 2024-04-25T12:22:27.039 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T12:22:27.159 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.158+0000 7f981c7bd640 1 Processor -- start 2024-04-25T12:22:27.160 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.158+0000 7f981c7bd640 1 -- start start 2024-04-25T12:22:27.161 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.158+0000 7f981c7bd640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f98140c8630 0x7f9814151b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:27.161 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.158+0000 7f981c7bd640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f98140c8a70 0x7f9814152080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:27.161 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.158+0000 7f981c7bd640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f981415b740 con 0x7f98140c8250 2024-04-25T12:22:27.161 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.158+0000 7f981c7bd640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f98140c6490 con 0x7f98140c8a70 2024-04-25T12:22:27.162 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.158+0000 7f981c7bd640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f98141525c0 con 0x7f98140c8630 2024-04-25T12:22:27.162 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.158+0000 7f981ad5a640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f98140c8a70 0x7f9814152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:27.162 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.158+0000 7f981a559640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f98140c8250 0x7f98140c39e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:41580/0 (socket says 172.21.15.86:41580) 2024-04-25T12:22:27.162 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.158+0000 7f981a559640 1 -- 172.21.15.86:0/3068649455 learned_addr learned my addr 172.21.15.86:0/3068649455 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-04-25T12:22:27.162 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.158+0000 7f9819d58640 1 --2- 172.21.15.86:0/3068649455 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f98140c8630 0x7f9814151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:27.162 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.158+0000 7f981ad5a640 1 -- 172.21.15.86:0/3068649455 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f98140c8630 msgr2=0x7f9814151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:27.162 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.158+0000 7f981ad5a640 1 --2- 172.21.15.86:0/3068649455 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f98140c8630 0x7f9814151b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:27.162 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.158+0000 7f9819557640 1 -- 172.21.15.86:0/3068649455 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3758563623 0 0) 0x7f981415b740 con 0x7f98140c8250 2024-04-25T12:22:27.163 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.158+0000 7f981ad5a640 1 -- 172.21.15.86:0/3068649455 >> v1:172.21.15.86:6789/0 conn(0x7f98140c8250 legacy=0x7f98140c39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:27.163 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.158+0000 7f981ad5a640 1 -- 172.21.15.86:0/3068649455 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98140c40f0 con 0x7f98140c8a70 2024-04-25T12:22:27.163 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.158+0000 7f9819d58640 1 --2- 172.21.15.86:0/3068649455 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f98140c8630 0x7f9814151b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:22:27.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.162+0000 7f981ad5a640 1 --2- 172.21.15.86:0/3068649455 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98140c8a70 0x7f9814152080 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f980c009dc0 tx=0x7f980c01c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e2d0ed967a150a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:27.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.162+0000 7f9819557640 1 -- 172.21.15.86:0/3068649455 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f980c0b2070 con 0x7f98140c8a70 2024-04-25T12:22:27.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.162+0000 7f9819557640 1 -- 172.21.15.86:0/3068649455 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f980c0a5780 con 0x7f98140c8a70 2024-04-25T12:22:27.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.162+0000 7f9819557640 1 -- 172.21.15.86:0/3068649455 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f980c0a5b50 con 0x7f98140c8a70 2024-04-25T12:22:27.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.162+0000 7f981c7bd640 1 -- 172.21.15.86:0/3068649455 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98140c8a70 msgr2=0x7f9814152080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:27.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.162+0000 7f981c7bd640 1 --2- 172.21.15.86:0/3068649455 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98140c8a70 0x7f9814152080 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f980c009dc0 tx=0x7f980c01c8c0 comp rx=0 tx=0).stop 2024-04-25T12:22:27.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.162+0000 7f981c7bd640 1 -- 172.21.15.86:0/3068649455 shutdown_connections 2024-04-25T12:22:27.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.162+0000 7f981c7bd640 1 --2- 172.21.15.86:0/3068649455 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98140c8a70 0x7f9814152080 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:27.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.162+0000 7f981c7bd640 1 --2- 172.21.15.86:0/3068649455 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f98140c8630 0x7f9814151b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:27.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.162+0000 7f981c7bd640 1 -- 172.21.15.86:0/3068649455 >> 172.21.15.86:0/3068649455 conn(0x7f981406b9d0 msgr2=0x7f981406bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:27.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.162+0000 7f981c7bd640 1 -- 172.21.15.86:0/3068649455 shutdown_connections 2024-04-25T12:22:27.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.162+0000 7f981c7bd640 1 -- 172.21.15.86:0/3068649455 wait complete. 2024-04-25T12:22:27.167 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.162+0000 7f981c7bd640 1 Processor -- start 2024-04-25T12:22:27.167 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.162+0000 7f981c7bd640 1 -- start start 2024-04-25T12:22:27.167 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.162+0000 7f981c7bd640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f98140c8250 0x7f9814143ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:27.167 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.162+0000 7f981c7bd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98140c8630 0x7f98141f4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:27.168 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.162+0000 7f981c7bd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98140c8a70 0x7f98141605c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:27.168 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.162+0000 7f981c7bd640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f981415b400 con 0x7f98140c8630 2024-04-25T12:22:27.168 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.162+0000 7f981c7bd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f98140721a0 con 0x7f98140c8a70 2024-04-25T12:22:27.168 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.162+0000 7f981c7bd640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f98140c6920 con 0x7f98140c8250 2024-04-25T12:22:27.168 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.162+0000 7f9819d58640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98140c8630 0x7f98141f4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:27.168 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.162+0000 7f9819d58640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98140c8630 0x7f98141f4990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51202/0 (socket says 172.21.15.86:51202) 2024-04-25T12:22:27.168 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.162+0000 7f9819d58640 1 -- 172.21.15.86:0/271585446 learned_addr learned my addr 172.21.15.86:0/271585446 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:27.168 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.162+0000 7f9819d58640 1 -- 172.21.15.86:0/271585446 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f98140c8250 msgr2=0x7f9814143ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:27.169 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.162+0000 7f9819d58640 1 --2- 172.21.15.86:0/271585446 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f98140c8250 0x7f9814143ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:27.169 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.162+0000 7f9819d58640 1 -- 172.21.15.86:0/271585446 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98140c8a70 msgr2=0x7f98141605c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:27.169 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.162+0000 7f9819d58640 1 --2- 172.21.15.86:0/271585446 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98140c8a70 0x7f98141605c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:27.169 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.162+0000 7f9819d58640 1 -- 172.21.15.86:0/271585446 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98141f3ed0 con 0x7f98140c8630 2024-04-25T12:22:27.169 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.162+0000 7f9819d58640 1 --2- 172.21.15.86:0/271585446 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98140c8630 0x7f98141f4990 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f981000c7c0 tx=0x7f981000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:27.169 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.162+0000 7f980affd640 1 -- 172.21.15.86:0/271585446 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9810007a30 con 0x7f98140c8630 2024-04-25T12:22:27.169 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.162+0000 7f980affd640 1 -- 172.21.15.86:0/271585446 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9810007bd0 con 0x7f98140c8630 2024-04-25T12:22:27.169 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.162+0000 7f981c7bd640 1 -- 172.21.15.86:0/271585446 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9814160f00 con 0x7f98140c8630 2024-04-25T12:22:27.169 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.162+0000 7f980affd640 1 -- 172.21.15.86:0/271585446 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98100113f0 con 0x7f98140c8630 2024-04-25T12:22:27.169 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.162+0000 7f981c7bd640 1 -- 172.21.15.86:0/271585446 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98141f4190 con 0x7f98140c8630 2024-04-25T12:22:27.170 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.166+0000 7f981c7bd640 1 -- 172.21.15.86:0/271585446 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9814075df0 con 0x7f98140c8630 2024-04-25T12:22:27.170 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.166+0000 7f980affd640 1 -- 172.21.15.86:0/271585446 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9810011590 con 0x7f98140c8630 2024-04-25T12:22:27.170 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.166+0000 7f980affd640 1 --2- 172.21.15.86:0/271585446 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f97f8068380 0x7f97f806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:27.171 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.166+0000 7f980affd640 1 -- 172.21.15.86:0/271585446 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f9810086f60 con 0x7f98140c8630 2024-04-25T12:22:27.171 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.166+0000 7f981a559640 1 --2- 172.21.15.86:0/271585446 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f97f8068380 0x7f97f806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:27.171 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.166+0000 7f981a559640 1 --2- 172.21.15.86:0/271585446 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f97f8068380 0x7f97f806a840 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f98040011f0 tx=0x7f9804007930 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:27.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.170+0000 7f980affd640 1 -- 172.21.15.86:0/271585446 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9810015020 con 0x7f98140c8630 2024-04-25T12:22:27.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.330+0000 7f981c7bd640 1 -- 172.21.15.86:0/271585446 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f9814142090 con 0x7f98140c8630 2024-04-25T12:22:27.333 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.330+0000 7f980affd640 1 -- 172.21.15.86:0/271585446 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f98100571b0 con 0x7f98140c8630 2024-04-25T12:22:27.333 INFO:teuthology.orchestra.run.smithi086.stderr:listed 0 entries 2024-04-25T12:22:27.335 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.330+0000 7f981c7bd640 1 -- 172.21.15.86:0/271585446 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f97f8068380 msgr2=0x7f97f806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:27.335 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.330+0000 7f981c7bd640 1 --2- 172.21.15.86:0/271585446 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f97f8068380 0x7f97f806a840 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f98040011f0 tx=0x7f9804007930 comp rx=0 tx=0).stop 2024-04-25T12:22:27.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.330+0000 7f981c7bd640 1 -- 172.21.15.86:0/271585446 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98140c8630 msgr2=0x7f98141f4990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:27.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.330+0000 7f981c7bd640 1 --2- 172.21.15.86:0/271585446 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98140c8630 0x7f98141f4990 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f981000c7c0 tx=0x7f981000cc80 comp rx=0 tx=0).stop 2024-04-25T12:22:27.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.330+0000 7f981c7bd640 1 -- 172.21.15.86:0/271585446 shutdown_connections 2024-04-25T12:22:27.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.330+0000 7f981c7bd640 1 --2- 172.21.15.86:0/271585446 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98140c8a70 0x7f98141605c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:27.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.330+0000 7f981c7bd640 1 --2- 172.21.15.86:0/271585446 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f97f8068380 0x7f97f806a840 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:27.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.330+0000 7f981c7bd640 1 --2- 172.21.15.86:0/271585446 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98140c8630 0x7f98141f4990 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:27.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.330+0000 7f981c7bd640 1 --2- 172.21.15.86:0/271585446 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f98140c8250 0x7f9814143ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:27.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.330+0000 7f981c7bd640 1 -- 172.21.15.86:0/271585446 >> 172.21.15.86:0/271585446 conn(0x7f981406b9d0 msgr2=0x7f98140c4ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:27.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.334+0000 7f981c7bd640 1 -- 172.21.15.86:0/271585446 shutdown_connections 2024-04-25T12:22:27.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.334+0000 7f981c7bd640 1 -- 172.21.15.86:0/271585446 wait complete. 2024-04-25T12:22:27.350 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-04-25T12:22:27.350 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T12:22:27.356 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T12:22:27.518 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.514+0000 7f37ea8ec640 1 Processor -- start 2024-04-25T12:22:27.519 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.514+0000 7f37ea8ec640 1 -- start start 2024-04-25T12:22:27.520 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.518+0000 7f37ea8ec640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f37e414fbc0 0x7f37e406f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:27.521 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.518+0000 7f37ea8ec640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f37e414ffa0 0x7f37e40c8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:27.521 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.518+0000 7f37ea8ec640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f37e4074100 0x7f37e40c8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:27.521 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.518+0000 7f37ea8ec640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f37e40c5d70 con 0x7f37e414ffa0 2024-04-25T12:22:27.521 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.518+0000 7f37ea8ec640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f37e40c6050 con 0x7f37e4074100 2024-04-25T12:22:27.521 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.518+0000 7f37ea8ec640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f37e40c6330 con 0x7f37e414fbc0 2024-04-25T12:22:27.521 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.518+0000 7f37e37fe640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f37e414ffa0 0x7f37e40c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:27.521 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.518+0000 7f37e37fe640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f37e414ffa0 0x7f37e40c8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51206/0 (socket says 172.21.15.86:51206) 2024-04-25T12:22:27.521 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.518+0000 7f37e37fe640 1 -- 172.21.15.86:0/1945227223 learned_addr learned my addr 172.21.15.86:0/1945227223 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:27.522 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.518+0000 7f37e3fff640 1 --2- 172.21.15.86:0/1945227223 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f37e414fbc0 0x7f37e406f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:27.522 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.518+0000 7f37e8e89640 1 --2- 172.21.15.86:0/1945227223 >> v2:172.21.15.134:3300/0 conn(0x7f37e4074100 0x7f37e40c8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:27.522 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.518+0000 7f37e37fe640 1 -- 172.21.15.86:0/1945227223 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f37e414fbc0 msgr2=0x7f37e406f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:27.522 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.518+0000 7f37e37fe640 1 --2- 172.21.15.86:0/1945227223 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f37e414fbc0 0x7f37e406f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:27.522 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.518+0000 7f37e37fe640 1 -- 172.21.15.86:0/1945227223 >> v2:172.21.15.134:3300/0 conn(0x7f37e4074100 msgr2=0x7f37e40c8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:27.522 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.518+0000 7f37e37fe640 1 --2- 172.21.15.86:0/1945227223 >> v2:172.21.15.134:3300/0 conn(0x7f37e4074100 0x7f37e40c8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:27.522 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.518+0000 7f37e37fe640 1 -- 172.21.15.86:0/1945227223 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37e40c6610 con 0x7f37e414ffa0 2024-04-25T12:22:27.522 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.518+0000 7f37e3fff640 1 --2- 172.21.15.86:0/1945227223 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f37e414fbc0 0x7f37e406f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:22:27.523 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.522+0000 7f37e37fe640 1 --2- 172.21.15.86:0/1945227223 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37e414ffa0 0x7f37e40c8220 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f37e40744e0 tx=0x7f37d801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8109f10f6371c08 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:27.523 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.522+0000 7f37e2ffd640 1 -- 172.21.15.86:0/1945227223 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d80aa660 con 0x7f37e414ffa0 2024-04-25T12:22:27.523 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.522+0000 7f37e2ffd640 1 -- 172.21.15.86:0/1945227223 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37d80af070 con 0x7f37e414ffa0 2024-04-25T12:22:27.523 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.522+0000 7f37e2ffd640 1 -- 172.21.15.86:0/1945227223 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d80aaa20 con 0x7f37e414ffa0 2024-04-25T12:22:27.524 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.522+0000 7f37ea8ec640 1 -- 172.21.15.86:0/1945227223 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37e414ffa0 msgr2=0x7f37e40c8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:27.524 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.522+0000 7f37ea8ec640 1 --2- 172.21.15.86:0/1945227223 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37e414ffa0 0x7f37e40c8220 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f37e40744e0 tx=0x7f37d801c520 comp rx=0 tx=0).stop 2024-04-25T12:22:27.524 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.522+0000 7f37ea8ec640 1 -- 172.21.15.86:0/1945227223 shutdown_connections 2024-04-25T12:22:27.524 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.522+0000 7f37ea8ec640 1 --2- 172.21.15.86:0/1945227223 >> v2:172.21.15.134:3300/0 conn(0x7f37e4074100 0x7f37e40c8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:27.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.522+0000 7f37ea8ec640 1 --2- 172.21.15.86:0/1945227223 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37e414ffa0 0x7f37e40c8220 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:27.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.522+0000 7f37ea8ec640 1 --2- 172.21.15.86:0/1945227223 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f37e414fbc0 0x7f37e406f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:27.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.522+0000 7f37ea8ec640 1 -- 172.21.15.86:0/1945227223 >> 172.21.15.86:0/1945227223 conn(0x7f37e406b9d0 msgr2=0x7f37e406bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:27.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.522+0000 7f37ea8ec640 1 -- 172.21.15.86:0/1945227223 shutdown_connections 2024-04-25T12:22:27.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.522+0000 7f37ea8ec640 1 -- 172.21.15.86:0/1945227223 wait complete. 2024-04-25T12:22:27.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.522+0000 7f37ea8ec640 1 Processor -- start 2024-04-25T12:22:27.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.522+0000 7f37ea8ec640 1 -- start start 2024-04-25T12:22:27.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.522+0000 7f37ea8ec640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f37e4074100 0x7f37e4151270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:27.528 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.522+0000 7f37ea8ec640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37e414fbc0 0x7f37e415a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:27.528 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.522+0000 7f37ea8ec640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37e414ffa0 0x7f37e41f4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:27.528 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.522+0000 7f37ea8ec640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f37e41592e0 con 0x7f37e414fbc0 2024-04-25T12:22:27.528 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.522+0000 7f37ea8ec640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f37e4159160 con 0x7f37e414ffa0 2024-04-25T12:22:27.528 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.522+0000 7f37ea8ec640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f37e4159460 con 0x7f37e4074100 2024-04-25T12:22:27.528 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.522+0000 7f37e37fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37e414fbc0 0x7f37e415a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:27.528 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.522+0000 7f37e37fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37e414fbc0 0x7f37e415a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51220/0 (socket says 172.21.15.86:51220) 2024-04-25T12:22:27.528 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.522+0000 7f37e37fe640 1 -- 172.21.15.86:0/667113189 learned_addr learned my addr 172.21.15.86:0/667113189 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:27.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.522+0000 7f37e3fff640 1 --2- 172.21.15.86:0/667113189 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f37e4074100 0x7f37e4151270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:27.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.522+0000 7f37e8e89640 1 --2- 172.21.15.86:0/667113189 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37e414ffa0 0x7f37e41f4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:27.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.522+0000 7f37e37fe640 1 -- 172.21.15.86:0/667113189 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f37e4074100 msgr2=0x7f37e4151270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:27.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.522+0000 7f37e37fe640 1 --2- 172.21.15.86:0/667113189 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f37e4074100 0x7f37e4151270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:27.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.522+0000 7f37e37fe640 1 -- 172.21.15.86:0/667113189 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37e414ffa0 msgr2=0x7f37e41f4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:27.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.522+0000 7f37e37fe640 1 --2- 172.21.15.86:0/667113189 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37e414ffa0 0x7f37e41f4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:27.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.522+0000 7f37e37fe640 1 -- 172.21.15.86:0/667113189 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37e406e880 con 0x7f37e414fbc0 2024-04-25T12:22:27.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.522+0000 7f37e8e89640 1 --2- 172.21.15.86:0/667113189 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37e414ffa0 0x7f37e41f4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:22:27.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.522+0000 7f37e37fe640 1 --2- 172.21.15.86:0/667113189 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37e414fbc0 0x7f37e415a310 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f37d80ac040 tx=0x7f37d801ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:27.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.522+0000 7f37e0ff9640 1 -- 172.21.15.86:0/667113189 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d80aadb0 con 0x7f37e414fbc0 2024-04-25T12:22:27.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.526+0000 7f37e0ff9640 1 -- 172.21.15.86:0/667113189 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37d80bd3f0 con 0x7f37e414fbc0 2024-04-25T12:22:27.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.526+0000 7f37ea8ec640 1 -- 172.21.15.86:0/667113189 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37e406eb60 con 0x7f37e414fbc0 2024-04-25T12:22:27.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.526+0000 7f37e0ff9640 1 -- 172.21.15.86:0/667113189 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d80bd7e0 con 0x7f37e414fbc0 2024-04-25T12:22:27.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.526+0000 7f37ea8ec640 1 -- 172.21.15.86:0/667113189 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37e414b1f0 con 0x7f37e414fbc0 2024-04-25T12:22:27.531 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.526+0000 7f37ea8ec640 1 -- 172.21.15.86:0/667113189 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37e4075df0 con 0x7f37e414fbc0 2024-04-25T12:22:27.531 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.526+0000 7f37e0ff9640 1 -- 172.21.15.86:0/667113189 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f37d80b33f0 con 0x7f37e414fbc0 2024-04-25T12:22:27.531 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.526+0000 7f37e0ff9640 1 --2- 172.21.15.86:0/667113189 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f37d0068380 0x7f37d006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:27.531 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.526+0000 7f37e0ff9640 1 -- 172.21.15.86:0/667113189 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f37d8120d30 con 0x7f37e414fbc0 2024-04-25T12:22:27.531 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.526+0000 7f37e3fff640 1 --2- 172.21.15.86:0/667113189 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f37d0068380 0x7f37d006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:27.531 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.526+0000 7f37e3fff640 1 --2- 172.21.15.86:0/667113189 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f37d0068380 0x7f37d006a840 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f37d400c900 tx=0x7f37d4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:27.533 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.530+0000 7f37e0ff9640 1 -- 172.21.15.86:0/667113189 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f37d80c3060 con 0x7f37e414fbc0 2024-04-25T12:22:27.698 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.694+0000 7f37ea8ec640 1 -- 172.21.15.86:0/667113189 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f37e41f3a80 con 0x7f37e414fbc0 2024-04-25T12:22:27.700 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.698+0000 7f37e0ff9640 1 -- 172.21.15.86:0/667113189 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18905 (secure 0 0 0) 0x7f37d8016110 con 0x7f37e414fbc0 2024-04-25T12:22:27.700 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:22:27.701 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":26,"fsid":"f2ef5c0c-9576-4650-b4f7-6cb14247f62a","created":"2024-04-25T12:20:59.241733+0000","modified":"2024-04-25T12:22:04.877793+0000","last_up_change":"2024-04-25T12:21:10.939617+0000","last_in_change":"2024-04-25T12:21:01.534145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T12:21:11.839922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T12:21:21.854040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T12:21:22.406060+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T12:21:26.152386+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1f713f00-ef9f-4a6f-a620-38a8a1f8a822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6801","nonce":2812764579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6803","nonce":2812764579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6807","nonce":2812764579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6805","nonce":2812764579}]},"public_addr":"172.21.15.86:6801/2812764579","cluster_addr":"172.21.15.86:6803/2812764579","heartbeat_back_addr":"172.21.15.86:6807/2812764579","heartbeat_front_addr":"172.21.15.86:6805/2812764579","state":["exists","up"]},{"osd":1,"uuid":"baf6606d-a556-4fbe-a930-855e04ff1534","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6809","nonce":467966038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6811","nonce":467966038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6815","nonce":467966038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6813","nonce":467966038}]},"public_addr":"172.21.15.86:6809/467966038","cluster_addr":"172.21.15.86:6811/467966038","heartbeat_back_addr":"172.21.15.86:6815/467966038","heartbeat_front_addr":"172.21.15.86:6813/467966038","state":["exists","up"]},{"osd":2,"uuid":"c983d68e-6d60-434f-aed6-108420c5dd09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6817","nonce":3279762843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6820","nonce":3279762843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6825","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6827","nonce":3279762843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6824","nonce":3279762843}]},"public_addr":"172.21.15.86:6817/3279762843","cluster_addr":"172.21.15.86:6820/3279762843","heartbeat_back_addr":"172.21.15.86:6827/3279762843","heartbeat_front_addr":"172.21.15.86:6824/3279762843","state":["exists","up"]},{"osd":3,"uuid":"e77657bb-45aa-43bf-ab41-c7377eb495ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6821","nonce":2861354413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6826","nonce":2861354413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6831","nonce":2861354413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6829","nonce":2861354413}]},"public_addr":"172.21.15.86:6821/2861354413","cluster_addr":"172.21.15.86:6826/2861354413","heartbeat_back_addr":"172.21.15.86:6831/2861354413","heartbeat_front_addr":"172.21.15.86:6829/2861354413","state":["exists","up"]},{"osd":4,"uuid":"252bd300-d75a-4b00-be4b-27e6b51de4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6802","nonce":1872913602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6805","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6808","nonce":1872913602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6815","nonce":1872913602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6813","nonce":1872913602}]},"public_addr":"172.21.15.134:6802/1872913602","cluster_addr":"172.21.15.134:6808/1872913602","heartbeat_back_addr":"172.21.15.134:6815/1872913602","heartbeat_front_addr":"172.21.15.134:6813/1872913602","state":["exists","up"]},{"osd":5,"uuid":"4135da3f-7427-4409-a48e-78bd8a7b46ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6801","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6803","nonce":2261413981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6806","nonce":2261413981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6812","nonce":2261413981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6809","nonce":2261413981}]},"public_addr":"172.21.15.134:6803/2261413981","cluster_addr":"172.21.15.134:6806/2261413981","heartbeat_back_addr":"172.21.15.134:6812/2261413981","heartbeat_front_addr":"172.21.15.134:6809/2261413981","state":["exists","up"]},{"osd":6,"uuid":"b6e7a5f1-fa7e-497d-abac-a19994d26820","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6825","nonce":2841082767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6827","nonce":2841082767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6831","nonce":2841082767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6829","nonce":2841082767}]},"public_addr":"172.21.15.134:6825/2841082767","cluster_addr":"172.21.15.134:6827/2841082767","heartbeat_back_addr":"172.21.15.134:6831/2841082767","heartbeat_front_addr":"172.21.15.134:6829/2841082767","state":["exists","up"]},{"osd":7,"uuid":"c5597e50-1962-4103-9124-dd7bceb8ac97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6817","nonce":1277404274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6819","nonce":1277404274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6823","nonce":1277404274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6821","nonce":1277404274}]},"public_addr":"172.21.15.134:6817/1277404274","cluster_addr":"172.21.15.134:6819/1277404274","heartbeat_back_addr":"172.21.15.134:6823/1277404274","heartbeat_front_addr":"172.21.15.134:6821/1277404274","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.018125+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.157958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.113619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.136904+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.844514+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.872629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.775339+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.822867+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":7,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.33","mappings":[{"from":3,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T12:22:27.702 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.698+0000 7f37ea8ec640 1 -- 172.21.15.86:0/667113189 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f37d0068380 msgr2=0x7f37d006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:27.702 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.698+0000 7f37ea8ec640 1 --2- 172.21.15.86:0/667113189 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f37d0068380 0x7f37d006a840 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f37d400c900 tx=0x7f37d4008040 comp rx=0 tx=0).stop 2024-04-25T12:22:27.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.698+0000 7f37ea8ec640 1 -- 172.21.15.86:0/667113189 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37e414fbc0 msgr2=0x7f37e415a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:27.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.698+0000 7f37ea8ec640 1 --2- 172.21.15.86:0/667113189 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37e414fbc0 0x7f37e415a310 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f37d80ac040 tx=0x7f37d801ad60 comp rx=0 tx=0).stop 2024-04-25T12:22:27.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.698+0000 7f37ea8ec640 1 -- 172.21.15.86:0/667113189 shutdown_connections 2024-04-25T12:22:27.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.698+0000 7f37ea8ec640 1 --2- 172.21.15.86:0/667113189 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37e414ffa0 0x7f37e41f4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:27.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.698+0000 7f37ea8ec640 1 --2- 172.21.15.86:0/667113189 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f37d0068380 0x7f37d006a840 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:27.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.698+0000 7f37ea8ec640 1 --2- 172.21.15.86:0/667113189 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37e414fbc0 0x7f37e415a310 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:27.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.698+0000 7f37ea8ec640 1 --2- 172.21.15.86:0/667113189 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f37e4074100 0x7f37e4151270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:27.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.698+0000 7f37ea8ec640 1 -- 172.21.15.86:0/667113189 >> 172.21.15.86:0/667113189 conn(0x7f37e406b9d0 msgr2=0x7f37e406c410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:27.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.698+0000 7f37ea8ec640 1 -- 172.21.15.86:0/667113189 shutdown_connections 2024-04-25T12:22:27.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.698+0000 7f37ea8ec640 1 -- 172.21.15.86:0/667113189 wait complete. 2024-04-25T12:22:27.719 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T12:21:11.839922+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T12:21:21.854040+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T12:21:22.406060+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T12:21:26.152386+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T12:22:27.720 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T12:22:27.839 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.834+0000 7f85b423a640 1 Processor -- start 2024-04-25T12:22:27.839 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.834+0000 7f85b423a640 1 -- start start 2024-04-25T12:22:27.840 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.838+0000 7f85b423a640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f85ac074100 0x7f85ac06f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:27.840 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.838+0000 7f85b423a640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85ac0c5d70 con 0x7f85ac14ffa0 2024-04-25T12:22:27.840 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.838+0000 7f85b423a640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85ac0c6050 con 0x7f85ac14fbc0 2024-04-25T12:22:27.840 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.838+0000 7f85b423a640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f85ac0c6330 con 0x7f85ac074100 2024-04-25T12:22:27.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.838+0000 7f85b17d5640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f85ac14ffa0 0x7f85ac0c7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:41584/0 (socket says 172.21.15.86:41584) 2024-04-25T12:22:27.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.838+0000 7f85b17d5640 1 -- 172.21.15.86:0/218842387 learned_addr learned my addr 172.21.15.86:0/218842387 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-04-25T12:22:27.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.838+0000 7f85b27d7640 1 --2- 172.21.15.86:0/218842387 >> v2:172.21.15.86:3300/0 conn(0x7f85ac074100 0x7f85ac06f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:27.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.838+0000 7f85b0fd4640 1 -- 172.21.15.86:0/218842387 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3623185019 0 0) 0x7f85ac0c5d70 con 0x7f85ac14ffa0 2024-04-25T12:22:27.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.838+0000 7f85b0fd4640 1 -- 172.21.15.86:0/218842387 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8598003530 con 0x7f85ac14ffa0 2024-04-25T12:22:27.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.838+0000 7f85b27d7640 1 -- 172.21.15.86:0/218842387 >> v1:172.21.15.134:6789/0 conn(0x7f85ac14fbc0 legacy=0x7f85ac0c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:27.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.838+0000 7f85b27d7640 1 -- 172.21.15.86:0/218842387 >> v1:172.21.15.86:6789/0 conn(0x7f85ac14ffa0 legacy=0x7f85ac0c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:27.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.838+0000 7f85b27d7640 1 -- 172.21.15.86:0/218842387 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85ac0c6610 con 0x7f85ac074100 2024-04-25T12:22:27.843 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.842+0000 7f85b27d7640 1 --2- 172.21.15.86:0/218842387 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85ac074100 0x7f85ac06f700 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f85a4009dc0 tx=0x7f85a401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2265fb0a20f15579 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:27.844 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.842+0000 7f85b0fd4640 1 -- 172.21.15.86:0/218842387 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a40b2070 con 0x7f85ac074100 2024-04-25T12:22:27.844 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.842+0000 7f85b0fd4640 1 -- 172.21.15.86:0/218842387 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85a40a5a30 con 0x7f85ac074100 2024-04-25T12:22:27.844 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.842+0000 7f85b0fd4640 1 -- 172.21.15.86:0/218842387 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a40a5e00 con 0x7f85ac074100 2024-04-25T12:22:27.845 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.842+0000 7f85b423a640 1 -- 172.21.15.86:0/218842387 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85ac074100 msgr2=0x7f85ac06f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:27.845 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.842+0000 7f85b423a640 1 --2- 172.21.15.86:0/218842387 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85ac074100 0x7f85ac06f700 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f85a4009dc0 tx=0x7f85a401c950 comp rx=0 tx=0).stop 2024-04-25T12:22:27.845 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.842+0000 7f85b423a640 1 -- 172.21.15.86:0/218842387 shutdown_connections 2024-04-25T12:22:27.845 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.842+0000 7f85b423a640 1 --2- 172.21.15.86:0/218842387 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85ac074100 0x7f85ac06f700 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:27.845 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.842+0000 7f85b423a640 1 -- 172.21.15.86:0/218842387 >> 172.21.15.86:0/218842387 conn(0x7f85ac06b9d0 msgr2=0x7f85ac06bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:27.845 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.842+0000 7f85b423a640 1 -- 172.21.15.86:0/218842387 shutdown_connections 2024-04-25T12:22:27.845 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.842+0000 7f85b423a640 1 -- 172.21.15.86:0/218842387 wait complete. 2024-04-25T12:22:27.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.842+0000 7f85b423a640 1 Processor -- start 2024-04-25T12:22:27.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.842+0000 7f85b423a640 1 -- start start 2024-04-25T12:22:27.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.842+0000 7f85b423a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85ac074100 0x7f85ac152d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:27.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.842+0000 7f85b423a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85ac14fbc0 0x7f85ac14bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:27.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.842+0000 7f85b423a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f85ac14ffa0 0x7f85ac14c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:27.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.842+0000 7f85b423a640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f85ac167630 con 0x7f85ac074100 2024-04-25T12:22:27.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.842+0000 7f85b423a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f85ac1674b0 con 0x7f85ac14fbc0 2024-04-25T12:22:27.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.842+0000 7f85b423a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f85ac1677b0 con 0x7f85ac14ffa0 2024-04-25T12:22:27.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.842+0000 7f85b1fd6640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85ac074100 0x7f85ac152d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:27.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.846+0000 7f85b1fd6640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85ac074100 0x7f85ac152d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51242/0 (socket says 172.21.15.86:51242) 2024-04-25T12:22:27.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.846+0000 7f85b1fd6640 1 -- 172.21.15.86:0/53044425 learned_addr learned my addr 172.21.15.86:0/53044425 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:27.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.846+0000 7f85b27d7640 1 --2- 172.21.15.86:0/53044425 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f85ac14ffa0 0x7f85ac14c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:27.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.846+0000 7f85b1fd6640 1 -- 172.21.15.86:0/53044425 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f85ac14ffa0 msgr2=0x7f85ac14c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:27.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.846+0000 7f85b1fd6640 1 --2- 172.21.15.86:0/53044425 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f85ac14ffa0 0x7f85ac14c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:27.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.846+0000 7f85b1fd6640 1 -- 172.21.15.86:0/53044425 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85ac14fbc0 msgr2=0x7f85ac14bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:27.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.846+0000 7f85b1fd6640 1 --2- 172.21.15.86:0/53044425 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85ac14fbc0 0x7f85ac14bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:27.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.846+0000 7f85b1fd6640 1 -- 172.21.15.86:0/53044425 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85ac14b7b0 con 0x7f85ac074100 2024-04-25T12:22:27.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.846+0000 7f85b1fd6640 1 --2- 172.21.15.86:0/53044425 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85ac074100 0x7f85ac152d90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f85a800c420 tx=0x7f85a800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:27.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.846+0000 7f85a27fc640 1 -- 172.21.15.86:0/53044425 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a80052d0 con 0x7f85ac074100 2024-04-25T12:22:27.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.846+0000 7f85a27fc640 1 -- 172.21.15.86:0/53044425 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85a8005470 con 0x7f85ac074100 2024-04-25T12:22:27.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.846+0000 7f85b423a640 1 -- 172.21.15.86:0/53044425 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85ac1f23d0 con 0x7f85ac074100 2024-04-25T12:22:27.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.846+0000 7f85a27fc640 1 -- 172.21.15.86:0/53044425 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a8007240 con 0x7f85ac074100 2024-04-25T12:22:27.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.846+0000 7f85b423a640 1 -- 172.21.15.86:0/53044425 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85ac1f2990 con 0x7f85ac074100 2024-04-25T12:22:27.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.846+0000 7f85b423a640 1 -- 172.21.15.86:0/53044425 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85ac075df0 con 0x7f85ac074100 2024-04-25T12:22:27.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.846+0000 7f85a27fc640 1 -- 172.21.15.86:0/53044425 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f85a80073e0 con 0x7f85ac074100 2024-04-25T12:22:27.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.846+0000 7f85a27fc640 1 --2- 172.21.15.86:0/53044425 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f8590068380 0x7f859006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:27.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.846+0000 7f85b17d5640 1 --2- 172.21.15.86:0/53044425 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f8590068380 0x7f859006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:27.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.846+0000 7f85a27fc640 1 -- 172.21.15.86:0/53044425 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f85a8086350 con 0x7f85ac074100 2024-04-25T12:22:27.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.846+0000 7f85b17d5640 1 --2- 172.21.15.86:0/53044425 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f8590068380 0x7f859006a840 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f859c007fd0 tx=0x7f859c007940 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:27.854 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:27.850+0000 7f85a27fc640 1 -- 172.21.15.86:0/53044425 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f85a8056480 con 0x7f85ac074100 2024-04-25T12:22:28.016 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.014+0000 7f85b423a640 1 -- 172.21.15.86:0/53044425 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f85ac072610 con 0x7f85ac074100 2024-04-25T12:22:28.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.014+0000 7f85a27fc640 1 -- 172.21.15.86:0/53044425 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7f85a8055d80 con 0x7f85ac074100 2024-04-25T12:22:28.017 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 1 2024-04-25T12:22:28.020 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.018+0000 7f85b423a640 1 -- 172.21.15.86:0/53044425 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f8590068380 msgr2=0x7f859006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:28.020 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.018+0000 7f85b423a640 1 --2- 172.21.15.86:0/53044425 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f8590068380 0x7f859006a840 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f859c007fd0 tx=0x7f859c007940 comp rx=0 tx=0).stop 2024-04-25T12:22:28.020 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.018+0000 7f85b423a640 1 -- 172.21.15.86:0/53044425 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85ac074100 msgr2=0x7f85ac152d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:28.020 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.018+0000 7f85b423a640 1 --2- 172.21.15.86:0/53044425 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85ac074100 0x7f85ac152d90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f85a800c420 tx=0x7f85a800c8e0 comp rx=0 tx=0).stop 2024-04-25T12:22:28.020 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.018+0000 7f85b423a640 1 -- 172.21.15.86:0/53044425 shutdown_connections 2024-04-25T12:22:28.020 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.018+0000 7f85b423a640 1 --2- 172.21.15.86:0/53044425 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f85ac14ffa0 0x7f85ac14c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:28.020 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.018+0000 7f85b423a640 1 --2- 172.21.15.86:0/53044425 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85ac14fbc0 0x7f85ac14bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:28.020 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.018+0000 7f85b423a640 1 --2- 172.21.15.86:0/53044425 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f8590068380 0x7f859006a840 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:28.021 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.018+0000 7f85b423a640 1 --2- 172.21.15.86:0/53044425 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85ac074100 0x7f85ac152d90 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:28.021 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.018+0000 7f85b423a640 1 -- 172.21.15.86:0/53044425 >> 172.21.15.86:0/53044425 conn(0x7f85ac06b9d0 msgr2=0x7f85ac14ea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:28.021 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.018+0000 7f85b423a640 1 -- 172.21.15.86:0/53044425 shutdown_connections 2024-04-25T12:22:28.021 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.018+0000 7f85b423a640 1 -- 172.21.15.86:0/53044425 wait complete. 2024-04-25T12:22:28.036 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T12:22:28.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.154+0000 7f5a63de9640 1 Processor -- start 2024-04-25T12:22:28.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.154+0000 7f5a63de9640 1 -- start start 2024-04-25T12:22:28.158 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.154+0000 7f5a63de9640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5a5c0c8a70 0x7f5a5c152250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:28.158 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.154+0000 7f5a63de9640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a5c15b740 con 0x7f5a5c0c8250 2024-04-25T12:22:28.158 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.154+0000 7f5a63de9640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a5c0c40f0 con 0x7f5a5c0c8630 2024-04-25T12:22:28.158 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.154+0000 7f5a63de9640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f5a5c0c6490 con 0x7f5a5c0c8a70 2024-04-25T12:22:28.161 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.154+0000 7f5a61b85640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f5a5c0c8250 0x7f5a5c0c39e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:41600/0 (socket says 172.21.15.86:41600) 2024-04-25T12:22:28.161 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.154+0000 7f5a61b85640 1 -- 172.21.15.86:0/3541641669 learned_addr learned my addr 172.21.15.86:0/3541641669 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-04-25T12:22:28.161 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.154+0000 7f5a62386640 1 --2- 172.21.15.86:0/3541641669 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5a5c0c8a70 0x7f5a5c152250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:28.162 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.154+0000 7f5a60b83640 1 -- 172.21.15.86:0/3541641669 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3218785794 0 0) 0x7f5a5c15b740 con 0x7f5a5c0c8250 2024-04-25T12:22:28.162 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.154+0000 7f5a60b83640 1 -- 172.21.15.86:0/3541641669 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a48003530 con 0x7f5a5c0c8250 2024-04-25T12:22:28.162 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.154+0000 7f5a60b83640 1 -- 172.21.15.86:0/3541641669 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2891377109 0 0) 0x7f5a48003530 con 0x7f5a5c0c8250 2024-04-25T12:22:28.162 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.154+0000 7f5a60b83640 1 -- 172.21.15.86:0/3541641669 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5a5c0c8a70 msgr2=0x7f5a5c152250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:28.162 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.154+0000 7f5a60b83640 1 --2- 172.21.15.86:0/3541641669 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5a5c0c8a70 0x7f5a5c152250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:28.162 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.154+0000 7f5a60b83640 1 -- 172.21.15.86:0/3541641669 >> v1:172.21.15.134:6789/0 conn(0x7f5a5c0c8630 legacy=0x7f5a5c151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:28.162 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.154+0000 7f5a60b83640 1 -- 172.21.15.86:0/3541641669 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a5c0c58c0 con 0x7f5a5c0c8250 2024-04-25T12:22:28.162 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.154+0000 7f5a60b83640 1 -- 172.21.15.86:0/3541641669 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1387950573 0 0) 0x7f5a58001a00 con 0x7f5a5c0c8250 2024-04-25T12:22:28.163 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.154+0000 7f5a60b83640 1 -- 172.21.15.86:0/3541641669 >> v1:172.21.15.86:6789/0 conn(0x7f5a5c0c8250 legacy=0x7f5a5c0c39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:28.163 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.154+0000 7f5a60b83640 1 --2- 172.21.15.86:0/3541641669 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5a5c0c8a70 0x7f5a480039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:28.163 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.154+0000 7f5a60b83640 1 --2- 172.21.15.86:0/3541641669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a48003f70 0x7f5a48004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:28.163 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.154+0000 7f5a60b83640 1 --2- 172.21.15.86:0/3541641669 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a48004d50 0x7f5a480051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:28.163 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.154+0000 7f5a60b83640 1 -- 172.21.15.86:0/3541641669 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f5a5c0c6490 con 0x7f5a48004d50 2024-04-25T12:22:28.163 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.154+0000 7f5a60b83640 1 -- 172.21.15.86:0/3541641669 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5a4800bb60 con 0x7f5a48003f70 2024-04-25T12:22:28.163 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.154+0000 7f5a60b83640 1 -- 172.21.15.86:0/3541641669 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f5a4800bd60 con 0x7f5a5c0c8a70 2024-04-25T12:22:28.163 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.154+0000 7f5a62386640 1 --2- 172.21.15.86:0/3541641669 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a48004d50 0x7f5a480051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:28.163 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.154+0000 7f5a61b85640 1 --2- 172.21.15.86:0/3541641669 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5a5c0c8a70 0x7f5a480039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:28.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.154+0000 7f5a62386640 1 -- 172.21.15.86:0/3541641669 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5a5c0c8a70 msgr2=0x7f5a480039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:28.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.154+0000 7f5a61384640 1 --2- 172.21.15.86:0/3541641669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a48003f70 0x7f5a48004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:28.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.154+0000 7f5a62386640 1 --2- 172.21.15.86:0/3541641669 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5a5c0c8a70 0x7f5a480039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:28.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.154+0000 7f5a62386640 1 -- 172.21.15.86:0/3541641669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a48003f70 msgr2=0x7f5a48004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:28.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.154+0000 7f5a62386640 1 --2- 172.21.15.86:0/3541641669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a48003f70 0x7f5a48004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:28.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.154+0000 7f5a62386640 1 -- 172.21.15.86:0/3541641669 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a48003530 con 0x7f5a48004d50 2024-04-25T12:22:28.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.154+0000 7f5a61b85640 1 --2- 172.21.15.86:0/3541641669 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5a5c0c8a70 0x7f5a480039f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:22:28.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.154+0000 7f5a61384640 1 --2- 172.21.15.86:0/3541641669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a48003f70 0x7f5a48004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:22:28.168 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.158+0000 7f5a62386640 1 --2- 172.21.15.86:0/3541641669 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a48004d50 0x7f5a480051d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5a54009ae0 tx=0x7f5a5401ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f02661d10f2ac6e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:28.168 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.158+0000 7f5a60b83640 1 -- 172.21.15.86:0/3541641669 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a540b2070 con 0x7f5a48004d50 2024-04-25T12:22:28.168 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.158+0000 7f5a60b83640 1 -- 172.21.15.86:0/3541641669 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a540a5660 con 0x7f5a48004d50 2024-04-25T12:22:28.168 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.158+0000 7f5a60b83640 1 -- 172.21.15.86:0/3541641669 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a540096b0 con 0x7f5a48004d50 2024-04-25T12:22:28.168 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.158+0000 7f5a63de9640 1 -- 172.21.15.86:0/3541641669 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a48004d50 msgr2=0x7f5a480051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:28.168 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.158+0000 7f5a63de9640 1 --2- 172.21.15.86:0/3541641669 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a48004d50 0x7f5a480051d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5a54009ae0 tx=0x7f5a5401ca70 comp rx=0 tx=0).stop 2024-04-25T12:22:28.168 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.158+0000 7f5a62386640 1 -- 172.21.15.86:0/3541641669 reap_dead start 2024-04-25T12:22:28.169 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.158+0000 7f5a63de9640 1 -- 172.21.15.86:0/3541641669 shutdown_connections 2024-04-25T12:22:28.169 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.158+0000 7f5a63de9640 1 -- 172.21.15.86:0/3541641669 >> 172.21.15.86:0/3541641669 conn(0x7f5a5c06b9d0 msgr2=0x7f5a5c06bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:28.169 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.158+0000 7f5a63de9640 1 -- 172.21.15.86:0/3541641669 shutdown_connections 2024-04-25T12:22:28.169 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.158+0000 7f5a63de9640 1 -- 172.21.15.86:0/3541641669 wait complete. 2024-04-25T12:22:28.169 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.158+0000 7f5a63de9640 1 Processor -- start 2024-04-25T12:22:28.169 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.158+0000 7f5a63de9640 1 -- start start 2024-04-25T12:22:28.169 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.158+0000 7f5a63de9640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a5c153fb0 0x7f5a5c1532e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:28.169 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.158+0000 7f5a63de9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a5c154390 0x7f5a5c1f58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:28.169 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.158+0000 7f5a63de9640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5a5c146f90 0x7f5a5c147410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:28.170 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.158+0000 7f5a63de9640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f5a5c0c6120 con 0x7f5a5c153fb0 2024-04-25T12:22:28.170 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.158+0000 7f5a63de9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5a5c0c5e40 con 0x7f5a5c154390 2024-04-25T12:22:28.170 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.158+0000 7f5a63de9640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f5a5c0721a0 con 0x7f5a5c146f90 2024-04-25T12:22:28.170 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.158+0000 7f5a61b85640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a5c153fb0 0x7f5a5c1532e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:28.170 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.158+0000 7f5a61b85640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a5c153fb0 0x7f5a5c1532e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51264/0 (socket says 172.21.15.86:51264) 2024-04-25T12:22:28.170 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.158+0000 7f5a61b85640 1 -- 172.21.15.86:0/2967132927 learned_addr learned my addr 172.21.15.86:0/2967132927 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:28.170 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.158+0000 7f5a62386640 1 --2- 172.21.15.86:0/2967132927 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5a5c146f90 0x7f5a5c147410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:28.170 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.158+0000 7f5a61384640 1 --2- 172.21.15.86:0/2967132927 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a5c154390 0x7f5a5c1f58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:28.170 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.158+0000 7f5a61b85640 1 -- 172.21.15.86:0/2967132927 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5a5c146f90 msgr2=0x7f5a5c147410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:28.171 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.158+0000 7f5a61b85640 1 --2- 172.21.15.86:0/2967132927 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5a5c146f90 0x7f5a5c147410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:28.171 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.158+0000 7f5a61b85640 1 -- 172.21.15.86:0/2967132927 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a5c154390 msgr2=0x7f5a5c1f58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:28.171 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.158+0000 7f5a61b85640 1 --2- 172.21.15.86:0/2967132927 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a5c154390 0x7f5a5c1f58f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:28.171 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.158+0000 7f5a61b85640 1 -- 172.21.15.86:0/2967132927 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a5c147950 con 0x7f5a5c153fb0 2024-04-25T12:22:28.171 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.158+0000 7f5a61b85640 1 --2- 172.21.15.86:0/2967132927 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a5c153fb0 0x7f5a5c1532e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f5a58010c50 tx=0x7f5a5800e4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:28.171 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.162+0000 7f5a527fc640 1 -- 172.21.15.86:0/2967132927 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a5801b070 con 0x7f5a5c153fb0 2024-04-25T12:22:28.171 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.162+0000 7f5a527fc640 1 -- 172.21.15.86:0/2967132927 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a58011040 con 0x7f5a5c153fb0 2024-04-25T12:22:28.171 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.162+0000 7f5a63de9640 1 -- 172.21.15.86:0/2967132927 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a5c1f5e30 con 0x7f5a5c153fb0 2024-04-25T12:22:28.172 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.162+0000 7f5a527fc640 1 -- 172.21.15.86:0/2967132927 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a580143a0 con 0x7f5a5c153fb0 2024-04-25T12:22:28.172 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.162+0000 7f5a63de9640 1 -- 172.21.15.86:0/2967132927 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a5c1461d0 con 0x7f5a5c153fb0 2024-04-25T12:22:28.172 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.162+0000 7f5a63de9640 1 -- 172.21.15.86:0/2967132927 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a5c075df0 con 0x7f5a5c153fb0 2024-04-25T12:22:28.172 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.162+0000 7f5a527fc640 1 -- 172.21.15.86:0/2967132927 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5a5801e070 con 0x7f5a5c153fb0 2024-04-25T12:22:28.172 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.162+0000 7f5a527fc640 1 --2- 172.21.15.86:0/2967132927 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f5a40068380 0x7f5a4006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:28.172 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.162+0000 7f5a527fc640 1 -- 172.21.15.86:0/2967132927 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f5a580899f0 con 0x7f5a5c153fb0 2024-04-25T12:22:28.172 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.162+0000 7f5a61384640 1 --2- 172.21.15.86:0/2967132927 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f5a40068380 0x7f5a4006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:28.172 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.162+0000 7f5a61384640 1 --2- 172.21.15.86:0/2967132927 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f5a40068380 0x7f5a4006a840 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c073450 tx=0x7f5a4c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:28.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.166+0000 7f5a527fc640 1 -- 172.21.15.86:0/2967132927 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5a5c147950 con 0x7f5a5c153fb0 2024-04-25T12:22:28.333 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.330+0000 7f5a63de9640 1 -- 172.21.15.86:0/2967132927 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f5a5c071e50 con 0x7f5a5c153fb0 2024-04-25T12:22:28.333 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.330+0000 7f5a527fc640 1 -- 172.21.15.86:0/2967132927 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f5a58059bb0 con 0x7f5a5c153fb0 2024-04-25T12:22:28.334 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 32 2024-04-25T12:22:28.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.334+0000 7f5a63de9640 1 -- 172.21.15.86:0/2967132927 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f5a40068380 msgr2=0x7f5a4006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:28.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.334+0000 7f5a63de9640 1 --2- 172.21.15.86:0/2967132927 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f5a40068380 0x7f5a4006a840 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c073450 tx=0x7f5a4c009040 comp rx=0 tx=0).stop 2024-04-25T12:22:28.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.334+0000 7f5a63de9640 1 -- 172.21.15.86:0/2967132927 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a5c153fb0 msgr2=0x7f5a5c1532e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:28.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.334+0000 7f5a63de9640 1 --2- 172.21.15.86:0/2967132927 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a5c153fb0 0x7f5a5c1532e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f5a58010c50 tx=0x7f5a5800e4d0 comp rx=0 tx=0).stop 2024-04-25T12:22:28.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.334+0000 7f5a63de9640 1 -- 172.21.15.86:0/2967132927 shutdown_connections 2024-04-25T12:22:28.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.334+0000 7f5a63de9640 1 --2- 172.21.15.86:0/2967132927 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5a5c146f90 0x7f5a5c147410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:28.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.334+0000 7f5a63de9640 1 --2- 172.21.15.86:0/2967132927 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a5c154390 0x7f5a5c1f58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:28.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.334+0000 7f5a63de9640 1 --2- 172.21.15.86:0/2967132927 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f5a40068380 0x7f5a4006a840 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:28.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.334+0000 7f5a63de9640 1 --2- 172.21.15.86:0/2967132927 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a5c153fb0 0x7f5a5c1532e0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:28.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.334+0000 7f5a63de9640 1 -- 172.21.15.86:0/2967132927 >> 172.21.15.86:0/2967132927 conn(0x7f5a5c06b9d0 msgr2=0x7f5a5c0c42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:28.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.334+0000 7f5a63de9640 1 -- 172.21.15.86:0/2967132927 shutdown_connections 2024-04-25T12:22:28.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.334+0000 7f5a63de9640 1 -- 172.21.15.86:0/2967132927 wait complete. 2024-04-25T12:22:28.353 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T12:22:28.478 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.474+0000 7f928941c640 1 Processor -- start 2024-04-25T12:22:28.479 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.474+0000 7f928941c640 1 -- start start 2024-04-25T12:22:28.480 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.478+0000 7f928941c640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9284155350 0x7f92840c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:28.480 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.478+0000 7f928941c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f92840cda50 0x7f92840cb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:28.480 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.478+0000 7f928941c640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f928415beb0 con 0x7f92840cbcf0 2024-04-25T12:22:28.480 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.478+0000 7f928941c640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f92840cca40 con 0x7f9284155350 2024-04-25T12:22:28.480 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.478+0000 7f928941c640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f92840ccc90 con 0x7f92840cda50 2024-04-25T12:22:28.480 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.478+0000 7f9282ffd640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9284155350 0x7f92840c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:28.480 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.478+0000 7f9282ffd640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9284155350 0x7f92840c59c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51268/0 (socket says 172.21.15.86:51268) 2024-04-25T12:22:28.481 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.478+0000 7f9282ffd640 1 -- 172.21.15.86:0/1660755371 learned_addr learned my addr 172.21.15.86:0/1660755371 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:28.481 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.478+0000 7f92827fc640 1 --2- 172.21.15.86:0/1660755371 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f92840cda50 0x7f92840cb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:28.481 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.478+0000 7f9282ffd640 1 -- 172.21.15.86:0/1660755371 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f92840cda50 msgr2=0x7f92840cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:28.481 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.478+0000 7f9282ffd640 1 --2- 172.21.15.86:0/1660755371 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f92840cda50 0x7f92840cb7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:28.481 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.478+0000 7f9282ffd640 1 -- 172.21.15.86:0/1660755371 >> v1:172.21.15.134:6789/0 conn(0x7f92840cbcf0 legacy=0x7f928415b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:28.481 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.478+0000 7f9282ffd640 1 -- 172.21.15.86:0/1660755371 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92840ccf70 con 0x7f9284155350 2024-04-25T12:22:28.482 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.478+0000 7f9282ffd640 1 --2- 172.21.15.86:0/1660755371 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9284155350 0x7f92840c59c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f926c009870 tx=0x7f926c01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57885f45162d3954 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:28.482 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.478+0000 7f9281ffb640 1 -- 172.21.15.86:0/1660755371 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f926c0b5070 con 0x7f9284155350 2024-04-25T12:22:28.482 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.478+0000 7f9281ffb640 1 -- 172.21.15.86:0/1660755371 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f926c0a89d0 con 0x7f9284155350 2024-04-25T12:22:28.482 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.478+0000 7f9281ffb640 1 -- 172.21.15.86:0/1660755371 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f926c0a8da0 con 0x7f9284155350 2024-04-25T12:22:28.483 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.478+0000 7f928941c640 1 -- 172.21.15.86:0/1660755371 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9284155350 msgr2=0x7f92840c59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:28.483 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.478+0000 7f928941c640 1 --2- 172.21.15.86:0/1660755371 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9284155350 0x7f92840c59c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f926c009870 tx=0x7f926c01ed10 comp rx=0 tx=0).stop 2024-04-25T12:22:28.484 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.482+0000 7f928941c640 1 -- 172.21.15.86:0/1660755371 shutdown_connections 2024-04-25T12:22:28.484 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.482+0000 7f928941c640 1 --2- 172.21.15.86:0/1660755371 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f92840cda50 0x7f92840cb7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:28.484 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.482+0000 7f928941c640 1 --2- 172.21.15.86:0/1660755371 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9284155350 0x7f92840c59c0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:28.484 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.482+0000 7f928941c640 1 -- 172.21.15.86:0/1660755371 >> 172.21.15.86:0/1660755371 conn(0x7f928406cc30 msgr2=0x7f928406d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:28.484 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.482+0000 7f928941c640 1 -- 172.21.15.86:0/1660755371 shutdown_connections 2024-04-25T12:22:28.484 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.482+0000 7f928941c640 1 -- 172.21.15.86:0/1660755371 wait complete. 2024-04-25T12:22:28.486 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.482+0000 7f928941c640 1 Processor -- start 2024-04-25T12:22:28.487 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.482+0000 7f928941c640 1 -- start start 2024-04-25T12:22:28.487 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.482+0000 7f928941c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f92840cbcf0 0x7f92840c7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:28.487 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.482+0000 7f928941c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92840cda50 0x7f92841f50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:28.487 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.482+0000 7f928941c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9284155350 0x7f928415a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:28.487 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.482+0000 7f928941c640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9284155730 con 0x7f9284155350 2024-04-25T12:22:28.487 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.482+0000 7f928941c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f92840cd530 con 0x7f92840cda50 2024-04-25T12:22:28.487 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.482+0000 7f928941c640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f928415e860 con 0x7f92840cbcf0 2024-04-25T12:22:28.487 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.482+0000 7f92837fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9284155350 0x7f928415a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:28.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.482+0000 7f92837fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9284155350 0x7f928415a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51270/0 (socket says 172.21.15.86:51270) 2024-04-25T12:22:28.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.482+0000 7f92837fe640 1 -- 172.21.15.86:0/4037115498 learned_addr learned my addr 172.21.15.86:0/4037115498 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:28.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.482+0000 7f9282ffd640 1 --2- 172.21.15.86:0/4037115498 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f92840cbcf0 0x7f92840c7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:28.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.482+0000 7f92827fc640 1 --2- 172.21.15.86:0/4037115498 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92840cda50 0x7f92841f50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:28.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.482+0000 7f92837fe640 1 -- 172.21.15.86:0/4037115498 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f92840cbcf0 msgr2=0x7f92840c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:28.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.482+0000 7f92837fe640 1 --2- 172.21.15.86:0/4037115498 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f92840cbcf0 0x7f92840c7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:28.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.482+0000 7f92837fe640 1 -- 172.21.15.86:0/4037115498 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92840cda50 msgr2=0x7f92841f50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:28.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.482+0000 7f92837fe640 1 --2- 172.21.15.86:0/4037115498 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92840cda50 0x7f92841f50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:28.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.482+0000 7f92837fe640 1 -- 172.21.15.86:0/4037115498 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92840c8b60 con 0x7f9284155350 2024-04-25T12:22:28.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.482+0000 7f92827fc640 1 --2- 172.21.15.86:0/4037115498 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92840cda50 0x7f92841f50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:22:28.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.482+0000 7f92837fe640 1 --2- 172.21.15.86:0/4037115498 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9284155350 0x7f928415a8c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f927c00c780 tx=0x7f927c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:28.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.482+0000 7f927b7fe640 1 -- 172.21.15.86:0/4037115498 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f927c004b20 con 0x7f9284155350 2024-04-25T12:22:28.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.482+0000 7f927b7fe640 1 -- 172.21.15.86:0/4037115498 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f927c004cc0 con 0x7f9284155350 2024-04-25T12:22:28.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.482+0000 7f928941c640 1 -- 172.21.15.86:0/4037115498 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92841f5630 con 0x7f9284155350 2024-04-25T12:22:28.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.482+0000 7f927b7fe640 1 -- 172.21.15.86:0/4037115498 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f927c00aa90 con 0x7f9284155350 2024-04-25T12:22:28.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.482+0000 7f928941c640 1 -- 172.21.15.86:0/4037115498 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92840c85a0 con 0x7f9284155350 2024-04-25T12:22:28.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.482+0000 7f928941c640 1 -- 172.21.15.86:0/4037115498 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9284075df0 con 0x7f9284155350 2024-04-25T12:22:28.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.486+0000 7f927b7fe640 1 -- 172.21.15.86:0/4037115498 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f927c00ac30 con 0x7f9284155350 2024-04-25T12:22:28.491 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.486+0000 7f927b7fe640 1 --2- 172.21.15.86:0/4037115498 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f9264068380 0x7f926406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:28.491 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.486+0000 7f927b7fe640 1 -- 172.21.15.86:0/4037115498 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f927c086ff0 con 0x7f9284155350 2024-04-25T12:22:28.491 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.486+0000 7f9282ffd640 1 --2- 172.21.15.86:0/4037115498 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f9264068380 0x7f926406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:28.491 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.486+0000 7f9282ffd640 1 --2- 172.21.15.86:0/4037115498 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f9264068380 0x7f926406a840 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f926c0b2000 tx=0x7f926c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:28.492 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.490+0000 7f927b7fe640 1 -- 172.21.15.86:0/4037115498 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f927c020070 con 0x7f9284155350 2024-04-25T12:22:28.652 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.650+0000 7f928941c640 1 -- 172.21.15.86:0/4037115498 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f92840cc610 con 0x7f9284155350 2024-04-25T12:22:28.653 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.650+0000 7f927b7fe640 1 -- 172.21.15.86:0/4037115498 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7f92840c8b60 con 0x7f9284155350 2024-04-25T12:22:28.653 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 64 2024-04-25T12:22:28.655 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.650+0000 7f928941c640 1 -- 172.21.15.86:0/4037115498 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f9264068380 msgr2=0x7f926406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:28.656 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.650+0000 7f928941c640 1 --2- 172.21.15.86:0/4037115498 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f9264068380 0x7f926406a840 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f926c0b2000 tx=0x7f926c008040 comp rx=0 tx=0).stop 2024-04-25T12:22:28.656 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.650+0000 7f928941c640 1 -- 172.21.15.86:0/4037115498 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9284155350 msgr2=0x7f928415a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:28.656 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.650+0000 7f928941c640 1 --2- 172.21.15.86:0/4037115498 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9284155350 0x7f928415a8c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f927c00c780 tx=0x7f927c00cc40 comp rx=0 tx=0).stop 2024-04-25T12:22:28.656 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.654+0000 7f928941c640 1 -- 172.21.15.86:0/4037115498 shutdown_connections 2024-04-25T12:22:28.656 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.654+0000 7f928941c640 1 --2- 172.21.15.86:0/4037115498 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f9264068380 0x7f926406a840 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:28.656 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.654+0000 7f928941c640 1 --2- 172.21.15.86:0/4037115498 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9284155350 0x7f928415a8c0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:28.656 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.654+0000 7f928941c640 1 --2- 172.21.15.86:0/4037115498 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92840cda50 0x7f92841f50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:28.657 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.654+0000 7f928941c640 1 --2- 172.21.15.86:0/4037115498 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f92840cbcf0 0x7f92840c7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:28.657 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.654+0000 7f928941c640 1 -- 172.21.15.86:0/4037115498 >> 172.21.15.86:0/4037115498 conn(0x7f928406cc30 msgr2=0x7f92840ce8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:28.657 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.654+0000 7f928941c640 1 -- 172.21.15.86:0/4037115498 shutdown_connections 2024-04-25T12:22:28.657 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.654+0000 7f928941c640 1 -- 172.21.15.86:0/4037115498 wait complete. 2024-04-25T12:22:28.673 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T12:22:28.795 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.794+0000 7f6b23cd1640 1 Processor -- start 2024-04-25T12:22:28.796 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.794+0000 7f6b23cd1640 1 -- start start 2024-04-25T12:22:28.797 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.794+0000 7f6b23cd1640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6b1c155300 0x7f6b1c0c3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:28.797 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.794+0000 7f6b23cd1640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6b1c06f700 0x7f6b1c15e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:28.797 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.794+0000 7f6b23cd1640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b1c0c4e80 con 0x7f6b1c15ec50 2024-04-25T12:22:28.797 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.794+0000 7f6b23cd1640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f6b1c0c4230 con 0x7f6b1c155300 2024-04-25T12:22:28.798 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.794+0000 7f6b23cd1640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f6b1c0c5770 con 0x7f6b1c06f700 2024-04-25T12:22:28.798 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.794+0000 7f6b21a6d640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6b1c155300 0x7f6b1c0c3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:28.798 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.794+0000 7f6b21a6d640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6b1c155300 0x7f6b1c0c3cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51276/0 (socket says 172.21.15.86:51276) 2024-04-25T12:22:28.798 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.794+0000 7f6b21a6d640 1 -- 172.21.15.86:0/4253698830 learned_addr learned my addr 172.21.15.86:0/4253698830 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:28.798 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.794+0000 7f6b2126c640 1 --2- 172.21.15.86:0/4253698830 >> v2:172.21.15.134:3300/0 conn(0x7f6b1c06f700 0x7f6b1c15e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:28.798 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.794+0000 7f6b21a6d640 1 -- 172.21.15.86:0/4253698830 >> v2:172.21.15.134:3300/0 conn(0x7f6b1c06f700 msgr2=0x7f6b1c15e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:28.798 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.794+0000 7f6b21a6d640 1 --2- 172.21.15.86:0/4253698830 >> v2:172.21.15.134:3300/0 conn(0x7f6b1c06f700 0x7f6b1c15e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:28.798 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.794+0000 7f6b21a6d640 1 -- 172.21.15.86:0/4253698830 >> v1:172.21.15.134:6789/0 conn(0x7f6b1c15ec50 legacy=0x7f6b1c0c6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:28.799 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.794+0000 7f6b21a6d640 1 -- 172.21.15.86:0/4253698830 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b1c15f080 con 0x7f6b1c155300 2024-04-25T12:22:28.799 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.794+0000 7f6b2126c640 1 --2- 172.21.15.86:0/4253698830 >> v2:172.21.15.134:3300/0 conn(0x7f6b1c06f700 0x7f6b1c15e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:22:28.799 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.798+0000 7f6b21a6d640 1 --2- 172.21.15.86:0/4253698830 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b1c155300 0x7f6b1c0c3cf0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c0c38b0 tx=0x7f6b0c01c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=610282d853b00630 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:28.799 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.798+0000 7f6b20a6b640 1 -- 172.21.15.86:0/4253698830 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b0c0b0070 con 0x7f6b1c155300 2024-04-25T12:22:28.800 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.798+0000 7f6b20a6b640 1 -- 172.21.15.86:0/4253698830 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b0c0ab600 con 0x7f6b1c155300 2024-04-25T12:22:28.800 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.798+0000 7f6b20a6b640 1 -- 172.21.15.86:0/4253698830 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b0c0ab9d0 con 0x7f6b1c155300 2024-04-25T12:22:28.800 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.798+0000 7f6b23cd1640 1 -- 172.21.15.86:0/4253698830 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b1c155300 msgr2=0x7f6b1c0c3cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:28.801 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.798+0000 7f6b23cd1640 1 --2- 172.21.15.86:0/4253698830 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b1c155300 0x7f6b1c0c3cf0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c0c38b0 tx=0x7f6b0c01c4e0 comp rx=0 tx=0).stop 2024-04-25T12:22:28.801 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.798+0000 7f6b23cd1640 1 -- 172.21.15.86:0/4253698830 shutdown_connections 2024-04-25T12:22:28.801 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.798+0000 7f6b23cd1640 1 --2- 172.21.15.86:0/4253698830 >> v2:172.21.15.134:3300/0 conn(0x7f6b1c06f700 0x7f6b1c15e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:28.801 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.798+0000 7f6b23cd1640 1 --2- 172.21.15.86:0/4253698830 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b1c155300 0x7f6b1c0c3cf0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:28.801 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.798+0000 7f6b23cd1640 1 -- 172.21.15.86:0/4253698830 >> 172.21.15.86:0/4253698830 conn(0x7f6b1c06b9d0 msgr2=0x7f6b1c06bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:28.801 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.798+0000 7f6b23cd1640 1 -- 172.21.15.86:0/4253698830 shutdown_connections 2024-04-25T12:22:28.801 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.798+0000 7f6b23cd1640 1 -- 172.21.15.86:0/4253698830 wait complete. 2024-04-25T12:22:28.804 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.798+0000 7f6b23cd1640 1 Processor -- start 2024-04-25T12:22:28.804 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.798+0000 7f6b23cd1640 1 -- start start 2024-04-25T12:22:28.804 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.798+0000 7f6b23cd1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b1c06f700 0x7f6b1c146250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:28.804 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.798+0000 7f6b23cd1640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b1c155300 0x7f6b1c072870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:28.804 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.798+0000 7f6b23cd1640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b1c15ec50 0x7f6b1c072db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:28.804 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.798+0000 7f6b23cd1640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6b1c0681d0 con 0x7f6b1c15ec50 2024-04-25T12:22:28.804 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.798+0000 7f6b23cd1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6b1c15f600 con 0x7f6b1c06f700 2024-04-25T12:22:28.805 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.798+0000 7f6b23cd1640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f6b1c068350 con 0x7f6b1c155300 2024-04-25T12:22:28.805 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.798+0000 7f6b2226e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b1c15ec50 0x7f6b1c072db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:28.805 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.798+0000 7f6b2226e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b1c15ec50 0x7f6b1c072db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51280/0 (socket says 172.21.15.86:51280) 2024-04-25T12:22:28.805 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.798+0000 7f6b2226e640 1 -- 172.21.15.86:0/4070602521 learned_addr learned my addr 172.21.15.86:0/4070602521 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:28.805 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.798+0000 7f6b21a6d640 1 --2- 172.21.15.86:0/4070602521 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b1c06f700 0x7f6b1c146250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:28.805 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.798+0000 7f6b2126c640 1 --2- 172.21.15.86:0/4070602521 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b1c155300 0x7f6b1c072870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:28.805 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.798+0000 7f6b2226e640 1 -- 172.21.15.86:0/4070602521 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b1c155300 msgr2=0x7f6b1c072870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:28.805 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.798+0000 7f6b2226e640 1 --2- 172.21.15.86:0/4070602521 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b1c155300 0x7f6b1c072870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:28.805 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.798+0000 7f6b2226e640 1 -- 172.21.15.86:0/4070602521 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b1c06f700 msgr2=0x7f6b1c146250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:28.806 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.798+0000 7f6b2226e640 1 --2- 172.21.15.86:0/4070602521 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b1c06f700 0x7f6b1c146250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:28.806 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.798+0000 7f6b2226e640 1 -- 172.21.15.86:0/4070602521 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b1c0723c0 con 0x7f6b1c15ec50 2024-04-25T12:22:28.806 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.798+0000 7f6b2226e640 1 --2- 172.21.15.86:0/4070602521 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b1c15ec50 0x7f6b1c072db0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6b1400b990 tx=0x7f6b1400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:28.806 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.802+0000 7f6b127fc640 1 -- 172.21.15.86:0/4070602521 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b14019070 con 0x7f6b1c15ec50 2024-04-25T12:22:28.806 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.802+0000 7f6b127fc640 1 -- 172.21.15.86:0/4070602521 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b1400cba0 con 0x7f6b1c15ec50 2024-04-25T12:22:28.806 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.802+0000 7f6b23cd1640 1 -- 172.21.15.86:0/4070602521 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b1c145960 con 0x7f6b1c15ec50 2024-04-25T12:22:28.806 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.802+0000 7f6b127fc640 1 -- 172.21.15.86:0/4070602521 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b14014440 con 0x7f6b1c15ec50 2024-04-25T12:22:28.806 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.802+0000 7f6b23cd1640 1 -- 172.21.15.86:0/4070602521 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b1c15e0b0 con 0x7f6b1c15ec50 2024-04-25T12:22:28.806 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.802+0000 7f6b23cd1640 1 -- 172.21.15.86:0/4070602521 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b1c075df0 con 0x7f6b1c15ec50 2024-04-25T12:22:28.807 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.802+0000 7f6b127fc640 1 -- 172.21.15.86:0/4070602521 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6b1401c070 con 0x7f6b1c15ec50 2024-04-25T12:22:28.807 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.802+0000 7f6b127fc640 1 --2- 172.21.15.86:0/4070602521 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f6b00068380 0x7f6b0006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:28.807 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.802+0000 7f6b127fc640 1 -- 172.21.15.86:0/4070602521 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f6b14086bc0 con 0x7f6b1c15ec50 2024-04-25T12:22:28.808 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.802+0000 7f6b21a6d640 1 --2- 172.21.15.86:0/4070602521 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f6b00068380 0x7f6b0006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:28.808 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.802+0000 7f6b21a6d640 1 --2- 172.21.15.86:0/4070602521 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f6b00068380 0x7f6b0006a840 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c0ad000 tx=0x7f6b0c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:28.809 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.806+0000 7f6b127fc640 1 -- 172.21.15.86:0/4070602521 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6b14056d80 con 0x7f6b1c15ec50 2024-04-25T12:22:28.972 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.970+0000 7f6b23cd1640 1 -- 172.21.15.86:0/4070602521 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f6b1c06c4f0 con 0x7f6b1c15ec50 2024-04-25T12:22:28.973 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.970+0000 7f6b127fc640 1 -- 172.21.15.86:0/4070602521 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f6b14056680 con 0x7f6b1c15ec50 2024-04-25T12:22:28.973 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 32 2024-04-25T12:22:28.975 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.974+0000 7f6b23cd1640 1 -- 172.21.15.86:0/4070602521 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f6b00068380 msgr2=0x7f6b0006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:28.976 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.974+0000 7f6b23cd1640 1 --2- 172.21.15.86:0/4070602521 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f6b00068380 0x7f6b0006a840 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c0ad000 tx=0x7f6b0c008040 comp rx=0 tx=0).stop 2024-04-25T12:22:28.976 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.974+0000 7f6b23cd1640 1 -- 172.21.15.86:0/4070602521 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b1c15ec50 msgr2=0x7f6b1c072db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:28.976 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.974+0000 7f6b23cd1640 1 --2- 172.21.15.86:0/4070602521 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b1c15ec50 0x7f6b1c072db0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6b1400b990 tx=0x7f6b1400be50 comp rx=0 tx=0).stop 2024-04-25T12:22:28.976 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.974+0000 7f6b23cd1640 1 -- 172.21.15.86:0/4070602521 shutdown_connections 2024-04-25T12:22:28.976 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.974+0000 7f6b23cd1640 1 --2- 172.21.15.86:0/4070602521 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f6b00068380 0x7f6b0006a840 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:28.976 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.974+0000 7f6b23cd1640 1 --2- 172.21.15.86:0/4070602521 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b1c15ec50 0x7f6b1c072db0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:28.976 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.974+0000 7f6b23cd1640 1 --2- 172.21.15.86:0/4070602521 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b1c155300 0x7f6b1c072870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:28.976 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.974+0000 7f6b23cd1640 1 --2- 172.21.15.86:0/4070602521 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b1c06f700 0x7f6b1c146250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:28.977 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.974+0000 7f6b23cd1640 1 -- 172.21.15.86:0/4070602521 >> 172.21.15.86:0/4070602521 conn(0x7f6b1c06b9d0 msgr2=0x7f6b1c1535b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:28.977 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.974+0000 7f6b23cd1640 1 -- 172.21.15.86:0/4070602521 shutdown_connections 2024-04-25T12:22:28.977 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:28.974+0000 7f6b23cd1640 1 -- 172.21.15.86:0/4070602521 wait complete. 2024-04-25T12:22:28.992 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T12:22:29.116 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.114+0000 7ffbadc4d640 1 Processor -- start 2024-04-25T12:22:29.117 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.114+0000 7ffbadc4d640 1 -- start start 2024-04-25T12:22:29.119 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.114+0000 7ffbadc4d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffba814fbc0 0x7ffba806f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:29.119 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.114+0000 7ffbadc4d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ffba8074100 0x7ffba80c7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:29.119 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.114+0000 7ffbadc4d640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffba80c5d70 con 0x7ffba814ffa0 2024-04-25T12:22:29.119 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.114+0000 7ffbadc4d640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7ffba80c6050 con 0x7ffba8074100 2024-04-25T12:22:29.119 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.114+0000 7ffbadc4d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7ffba80c6330 con 0x7ffba814fbc0 2024-04-25T12:22:29.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.114+0000 7ffba6ffd640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7ffba814ffa0 0x7ffba80c8220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:41610/0 (socket says 172.21.15.86:41610) 2024-04-25T12:22:29.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.114+0000 7ffba6ffd640 1 -- 172.21.15.86:0/3557443490 learned_addr learned my addr 172.21.15.86:0/3557443490 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-04-25T12:22:29.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.114+0000 7ffba77fe640 1 --2- 172.21.15.86:0/3557443490 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffba814fbc0 0x7ffba806f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:29.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.114+0000 7ffba67fc640 1 -- 172.21.15.86:0/3557443490 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2094056334 0 0) 0x7ffba80c5d70 con 0x7ffba814ffa0 2024-04-25T12:22:29.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.114+0000 7ffba7fff640 1 --2- 172.21.15.86:0/3557443490 >> v2:172.21.15.134:3300/0 conn(0x7ffba8074100 0x7ffba80c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:29.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.114+0000 7ffba67fc640 1 -- 172.21.15.86:0/3557443490 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb90003530 con 0x7ffba814ffa0 2024-04-25T12:22:29.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.114+0000 7ffba67fc640 1 -- 172.21.15.86:0/3557443490 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 350574622 0 0) 0x7ffb90003530 con 0x7ffba814ffa0 2024-04-25T12:22:29.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.114+0000 7ffba67fc640 1 -- 172.21.15.86:0/3557443490 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffba814fbc0 msgr2=0x7ffba806f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:29.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.114+0000 7ffba67fc640 1 --2- 172.21.15.86:0/3557443490 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffba814fbc0 0x7ffba806f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:29.121 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.114+0000 7ffba67fc640 1 -- 172.21.15.86:0/3557443490 >> v2:172.21.15.134:3300/0 conn(0x7ffba8074100 msgr2=0x7ffba80c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:29.121 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.114+0000 7ffba67fc640 1 --2- 172.21.15.86:0/3557443490 >> v2:172.21.15.134:3300/0 conn(0x7ffba8074100 0x7ffba80c7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:29.121 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.114+0000 7ffba67fc640 1 -- 172.21.15.86:0/3557443490 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffba80c6610 con 0x7ffba814ffa0 2024-04-25T12:22:29.121 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.114+0000 7ffba67fc640 1 -- 172.21.15.86:0/3557443490 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1387950573 0 0) 0x7ffb9c001680 con 0x7ffba814ffa0 2024-04-25T12:22:29.121 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.114+0000 7ffba67fc640 1 -- 172.21.15.86:0/3557443490 >> v1:172.21.15.86:6789/0 conn(0x7ffba814ffa0 legacy=0x7ffba80c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:29.121 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.114+0000 7ffba67fc640 1 --2- 172.21.15.86:0/3557443490 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb900039c0 0x7ffb90003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:29.121 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.114+0000 7ffba67fc640 1 --2- 172.21.15.86:0/3557443490 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb90004810 0x7ffb90004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:29.121 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.114+0000 7ffba67fc640 1 --2- 172.21.15.86:0/3557443490 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffba814fbc0 0x7ffb900051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:29.122 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.114+0000 7ffba67fc640 1 -- 172.21.15.86:0/3557443490 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ffba80c6050 con 0x7ffb900039c0 2024-04-25T12:22:29.122 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.114+0000 7ffba67fc640 1 -- 172.21.15.86:0/3557443490 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ffba80c6330 con 0x7ffb90004810 2024-04-25T12:22:29.122 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.114+0000 7ffba67fc640 1 -- 172.21.15.86:0/3557443490 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7ffb9000b9d0 con 0x7ffba814fbc0 2024-04-25T12:22:29.122 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.114+0000 7ffba77fe640 1 --2- 172.21.15.86:0/3557443490 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb900039c0 0x7ffb90003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:29.122 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.114+0000 7ffba6ffd640 1 --2- 172.21.15.86:0/3557443490 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb90004810 0x7ffb90004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:29.122 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.114+0000 7ffba7fff640 1 --2- 172.21.15.86:0/3557443490 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffba814fbc0 0x7ffb900051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:29.122 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.114+0000 7ffba77fe640 1 -- 172.21.15.86:0/3557443490 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffba814fbc0 msgr2=0x7ffb900051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:29.122 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.114+0000 7ffba77fe640 1 --2- 172.21.15.86:0/3557443490 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffba814fbc0 0x7ffb900051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:29.123 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.114+0000 7ffba77fe640 1 -- 172.21.15.86:0/3557443490 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb90004810 msgr2=0x7ffb90004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:29.123 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.114+0000 7ffba77fe640 1 --2- 172.21.15.86:0/3557443490 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb90004810 0x7ffb90004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:29.123 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.114+0000 7ffba77fe640 1 -- 172.21.15.86:0/3557443490 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb90003530 con 0x7ffb900039c0 2024-04-25T12:22:29.126 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.118+0000 7ffba77fe640 1 --2- 172.21.15.86:0/3557443490 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb900039c0 0x7ffb90003de0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ffb98009ae0 tx=0x7ffb9801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deb56e2b37d59002 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:29.126 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.118+0000 7ffba67fc640 1 -- 172.21.15.86:0/3557443490 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb980b2070 con 0x7ffb900039c0 2024-04-25T12:22:29.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.118+0000 7ffba67fc640 1 -- 172.21.15.86:0/3557443490 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb980a5580 con 0x7ffb900039c0 2024-04-25T12:22:29.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.118+0000 7ffba67fc640 1 -- 172.21.15.86:0/3557443490 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb980096b0 con 0x7ffb900039c0 2024-04-25T12:22:29.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.118+0000 7ffbadc4d640 1 -- 172.21.15.86:0/3557443490 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb900039c0 msgr2=0x7ffb90003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:29.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.118+0000 7ffbadc4d640 1 --2- 172.21.15.86:0/3557443490 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb900039c0 0x7ffb90003de0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ffb98009ae0 tx=0x7ffb9801ca70 comp rx=0 tx=0).stop 2024-04-25T12:22:29.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.118+0000 7ffba7fff640 1 -- 172.21.15.86:0/3557443490 reap_dead start 2024-04-25T12:22:29.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.118+0000 7ffbadc4d640 1 -- 172.21.15.86:0/3557443490 shutdown_connections 2024-04-25T12:22:29.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.118+0000 7ffbadc4d640 1 -- 172.21.15.86:0/3557443490 >> 172.21.15.86:0/3557443490 conn(0x7ffba806b9d0 msgr2=0x7ffba806bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:29.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.118+0000 7ffbadc4d640 1 -- 172.21.15.86:0/3557443490 shutdown_connections 2024-04-25T12:22:29.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.118+0000 7ffbadc4d640 1 -- 172.21.15.86:0/3557443490 wait complete. 2024-04-25T12:22:29.128 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.118+0000 7ffbadc4d640 1 Processor -- start 2024-04-25T12:22:29.128 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.122+0000 7ffbadc4d640 1 -- start start 2024-04-25T12:22:29.128 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.122+0000 7ffbadc4d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb900039c0 0x7ffba815b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:29.128 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.122+0000 7ffbadc4d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffba81524c0 0x7ffba815a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:29.128 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.122+0000 7ffbadc4d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffba8151c30 0x7ffba815c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:29.128 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.122+0000 7ffbadc4d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ffba80c8930 con 0x7ffb900039c0 2024-04-25T12:22:29.128 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.122+0000 7ffbadc4d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ffba806fb10 con 0x7ffba8151c30 2024-04-25T12:22:29.128 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.122+0000 7ffbadc4d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7ffba80c8ab0 con 0x7ffba81524c0 2024-04-25T12:22:29.128 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.122+0000 7ffba77fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb900039c0 0x7ffba815b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:29.129 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.122+0000 7ffba77fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb900039c0 0x7ffba815b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51296/0 (socket says 172.21.15.86:51296) 2024-04-25T12:22:29.129 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.122+0000 7ffba77fe640 1 -- 172.21.15.86:0/2925706617 learned_addr learned my addr 172.21.15.86:0/2925706617 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:29.129 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.122+0000 7ffba6ffd640 1 --2- 172.21.15.86:0/2925706617 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffba81524c0 0x7ffba815a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:29.129 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.122+0000 7ffba7fff640 1 --2- 172.21.15.86:0/2925706617 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffba8151c30 0x7ffba815c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:29.129 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.122+0000 7ffba77fe640 1 -- 172.21.15.86:0/2925706617 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffba81524c0 msgr2=0x7ffba815a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:29.129 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.122+0000 7ffba77fe640 1 --2- 172.21.15.86:0/2925706617 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffba81524c0 0x7ffba815a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:29.129 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.122+0000 7ffba77fe640 1 -- 172.21.15.86:0/2925706617 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffba8151c30 msgr2=0x7ffba815c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:29.129 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.122+0000 7ffba77fe640 1 --2- 172.21.15.86:0/2925706617 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffba8151c30 0x7ffba815c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:29.130 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.122+0000 7ffba77fe640 1 -- 172.21.15.86:0/2925706617 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffba815bdb0 con 0x7ffb900039c0 2024-04-25T12:22:29.130 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.122+0000 7ffba6ffd640 1 --2- 172.21.15.86:0/2925706617 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffba81524c0 0x7ffba815a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:22:29.130 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.122+0000 7ffba7fff640 1 --2- 172.21.15.86:0/2925706617 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffba8151c30 0x7ffba815c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:22:29.130 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.122+0000 7ffba77fe640 1 --2- 172.21.15.86:0/2925706617 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb900039c0 0x7ffba815b3d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ffb9801c8a0 tx=0x7ffb90005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:29.130 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.122+0000 7ffb8ffff640 1 -- 172.21.15.86:0/2925706617 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb980ba030 con 0x7ffb900039c0 2024-04-25T12:22:29.130 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.122+0000 7ffb8ffff640 1 -- 172.21.15.86:0/2925706617 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb9800f000 con 0x7ffb900039c0 2024-04-25T12:22:29.130 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.122+0000 7ffb8ffff640 1 -- 172.21.15.86:0/2925706617 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb980b2040 con 0x7ffb900039c0 2024-04-25T12:22:29.130 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.122+0000 7ffbadc4d640 1 -- 172.21.15.86:0/2925706617 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffba815a590 con 0x7ffb900039c0 2024-04-25T12:22:29.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.122+0000 7ffbadc4d640 1 -- 172.21.15.86:0/2925706617 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffba8150790 con 0x7ffb900039c0 2024-04-25T12:22:29.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.122+0000 7ffbadc4d640 1 -- 172.21.15.86:0/2925706617 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffba8075df0 con 0x7ffb900039c0 2024-04-25T12:22:29.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.122+0000 7ffb8ffff640 1 -- 172.21.15.86:0/2925706617 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ffb98004220 con 0x7ffb900039c0 2024-04-25T12:22:29.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.122+0000 7ffb8ffff640 1 --2- 172.21.15.86:0/2925706617 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7ffb94068380 0x7ffb9406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:29.132 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.122+0000 7ffb8ffff640 1 -- 172.21.15.86:0/2925706617 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7ffb98120930 con 0x7ffb900039c0 2024-04-25T12:22:29.132 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.126+0000 7ffba6ffd640 1 --2- 172.21.15.86:0/2925706617 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7ffb94068380 0x7ffb9406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:29.132 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.126+0000 7ffba6ffd640 1 --2- 172.21.15.86:0/2925706617 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7ffb94068380 0x7ffb9406a840 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c000c10 tx=0x7ffb9c000ee0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:29.132 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.130+0000 7ffb8ffff640 1 -- 172.21.15.86:0/2925706617 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ffba815bdb0 con 0x7ffb900039c0 2024-04-25T12:22:29.306 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.302+0000 7ffbadc4d640 1 -- 172.21.15.86:0/2925706617 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ffba80c7df0 con 0x7ffb900039c0 2024-04-25T12:22:29.307 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.302+0000 7ffb8ffff640 1 -- 172.21.15.86:0/2925706617 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7ffb98016780 con 0x7ffb900039c0 2024-04-25T12:22:29.307 INFO:teuthology.orchestra.run.smithi086.stderr:listed 0 entries 2024-04-25T12:22:29.309 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.306+0000 7ffbadc4d640 1 -- 172.21.15.86:0/2925706617 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7ffb94068380 msgr2=0x7ffb9406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:29.309 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.306+0000 7ffbadc4d640 1 --2- 172.21.15.86:0/2925706617 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7ffb94068380 0x7ffb9406a840 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c000c10 tx=0x7ffb9c000ee0 comp rx=0 tx=0).stop 2024-04-25T12:22:29.310 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.306+0000 7ffbadc4d640 1 -- 172.21.15.86:0/2925706617 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb900039c0 msgr2=0x7ffba815b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:29.310 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.306+0000 7ffbadc4d640 1 --2- 172.21.15.86:0/2925706617 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb900039c0 0x7ffba815b3d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ffb9801c8a0 tx=0x7ffb90005840 comp rx=0 tx=0).stop 2024-04-25T12:22:29.310 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.306+0000 7ffbadc4d640 1 -- 172.21.15.86:0/2925706617 shutdown_connections 2024-04-25T12:22:29.310 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.306+0000 7ffbadc4d640 1 --2- 172.21.15.86:0/2925706617 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffba8151c30 0x7ffba815c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:29.310 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.306+0000 7ffbadc4d640 1 --2- 172.21.15.86:0/2925706617 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffba81524c0 0x7ffba815a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:29.310 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.306+0000 7ffbadc4d640 1 --2- 172.21.15.86:0/2925706617 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7ffb94068380 0x7ffb9406a840 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:29.310 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.306+0000 7ffbadc4d640 1 --2- 172.21.15.86:0/2925706617 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb900039c0 0x7ffba815b3d0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:29.310 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.306+0000 7ffbadc4d640 1 -- 172.21.15.86:0/2925706617 >> 172.21.15.86:0/2925706617 conn(0x7ffba806b9d0 msgr2=0x7ffba8071030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:29.311 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.306+0000 7ffbadc4d640 1 -- 172.21.15.86:0/2925706617 shutdown_connections 2024-04-25T12:22:29.311 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:29.306+0000 7ffbadc4d640 1 -- 172.21.15.86:0/2925706617 wait complete. 2024-04-25T12:22:29.326 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi086.front.sepia.ceph.com... 2024-04-25T12:22:29.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:22:29.327 DEBUG:teuthology.orchestra.run.smithi086:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-25T12:22:29.336 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi086.stderr:ceph-fuse[36243]: fuse finished with error 0 and tester_r 0 2024-04-25T12:22:29.337 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T12:22:35.439 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi086.front.sepia.ceph.com 2024-04-25T12:22:35.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:22:35.439 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T12:22:35.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:22:35.447 DEBUG:teuthology.orchestra.run.smithi086:> ip netns list 2024-04-25T12:22:35.497 INFO:teuthology.orchestra.run.smithi086.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T12:22:35.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:22:35.497 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T12:22:35.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:22:35.552 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link delete ceph-brx 2024-04-25T12:22:35.749 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-25T12:22:35.760 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T12:22:35.760 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T12:22:35.887 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:35.885+0000 7f322b934640 1 Processor -- start 2024-04-25T12:22:35.887 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:35.885+0000 7f322b934640 1 -- start start 2024-04-25T12:22:35.889 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:35.885+0000 7f322b934640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f32240c8250 0x7f32240c39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:35.889 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:35.885+0000 7f322b934640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f32240c8630 0x7f3224151b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:35.889 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:35.885+0000 7f322b934640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f322415b740 con 0x7f32240c8a70 2024-04-25T12:22:35.889 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:35.885+0000 7f322b934640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f32240c6490 con 0x7f32240c8250 2024-04-25T12:22:35.889 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:35.885+0000 7f322b934640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f32240c58c0 con 0x7f32240c8630 2024-04-25T12:22:35.889 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:35.885+0000 7f32296d0640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f32240c8250 0x7f32240c39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:35.889 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:35.885+0000 7f32296d0640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f32240c8250 0x7f32240c39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37492/0 (socket says 172.21.15.86:37492) 2024-04-25T12:22:35.890 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:35.885+0000 7f32296d0640 1 -- 172.21.15.86:0/2505299643 learned_addr learned my addr 172.21.15.86:0/2505299643 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:35.890 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:35.885+0000 7f3228ecf640 1 --2- 172.21.15.86:0/2505299643 >> v2:172.21.15.134:3300/0 conn(0x7f32240c8630 0x7f3224151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:35.890 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:35.885+0000 7f32296d0640 1 -- 172.21.15.86:0/2505299643 >> v2:172.21.15.134:3300/0 conn(0x7f32240c8630 msgr2=0x7f3224151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:35.890 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:35.885+0000 7f32296d0640 1 --2- 172.21.15.86:0/2505299643 >> v2:172.21.15.134:3300/0 conn(0x7f32240c8630 0x7f3224151b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:35.890 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:35.885+0000 7f32296d0640 1 -- 172.21.15.86:0/2505299643 >> v1:172.21.15.86:6789/0 conn(0x7f32240c8a70 legacy=0x7f3224152080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:35.890 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:35.885+0000 7f32296d0640 1 -- 172.21.15.86:0/2505299643 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32240c5b60 con 0x7f32240c8250 2024-04-25T12:22:35.890 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:35.885+0000 7f321bfff640 1 -- 172.21.15.86:0/2505299643 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4065339894 0 0) 0x7f322415b740 con 0x7f32240c8a70 2024-04-25T12:22:35.890 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:35.885+0000 7f3228ecf640 1 --2- 172.21.15.86:0/2505299643 >> v2:172.21.15.134:3300/0 conn(0x7f32240c8630 0x7f3224151b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:22:35.892 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:35.885+0000 7f32296d0640 1 --2- 172.21.15.86:0/2505299643 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32240c8250 0x7f32240c39e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f32240c6610 tx=0x7f321c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44bf465e404dbe49 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:35.892 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:35.885+0000 7f321bfff640 1 -- 172.21.15.86:0/2505299643 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f321c0b2070 con 0x7f32240c8250 2024-04-25T12:22:35.892 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:35.889+0000 7f321bfff640 1 -- 172.21.15.86:0/2505299643 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f321c0ad680 con 0x7f32240c8250 2024-04-25T12:22:35.892 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:35.889+0000 7f321bfff640 1 -- 172.21.15.86:0/2505299643 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f321c0ada50 con 0x7f32240c8250 2024-04-25T12:22:35.892 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:35.889+0000 7f322b934640 1 -- 172.21.15.86:0/2505299643 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32240c8250 msgr2=0x7f32240c39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:35.892 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:35.889+0000 7f322b934640 1 --2- 172.21.15.86:0/2505299643 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32240c8250 0x7f32240c39e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f32240c6610 tx=0x7f321c01c490 comp rx=0 tx=0).stop 2024-04-25T12:22:35.892 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:35.889+0000 7f322b934640 1 -- 172.21.15.86:0/2505299643 shutdown_connections 2024-04-25T12:22:35.892 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:35.889+0000 7f322b934640 1 --2- 172.21.15.86:0/2505299643 >> v2:172.21.15.134:3300/0 conn(0x7f32240c8630 0x7f3224151b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:35.892 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:35.889+0000 7f322b934640 1 --2- 172.21.15.86:0/2505299643 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32240c8250 0x7f32240c39e0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:35.893 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:35.889+0000 7f322b934640 1 -- 172.21.15.86:0/2505299643 >> 172.21.15.86:0/2505299643 conn(0x7f322406b9d0 msgr2=0x7f322406bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:35.893 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:35.889+0000 7f322b934640 1 -- 172.21.15.86:0/2505299643 shutdown_connections 2024-04-25T12:22:35.893 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:35.889+0000 7f322b934640 1 -- 172.21.15.86:0/2505299643 wait complete. 2024-04-25T12:22:35.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:35.889+0000 7f322b934640 1 Processor -- start 2024-04-25T12:22:35.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:35.889+0000 7f322b934640 1 -- start start 2024-04-25T12:22:35.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:35.889+0000 7f322b934640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32240c8250 0x7f3224157900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:35.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:35.889+0000 7f322b934640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f32240c8630 0x7f32241f5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:35.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:35.889+0000 7f322b934640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32240c8a70 0x7f3224143190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:35.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:35.889+0000 7f322b934640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f32240c6920 con 0x7f32240c8a70 2024-04-25T12:22:35.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:35.889+0000 7f322b934640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f322415b400 con 0x7f32240c8250 2024-04-25T12:22:35.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:35.889+0000 7f322b934640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f32240681d0 con 0x7f32240c8630 2024-04-25T12:22:35.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:35.889+0000 7f3229ed1640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32240c8a70 0x7f3224143190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:35.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:35.889+0000 7f3229ed1640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32240c8a70 0x7f3224143190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37506/0 (socket says 172.21.15.86:37506) 2024-04-25T12:22:35.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:35.889+0000 7f3229ed1640 1 -- 172.21.15.86:0/1834877829 learned_addr learned my addr 172.21.15.86:0/1834877829 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:35.897 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:35.889+0000 7f32296d0640 1 --2- 172.21.15.86:0/1834877829 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32240c8250 0x7f3224157900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:35.897 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:35.889+0000 7f3228ecf640 1 --2- 172.21.15.86:0/1834877829 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f32240c8630 0x7f32241f5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:35.897 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:35.889+0000 7f3229ed1640 1 -- 172.21.15.86:0/1834877829 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f32240c8630 msgr2=0x7f32241f5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:35.897 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:35.889+0000 7f3229ed1640 1 --2- 172.21.15.86:0/1834877829 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f32240c8630 0x7f32241f5930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:35.897 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:35.889+0000 7f3229ed1640 1 -- 172.21.15.86:0/1834877829 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32240c8250 msgr2=0x7f3224157900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:35.897 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:35.889+0000 7f3229ed1640 1 --2- 172.21.15.86:0/1834877829 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32240c8250 0x7f3224157900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:35.897 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:35.889+0000 7f3229ed1640 1 -- 172.21.15.86:0/1834877829 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32241f5e70 con 0x7f32240c8a70 2024-04-25T12:22:35.897 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:35.889+0000 7f32296d0640 1 --2- 172.21.15.86:0/1834877829 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32240c8250 0x7f3224157900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:22:35.897 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:35.889+0000 7f3228ecf640 1 --2- 172.21.15.86:0/1834877829 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f32240c8630 0x7f32241f5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:22:35.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:35.889+0000 7f3229ed1640 1 --2- 172.21.15.86:0/1834877829 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32240c8a70 0x7f3224143190 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f322000c7b0 tx=0x7f322000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:35.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:35.889+0000 7f3219ffb640 1 -- 172.21.15.86:0/1834877829 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f322000ce60 con 0x7f32240c8a70 2024-04-25T12:22:35.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:35.889+0000 7f3219ffb640 1 -- 172.21.15.86:0/1834877829 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3220003db0 con 0x7f32240c8a70 2024-04-25T12:22:35.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:35.889+0000 7f322b934640 1 -- 172.21.15.86:0/1834877829 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3224153390 con 0x7f32240c8a70 2024-04-25T12:22:35.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:35.889+0000 7f3219ffb640 1 -- 172.21.15.86:0/1834877829 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32200052b0 con 0x7f32240c8a70 2024-04-25T12:22:35.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:35.889+0000 7f322b934640 1 -- 172.21.15.86:0/1834877829 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3224153910 con 0x7f32240c8a70 2024-04-25T12:22:35.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:35.893+0000 7f322b934640 1 -- 172.21.15.86:0/1834877829 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3224075df0 con 0x7f32240c8a70 2024-04-25T12:22:35.899 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:35.893+0000 7f3219ffb640 1 -- 172.21.15.86:0/1834877829 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3220005450 con 0x7f32240c8a70 2024-04-25T12:22:35.899 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:35.893+0000 7f3219ffb640 1 --2- 172.21.15.86:0/1834877829 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f32080683b0 0x7f320806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:35.899 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:35.893+0000 7f3219ffb640 1 -- 172.21.15.86:0/1834877829 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f3220086bd0 con 0x7f32240c8a70 2024-04-25T12:22:35.900 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:35.893+0000 7f32296d0640 1 --2- 172.21.15.86:0/1834877829 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f32080683b0 0x7f320806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:35.900 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:35.893+0000 7f32296d0640 1 --2- 172.21.15.86:0/1834877829 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f32080683b0 0x7f320806a870 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f321c0af000 tx=0x7f321c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:35.901 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:35.897+0000 7f3219ffb640 1 -- 172.21.15.86:0/1834877829 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3220056d90 con 0x7f32240c8a70 2024-04-25T12:22:36.060 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.057+0000 7f322b934640 1 -- 172.21.15.86:0/1834877829 --> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3224157e40 con 0x7f32080683b0 2024-04-25T12:22:36.073 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.069+0000 7f3219ffb640 1 -- 172.21.15.86:0/1834877829 <== mgr.4107 v2:172.21.15.86:6832/3708662606 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332691 (secure 0 0 0) 0x7f3224157e40 con 0x7f32080683b0 2024-04-25T12:22:36.077 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:22:36.079 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2024-04-25T12:22:36.080 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.073+0000 7f322b934640 1 -- 172.21.15.86:0/1834877829 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f32080683b0 msgr2=0x7f320806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:36.080 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.073+0000 7f322b934640 1 --2- 172.21.15.86:0/1834877829 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f32080683b0 0x7f320806a870 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f321c0af000 tx=0x7f321c008040 comp rx=0 tx=0).stop 2024-04-25T12:22:36.080 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.073+0000 7f322b934640 1 -- 172.21.15.86:0/1834877829 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32240c8a70 msgr2=0x7f3224143190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:36.080 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.073+0000 7f322b934640 1 --2- 172.21.15.86:0/1834877829 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32240c8a70 0x7f3224143190 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f322000c7b0 tx=0x7f322000cc70 comp rx=0 tx=0).stop 2024-04-25T12:22:36.080 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.073+0000 7f322b934640 1 -- 172.21.15.86:0/1834877829 shutdown_connections 2024-04-25T12:22:36.080 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.073+0000 7f322b934640 1 --2- 172.21.15.86:0/1834877829 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f32080683b0 0x7f320806a870 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:36.081 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.073+0000 7f322b934640 1 --2- 172.21.15.86:0/1834877829 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32240c8a70 0x7f3224143190 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:36.081 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.073+0000 7f322b934640 1 --2- 172.21.15.86:0/1834877829 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f32240c8630 0x7f32241f5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:36.081 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.073+0000 7f322b934640 1 --2- 172.21.15.86:0/1834877829 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32240c8250 0x7f3224157900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:36.081 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.073+0000 7f322b934640 1 -- 172.21.15.86:0/1834877829 >> 172.21.15.86:0/1834877829 conn(0x7f322406b9d0 msgr2=0x7f322414f330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:36.081 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.073+0000 7f322b934640 1 -- 172.21.15.86:0/1834877829 shutdown_connections 2024-04-25T12:22:36.081 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.073+0000 7f322b934640 1 -- 172.21.15.86:0/1834877829 wait complete. 2024-04-25T12:22:36.096 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2024-04-25T12:22:35.822910+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":602960,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":379,"num_write_kb":2494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":311,"ondisk_log_size":311,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219720,"kb_used_data":3592,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755000,"statfs":{"total":773094113280,"available":772869120000,"internally_reserved":0,"allocated":3678208,"data_stored":2120808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2328,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004752"},"pg_stats":[{"pgid":"2.1f","version":"26'13","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:14.941362+0000","last_change":"2024-04-25T12:21:23.124053+0000","last_active":"2024-04-25T12:22:14.941362+0000","last_peered":"2024-04-25T12:22:14.941362+0000","last_clean":"2024-04-25T12:22:14.941362+0000","last_became_active":"2024-04-25T12:21:23.123863+0000","last_became_peered":"2024-04-25T12:21:23.123863+0000","last_unstale":"2024-04-25T12:22:14.941362+0000","last_undegraded":"2024-04-25T12:22:14.941362+0000","last_fullsized":"2024-04-25T12:22:14.941362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:52:10.500619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.889057+0000","last_change":"2024-04-25T12:21:24.141874+0000","last_active":"2024-04-25T12:22:04.889057+0000","last_peered":"2024-04-25T12:22:04.889057+0000","last_clean":"2024-04-25T12:22:04.889057+0000","last_became_active":"2024-04-25T12:21:24.141482+0000","last_became_peered":"2024-04-25T12:21:24.141482+0000","last_unstale":"2024-04-25T12:22:04.889057+0000","last_undegraded":"2024-04-25T12:22:04.889057+0000","last_fullsized":"2024-04-25T12:22:04.889057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:45.364004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.885753+0000","last_change":"2024-04-25T12:21:28.377921+0000","last_active":"2024-04-25T12:22:04.885753+0000","last_peered":"2024-04-25T12:22:04.885753+0000","last_clean":"2024-04-25T12:22:04.885753+0000","last_became_active":"2024-04-25T12:21:28.376966+0000","last_became_peered":"2024-04-25T12:21:28.376966+0000","last_unstale":"2024-04-25T12:22:04.885753+0000","last_undegraded":"2024-04-25T12:22:04.885753+0000","last_fullsized":"2024-04-25T12:22:04.885753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:50:43.460694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.889523+0000","last_change":"2024-04-25T12:21:23.113889+0000","last_active":"2024-04-25T12:22:04.889523+0000","last_peered":"2024-04-25T12:22:04.889523+0000","last_clean":"2024-04-25T12:22:04.889523+0000","last_became_active":"2024-04-25T12:21:23.113605+0000","last_became_peered":"2024-04-25T12:21:23.113605+0000","last_unstale":"2024-04-25T12:22:04.889523+0000","last_undegraded":"2024-04-25T12:22:04.889523+0000","last_fullsized":"2024-04-25T12:22:04.889523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:01.082322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.926635+0000","last_change":"2024-04-25T12:22:04.926635+0000","last_active":"2024-04-25T12:22:04.926635+0000","last_peered":"2024-04-25T12:22:04.926635+0000","last_clean":"2024-04-25T12:22:04.926635+0000","last_became_active":"2024-04-25T12:22:04.925895+0000","last_became_peered":"2024-04-25T12:22:04.925895+0000","last_unstale":"2024-04-25T12:22:04.926635+0000","last_undegraded":"2024-04-25T12:22:04.926635+0000","last_fullsized":"2024-04-25T12:22:04.926635+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:58:49.313708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.886429+0000","last_change":"2024-04-25T12:21:28.205320+0000","last_active":"2024-04-25T12:22:04.886429+0000","last_peered":"2024-04-25T12:22:04.886429+0000","last_clean":"2024-04-25T12:22:04.886429+0000","last_became_active":"2024-04-25T12:21:28.204404+0000","last_became_peered":"2024-04-25T12:21:28.204404+0000","last_unstale":"2024-04-25T12:22:04.886429+0000","last_undegraded":"2024-04-25T12:22:04.886429+0000","last_fullsized":"2024-04-25T12:22:04.886429+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:03:17.730928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'12","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:14.950869+0000","last_change":"2024-04-25T12:21:23.132332+0000","last_active":"2024-04-25T12:22:14.950869+0000","last_peered":"2024-04-25T12:22:14.950869+0000","last_clean":"2024-04-25T12:22:14.950869+0000","last_became_active":"2024-04-25T12:21:23.131566+0000","last_became_peered":"2024-04-25T12:21:23.131566+0000","last_unstale":"2024-04-25T12:22:14.950869+0000","last_undegraded":"2024-04-25T12:22:14.950869+0000","last_fullsized":"2024-04-25T12:22:14.950869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:02.429838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.886464+0000","last_change":"2024-04-25T12:21:24.128824+0000","last_active":"2024-04-25T12:22:04.886464+0000","last_peered":"2024-04-25T12:22:04.886464+0000","last_clean":"2024-04-25T12:22:04.886464+0000","last_became_active":"2024-04-25T12:21:24.128027+0000","last_became_peered":"2024-04-25T12:21:24.128027+0000","last_unstale":"2024-04-25T12:22:04.886464+0000","last_undegraded":"2024-04-25T12:22:04.886464+0000","last_fullsized":"2024-04-25T12:22:04.886464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:57:44.137044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.888676+0000","last_change":"2024-04-25T12:21:28.202389+0000","last_active":"2024-04-25T12:22:04.888676+0000","last_peered":"2024-04-25T12:22:04.888676+0000","last_clean":"2024-04-25T12:22:04.888676+0000","last_became_active":"2024-04-25T12:21:28.201228+0000","last_became_peered":"2024-04-25T12:21:28.201228+0000","last_unstale":"2024-04-25T12:22:04.888676+0000","last_undegraded":"2024-04-25T12:22:04.888676+0000","last_fullsized":"2024-04-25T12:22:04.888676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:45:30.365480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:14.953252+0000","last_change":"2024-04-25T12:21:23.128355+0000","last_active":"2024-04-25T12:22:14.953252+0000","last_peered":"2024-04-25T12:22:14.953252+0000","last_clean":"2024-04-25T12:22:14.953252+0000","last_became_active":"2024-04-25T12:21:23.127717+0000","last_became_peered":"2024-04-25T12:21:23.127717+0000","last_unstale":"2024-04-25T12:22:14.953252+0000","last_undegraded":"2024-04-25T12:22:14.953252+0000","last_fullsized":"2024-04-25T12:22:14.953252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:26.319715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.886973+0000","last_change":"2024-04-25T12:21:24.122098+0000","last_active":"2024-04-25T12:22:04.886973+0000","last_peered":"2024-04-25T12:22:04.886973+0000","last_clean":"2024-04-25T12:22:04.886973+0000","last_became_active":"2024-04-25T12:21:24.121392+0000","last_became_peered":"2024-04-25T12:21:24.121392+0000","last_unstale":"2024-04-25T12:22:04.886973+0000","last_undegraded":"2024-04-25T12:22:04.886973+0000","last_fullsized":"2024-04-25T12:22:04.886973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:11:35.116222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.887755+0000","last_change":"2024-04-25T12:21:28.189048+0000","last_active":"2024-04-25T12:22:04.887755+0000","last_peered":"2024-04-25T12:22:04.887755+0000","last_clean":"2024-04-25T12:22:04.887755+0000","last_became_active":"2024-04-25T12:21:28.187340+0000","last_became_peered":"2024-04-25T12:21:28.187340+0000","last_unstale":"2024-04-25T12:22:04.887755+0000","last_undegraded":"2024-04-25T12:22:04.887755+0000","last_fullsized":"2024-04-25T12:22:04.887755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:47:13.797595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.893836+0000","last_change":"2024-04-25T12:21:24.126211+0000","last_active":"2024-04-25T12:22:04.893836+0000","last_peered":"2024-04-25T12:22:04.893836+0000","last_clean":"2024-04-25T12:22:04.893836+0000","last_became_active":"2024-04-25T12:21:24.123695+0000","last_became_peered":"2024-04-25T12:21:24.123695+0000","last_unstale":"2024-04-25T12:22:04.893836+0000","last_undegraded":"2024-04-25T12:22:04.893836+0000","last_fullsized":"2024-04-25T12:22:04.893836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:09:04.327157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"24'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.921191+0000","last_change":"2024-04-25T12:21:23.139676+0000","last_active":"2024-04-25T12:22:04.921191+0000","last_peered":"2024-04-25T12:22:04.921191+0000","last_clean":"2024-04-25T12:22:04.921191+0000","last_became_active":"2024-04-25T12:21:23.139025+0000","last_became_peered":"2024-04-25T12:21:23.139025+0000","last_unstale":"2024-04-25T12:22:04.921191+0000","last_undegraded":"2024-04-25T12:22:04.921191+0000","last_fullsized":"2024-04-25T12:22:04.921191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:43:51.445149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.889613+0000","last_change":"2024-04-25T12:21:28.188852+0000","last_active":"2024-04-25T12:22:04.889613+0000","last_peered":"2024-04-25T12:22:04.889613+0000","last_clean":"2024-04-25T12:22:04.889613+0000","last_became_active":"2024-04-25T12:21:28.187619+0000","last_became_peered":"2024-04-25T12:21:28.187619+0000","last_unstale":"2024-04-25T12:22:04.889613+0000","last_undegraded":"2024-04-25T12:22:04.889613+0000","last_fullsized":"2024-04-25T12:22:04.889613+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:12:14.726245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.888266+0000","last_change":"2024-04-25T12:21:24.136925+0000","last_active":"2024-04-25T12:22:04.888266+0000","last_peered":"2024-04-25T12:22:04.888266+0000","last_clean":"2024-04-25T12:22:04.888266+0000","last_became_active":"2024-04-25T12:21:24.136535+0000","last_became_peered":"2024-04-25T12:21:24.136535+0000","last_unstale":"2024-04-25T12:22:04.888266+0000","last_undegraded":"2024-04-25T12:22:04.888266+0000","last_fullsized":"2024-04-25T12:22:04.888266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:28:23.965010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:08.913144+0000","last_change":"2024-04-25T12:21:23.105571+0000","last_active":"2024-04-25T12:22:08.913144+0000","last_peered":"2024-04-25T12:22:08.913144+0000","last_clean":"2024-04-25T12:22:08.913144+0000","last_became_active":"2024-04-25T12:21:23.105051+0000","last_became_peered":"2024-04-25T12:21:23.105051+0000","last_unstale":"2024-04-25T12:22:08.913144+0000","last_undegraded":"2024-04-25T12:22:08.913144+0000","last_fullsized":"2024-04-25T12:22:08.913144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:52:40.783100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.888765+0000","last_change":"2024-04-25T12:21:28.202632+0000","last_active":"2024-04-25T12:22:04.888765+0000","last_peered":"2024-04-25T12:22:04.888765+0000","last_clean":"2024-04-25T12:22:04.888765+0000","last_became_active":"2024-04-25T12:21:28.201389+0000","last_became_peered":"2024-04-25T12:21:28.201389+0000","last_unstale":"2024-04-25T12:22:04.888765+0000","last_undegraded":"2024-04-25T12:22:04.888765+0000","last_fullsized":"2024-04-25T12:22:04.888765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:48:58.246610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.887395+0000","last_change":"2024-04-25T12:21:24.138749+0000","last_active":"2024-04-25T12:22:04.887395+0000","last_peered":"2024-04-25T12:22:04.887395+0000","last_clean":"2024-04-25T12:22:04.887395+0000","last_became_active":"2024-04-25T12:21:24.138446+0000","last_became_peered":"2024-04-25T12:21:24.138446+0000","last_unstale":"2024-04-25T12:22:04.887395+0000","last_undegraded":"2024-04-25T12:22:04.887395+0000","last_fullsized":"2024-04-25T12:22:04.887395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:22:03.856237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:14.941093+0000","last_change":"2024-04-25T12:21:23.126871+0000","last_active":"2024-04-25T12:22:14.941093+0000","last_peered":"2024-04-25T12:22:14.941093+0000","last_clean":"2024-04-25T12:22:14.941093+0000","last_became_active":"2024-04-25T12:21:23.126521+0000","last_became_peered":"2024-04-25T12:21:23.126521+0000","last_unstale":"2024-04-25T12:22:14.941093+0000","last_undegraded":"2024-04-25T12:22:14.941093+0000","last_fullsized":"2024-04-25T12:22:14.941093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:12:31.353951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.922140+0000","last_change":"2024-04-25T12:21:28.383996+0000","last_active":"2024-04-25T12:22:04.922140+0000","last_peered":"2024-04-25T12:22:04.922140+0000","last_clean":"2024-04-25T12:22:04.922140+0000","last_became_active":"2024-04-25T12:21:28.383568+0000","last_became_peered":"2024-04-25T12:21:28.383568+0000","last_unstale":"2024-04-25T12:22:04.922140+0000","last_undegraded":"2024-04-25T12:22:04.922140+0000","last_fullsized":"2024-04-25T12:22:04.922140+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:19:41.564694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.887535+0000","last_change":"2024-04-25T12:21:24.125112+0000","last_active":"2024-04-25T12:22:04.887535+0000","last_peered":"2024-04-25T12:22:04.887535+0000","last_clean":"2024-04-25T12:22:04.887535+0000","last_became_active":"2024-04-25T12:21:24.121963+0000","last_became_peered":"2024-04-25T12:21:24.121963+0000","last_unstale":"2024-04-25T12:22:04.887535+0000","last_undegraded":"2024-04-25T12:22:04.887535+0000","last_fullsized":"2024-04-25T12:22:04.887535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:33:14.123119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"24'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.919771+0000","last_change":"2024-04-25T12:21:23.117114+0000","last_active":"2024-04-25T12:22:04.919771+0000","last_peered":"2024-04-25T12:22:04.919771+0000","last_clean":"2024-04-25T12:22:04.919771+0000","last_became_active":"2024-04-25T12:21:23.115571+0000","last_became_peered":"2024-04-25T12:21:23.115571+0000","last_unstale":"2024-04-25T12:22:04.919771+0000","last_undegraded":"2024-04-25T12:22:04.919771+0000","last_fullsized":"2024-04-25T12:22:04.919771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:47.838299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.888900+0000","last_change":"2024-04-25T12:21:28.202374+0000","last_active":"2024-04-25T12:22:04.888900+0000","last_peered":"2024-04-25T12:22:04.888900+0000","last_clean":"2024-04-25T12:22:04.888900+0000","last_became_active":"2024-04-25T12:21:28.201297+0000","last_became_peered":"2024-04-25T12:21:28.201297+0000","last_unstale":"2024-04-25T12:22:04.888900+0000","last_undegraded":"2024-04-25T12:22:04.888900+0000","last_fullsized":"2024-04-25T12:22:04.888900+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:13.461169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.899183+0000","last_change":"2024-04-25T12:21:24.133827+0000","last_active":"2024-04-25T12:22:04.899183+0000","last_peered":"2024-04-25T12:22:04.899183+0000","last_clean":"2024-04-25T12:22:04.899183+0000","last_became_active":"2024-04-25T12:21:24.132703+0000","last_became_peered":"2024-04-25T12:21:24.132703+0000","last_unstale":"2024-04-25T12:22:04.899183+0000","last_undegraded":"2024-04-25T12:22:04.899183+0000","last_fullsized":"2024-04-25T12:22:04.899183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:06:22.849827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:14.949919+0000","last_change":"2024-04-25T12:21:23.132331+0000","last_active":"2024-04-25T12:22:14.949919+0000","last_peered":"2024-04-25T12:22:14.949919+0000","last_clean":"2024-04-25T12:22:14.949919+0000","last_became_active":"2024-04-25T12:21:23.131628+0000","last_became_peered":"2024-04-25T12:21:23.131628+0000","last_unstale":"2024-04-25T12:22:14.949919+0000","last_undegraded":"2024-04-25T12:22:14.949919+0000","last_fullsized":"2024-04-25T12:22:14.949919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:19:13.372172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.887229+0000","last_change":"2024-04-25T12:21:28.377407+0000","last_active":"2024-04-25T12:22:04.887229+0000","last_peered":"2024-04-25T12:22:04.887229+0000","last_clean":"2024-04-25T12:22:04.887229+0000","last_became_active":"2024-04-25T12:21:28.376224+0000","last_became_peered":"2024-04-25T12:21:28.376224+0000","last_unstale":"2024-04-25T12:22:04.887229+0000","last_undegraded":"2024-04-25T12:22:04.887229+0000","last_fullsized":"2024-04-25T12:22:04.887229+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:13:02.955979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.888952+0000","last_change":"2024-04-25T12:21:24.145468+0000","last_active":"2024-04-25T12:22:04.888952+0000","last_peered":"2024-04-25T12:22:04.888952+0000","last_clean":"2024-04-25T12:22:04.888952+0000","last_became_active":"2024-04-25T12:21:24.145132+0000","last_became_peered":"2024-04-25T12:21:24.145132+0000","last_unstale":"2024-04-25T12:22:04.888952+0000","last_undegraded":"2024-04-25T12:22:04.888952+0000","last_fullsized":"2024-04-25T12:22:04.888952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:46:44.281270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:08.911698+0000","last_change":"2024-04-25T12:21:23.131029+0000","last_active":"2024-04-25T12:22:08.911698+0000","last_peered":"2024-04-25T12:22:08.911698+0000","last_clean":"2024-04-25T12:22:08.911698+0000","last_became_active":"2024-04-25T12:21:23.130612+0000","last_became_peered":"2024-04-25T12:21:23.130612+0000","last_unstale":"2024-04-25T12:22:08.911698+0000","last_undegraded":"2024-04-25T12:22:08.911698+0000","last_fullsized":"2024-04-25T12:22:08.911698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:02.146986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.885579+0000","last_change":"2024-04-25T12:21:28.375231+0000","last_active":"2024-04-25T12:22:04.885579+0000","last_peered":"2024-04-25T12:22:04.885579+0000","last_clean":"2024-04-25T12:22:04.885579+0000","last_became_active":"2024-04-25T12:21:28.374813+0000","last_became_peered":"2024-04-25T12:21:28.374813+0000","last_unstale":"2024-04-25T12:22:04.885579+0000","last_undegraded":"2024-04-25T12:22:04.885579+0000","last_fullsized":"2024-04-25T12:22:04.885579+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:16.393582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.922376+0000","last_change":"2024-04-25T12:21:24.112280+0000","last_active":"2024-04-25T12:22:04.922376+0000","last_peered":"2024-04-25T12:22:04.922376+0000","last_clean":"2024-04-25T12:22:04.922376+0000","last_became_active":"2024-04-25T12:21:24.111430+0000","last_became_peered":"2024-04-25T12:21:24.111430+0000","last_unstale":"2024-04-25T12:22:04.922376+0000","last_undegraded":"2024-04-25T12:22:04.922376+0000","last_fullsized":"2024-04-25T12:22:04.922376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:58.325720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:08.912181+0000","last_change":"2024-04-25T12:21:23.124271+0000","last_active":"2024-04-25T12:22:08.912181+0000","last_peered":"2024-04-25T12:22:08.912181+0000","last_clean":"2024-04-25T12:22:08.912181+0000","last_became_active":"2024-04-25T12:21:23.123492+0000","last_became_peered":"2024-04-25T12:21:23.123492+0000","last_unstale":"2024-04-25T12:22:08.912181+0000","last_undegraded":"2024-04-25T12:22:08.912181+0000","last_fullsized":"2024-04-25T12:22:08.912181+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:31:09.080478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.896489+0000","last_change":"2024-04-25T12:21:28.375801+0000","last_active":"2024-04-25T12:22:04.896489+0000","last_peered":"2024-04-25T12:22:04.896489+0000","last_clean":"2024-04-25T12:22:04.896489+0000","last_became_active":"2024-04-25T12:21:28.375119+0000","last_became_peered":"2024-04-25T12:21:28.375119+0000","last_unstale":"2024-04-25T12:22:04.896489+0000","last_undegraded":"2024-04-25T12:22:04.896489+0000","last_fullsized":"2024-04-25T12:22:04.896489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:00:29.908954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.886990+0000","last_change":"2024-04-25T12:21:24.131673+0000","last_active":"2024-04-25T12:22:04.886990+0000","last_peered":"2024-04-25T12:22:04.886990+0000","last_clean":"2024-04-25T12:22:04.886990+0000","last_became_active":"2024-04-25T12:21:24.130866+0000","last_became_peered":"2024-04-25T12:21:24.130866+0000","last_unstale":"2024-04-25T12:22:04.886990+0000","last_undegraded":"2024-04-25T12:22:04.886990+0000","last_fullsized":"2024-04-25T12:22:04.886990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:09:04.327157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"26'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.922773+0000","last_change":"2024-04-25T12:21:23.106785+0000","last_active":"2024-04-25T12:22:04.922773+0000","last_peered":"2024-04-25T12:22:04.922773+0000","last_clean":"2024-04-25T12:22:04.922773+0000","last_became_active":"2024-04-25T12:21:23.105809+0000","last_became_peered":"2024-04-25T12:21:23.105809+0000","last_unstale":"2024-04-25T12:22:04.922773+0000","last_undegraded":"2024-04-25T12:22:04.922773+0000","last_fullsized":"2024-04-25T12:22:04.922773+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:17.185116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.920337+0000","last_change":"2024-04-25T12:21:28.193242+0000","last_active":"2024-04-25T12:22:04.920337+0000","last_peered":"2024-04-25T12:22:04.920337+0000","last_clean":"2024-04-25T12:22:04.920337+0000","last_became_active":"2024-04-25T12:21:28.192835+0000","last_became_peered":"2024-04-25T12:21:28.192835+0000","last_unstale":"2024-04-25T12:22:04.920337+0000","last_undegraded":"2024-04-25T12:22:04.920337+0000","last_fullsized":"2024-04-25T12:22:04.920337+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:42:52.476024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.889648+0000","last_change":"2024-04-25T12:21:24.128902+0000","last_active":"2024-04-25T12:22:04.889648+0000","last_peered":"2024-04-25T12:22:04.889648+0000","last_clean":"2024-04-25T12:22:04.889648+0000","last_became_active":"2024-04-25T12:21:24.124563+0000","last_became_peered":"2024-04-25T12:21:24.124563+0000","last_unstale":"2024-04-25T12:22:04.889648+0000","last_undegraded":"2024-04-25T12:22:04.889648+0000","last_fullsized":"2024-04-25T12:22:04.889648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:16.937980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:14.953290+0000","last_change":"2024-04-25T12:21:23.114222+0000","last_active":"2024-04-25T12:22:14.953290+0000","last_peered":"2024-04-25T12:22:14.953290+0000","last_clean":"2024-04-25T12:22:14.953290+0000","last_became_active":"2024-04-25T12:21:23.113504+0000","last_became_peered":"2024-04-25T12:21:23.113504+0000","last_unstale":"2024-04-25T12:22:14.953290+0000","last_undegraded":"2024-04-25T12:22:14.953290+0000","last_fullsized":"2024-04-25T12:22:14.953290+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:37:42.382391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.922111+0000","last_change":"2024-04-25T12:21:28.200532+0000","last_active":"2024-04-25T12:22:04.922111+0000","last_peered":"2024-04-25T12:22:04.922111+0000","last_clean":"2024-04-25T12:22:04.922111+0000","last_became_active":"2024-04-25T12:21:28.200082+0000","last_became_peered":"2024-04-25T12:21:28.200082+0000","last_unstale":"2024-04-25T12:22:04.922111+0000","last_undegraded":"2024-04-25T12:22:04.922111+0000","last_fullsized":"2024-04-25T12:22:04.922111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:24.889665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.920686+0000","last_change":"2024-04-25T12:21:24.112524+0000","last_active":"2024-04-25T12:22:04.920686+0000","last_peered":"2024-04-25T12:22:04.920686+0000","last_clean":"2024-04-25T12:22:04.920686+0000","last_became_active":"2024-04-25T12:21:24.111503+0000","last_became_peered":"2024-04-25T12:21:24.111503+0000","last_unstale":"2024-04-25T12:22:04.920686+0000","last_undegraded":"2024-04-25T12:22:04.920686+0000","last_fullsized":"2024-04-25T12:22:04.920686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:03:35.982959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:14.944694+0000","last_change":"2024-04-25T12:21:23.108434+0000","last_active":"2024-04-25T12:22:14.944694+0000","last_peered":"2024-04-25T12:22:14.944694+0000","last_clean":"2024-04-25T12:22:14.944694+0000","last_became_active":"2024-04-25T12:21:23.108051+0000","last_became_peered":"2024-04-25T12:21:23.108051+0000","last_unstale":"2024-04-25T12:22:14.944694+0000","last_undegraded":"2024-04-25T12:22:14.944694+0000","last_fullsized":"2024-04-25T12:22:14.944694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:49.222950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.922506+0000","last_change":"2024-04-25T12:21:28.189825+0000","last_active":"2024-04-25T12:22:04.922506+0000","last_peered":"2024-04-25T12:22:04.922506+0000","last_clean":"2024-04-25T12:22:04.922506+0000","last_became_active":"2024-04-25T12:21:28.189247+0000","last_became_peered":"2024-04-25T12:21:28.189247+0000","last_unstale":"2024-04-25T12:22:04.922506+0000","last_undegraded":"2024-04-25T12:22:04.922506+0000","last_fullsized":"2024-04-25T12:22:04.922506+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:54:02.752212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.894738+0000","last_change":"2024-04-25T12:21:24.105746+0000","last_active":"2024-04-25T12:22:04.894738+0000","last_peered":"2024-04-25T12:22:04.894738+0000","last_clean":"2024-04-25T12:22:04.894738+0000","last_became_active":"2024-04-25T12:21:24.104947+0000","last_became_peered":"2024-04-25T12:21:24.104947+0000","last_unstale":"2024-04-25T12:22:04.894738+0000","last_undegraded":"2024-04-25T12:22:04.894738+0000","last_fullsized":"2024-04-25T12:22:04.894738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:46:14.853789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.919808+0000","last_change":"2024-04-25T12:21:23.114591+0000","last_active":"2024-04-25T12:22:04.919808+0000","last_peered":"2024-04-25T12:22:04.919808+0000","last_clean":"2024-04-25T12:22:04.919808+0000","last_became_active":"2024-04-25T12:21:23.113829+0000","last_became_peered":"2024-04-25T12:21:23.113829+0000","last_unstale":"2024-04-25T12:22:04.919808+0000","last_undegraded":"2024-04-25T12:22:04.919808+0000","last_fullsized":"2024-04-25T12:22:04.919808+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:51:38.471436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.898786+0000","last_change":"2024-04-25T12:21:28.378024+0000","last_active":"2024-04-25T12:22:04.898786+0000","last_peered":"2024-04-25T12:22:04.898786+0000","last_clean":"2024-04-25T12:22:04.898786+0000","last_became_active":"2024-04-25T12:21:28.377639+0000","last_became_peered":"2024-04-25T12:21:28.377639+0000","last_unstale":"2024-04-25T12:22:04.898786+0000","last_undegraded":"2024-04-25T12:22:04.898786+0000","last_fullsized":"2024-04-25T12:22:04.898786+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:18:40.723659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.886368+0000","last_change":"2024-04-25T12:21:24.120719+0000","last_active":"2024-04-25T12:22:04.886368+0000","last_peered":"2024-04-25T12:22:04.886368+0000","last_clean":"2024-04-25T12:22:04.886368+0000","last_became_active":"2024-04-25T12:21:24.119870+0000","last_became_peered":"2024-04-25T12:21:24.119870+0000","last_unstale":"2024-04-25T12:22:04.886368+0000","last_undegraded":"2024-04-25T12:22:04.886368+0000","last_fullsized":"2024-04-25T12:22:04.886368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:53:15.175473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:08.909810+0000","last_change":"2024-04-25T12:21:23.103524+0000","last_active":"2024-04-25T12:22:08.909810+0000","last_peered":"2024-04-25T12:22:08.909810+0000","last_clean":"2024-04-25T12:22:08.909810+0000","last_became_active":"2024-04-25T12:21:23.102790+0000","last_became_peered":"2024-04-25T12:21:23.102790+0000","last_unstale":"2024-04-25T12:22:08.909810+0000","last_undegraded":"2024-04-25T12:22:08.909810+0000","last_fullsized":"2024-04-25T12:22:08.909810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:15:54.796303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":182,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.919869+0000","last_change":"2024-04-25T12:21:13.081186+0000","last_active":"2024-04-25T12:22:04.919869+0000","last_peered":"2024-04-25T12:22:04.919869+0000","last_clean":"2024-04-25T12:22:04.919869+0000","last_became_active":"2024-04-25T12:21:13.076753+0000","last_became_peered":"2024-04-25T12:21:13.076753+0000","last_unstale":"2024-04-25T12:22:04.919869+0000","last_undegraded":"2024-04-25T12:22:04.919869+0000","last_fullsized":"2024-04-25T12:22:04.919869+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:12.013694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:12.013694+0000","last_clean_scrub_stamp":"2024-04-25T12:21:12.013694+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:18:03.288120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.894131+0000","last_change":"2024-04-25T12:21:28.379372+0000","last_active":"2024-04-25T12:22:04.894131+0000","last_peered":"2024-04-25T12:22:04.894131+0000","last_clean":"2024-04-25T12:22:04.894131+0000","last_became_active":"2024-04-25T12:21:28.378522+0000","last_became_peered":"2024-04-25T12:21:28.378522+0000","last_unstale":"2024-04-25T12:22:04.894131+0000","last_undegraded":"2024-04-25T12:22:04.894131+0000","last_fullsized":"2024-04-25T12:22:04.894131+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:54:35.288829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.921450+0000","last_change":"2024-04-25T12:21:24.144632+0000","last_active":"2024-04-25T12:22:04.921450+0000","last_peered":"2024-04-25T12:22:04.921450+0000","last_clean":"2024-04-25T12:22:04.921450+0000","last_became_active":"2024-04-25T12:21:24.142085+0000","last_became_peered":"2024-04-25T12:21:24.142085+0000","last_unstale":"2024-04-25T12:22:04.921450+0000","last_undegraded":"2024-04-25T12:22:04.921450+0000","last_fullsized":"2024-04-25T12:22:04.921450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:16:55.634329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:23.478572+0000","last_change":"2024-04-25T12:21:23.126527+0000","last_active":"2024-04-25T12:22:23.478572+0000","last_peered":"2024-04-25T12:22:23.478572+0000","last_clean":"2024-04-25T12:22:23.478572+0000","last_became_active":"2024-04-25T12:21:23.126103+0000","last_became_peered":"2024-04-25T12:21:23.126103+0000","last_unstale":"2024-04-25T12:22:23.478572+0000","last_undegraded":"2024-04-25T12:22:23.478572+0000","last_fullsized":"2024-04-25T12:22:23.478572+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:16:36.502824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.891785+0000","last_change":"2024-04-25T12:21:28.379480+0000","last_active":"2024-04-25T12:22:04.891785+0000","last_peered":"2024-04-25T12:22:04.891785+0000","last_clean":"2024-04-25T12:22:04.891785+0000","last_became_active":"2024-04-25T12:21:28.378559+0000","last_became_peered":"2024-04-25T12:21:28.378559+0000","last_unstale":"2024-04-25T12:22:04.891785+0000","last_undegraded":"2024-04-25T12:22:04.891785+0000","last_fullsized":"2024-04-25T12:22:04.891785+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:40.975592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.886708+0000","last_change":"2024-04-25T12:21:24.129518+0000","last_active":"2024-04-25T12:22:04.886708+0000","last_peered":"2024-04-25T12:22:04.886708+0000","last_clean":"2024-04-25T12:22:04.886708+0000","last_became_active":"2024-04-25T12:21:24.126968+0000","last_became_peered":"2024-04-25T12:21:24.126968+0000","last_unstale":"2024-04-25T12:22:04.886708+0000","last_undegraded":"2024-04-25T12:22:04.886708+0000","last_fullsized":"2024-04-25T12:22:04.886708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:49.243645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:08.913274+0000","last_change":"2024-04-25T12:21:23.116529+0000","last_active":"2024-04-25T12:22:08.913274+0000","last_peered":"2024-04-25T12:22:08.913274+0000","last_clean":"2024-04-25T12:22:08.913274+0000","last_became_active":"2024-04-25T12:21:23.116148+0000","last_became_peered":"2024-04-25T12:21:23.116148+0000","last_unstale":"2024-04-25T12:22:08.913274+0000","last_undegraded":"2024-04-25T12:22:08.913274+0000","last_fullsized":"2024-04-25T12:22:08.913274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:01:45.567238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.897064+0000","last_change":"2024-04-25T12:21:28.194823+0000","last_active":"2024-04-25T12:22:04.897064+0000","last_peered":"2024-04-25T12:22:04.897064+0000","last_clean":"2024-04-25T12:22:04.897064+0000","last_became_active":"2024-04-25T12:21:28.194191+0000","last_became_peered":"2024-04-25T12:21:28.194191+0000","last_unstale":"2024-04-25T12:22:04.897064+0000","last_undegraded":"2024-04-25T12:22:04.897064+0000","last_fullsized":"2024-04-25T12:22:04.897064+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:50:30.454926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.921672+0000","last_change":"2024-04-25T12:21:24.146733+0000","last_active":"2024-04-25T12:22:04.921672+0000","last_peered":"2024-04-25T12:22:04.921672+0000","last_clean":"2024-04-25T12:22:04.921672+0000","last_became_active":"2024-04-25T12:21:24.145807+0000","last_became_peered":"2024-04-25T12:21:24.145807+0000","last_unstale":"2024-04-25T12:22:04.921672+0000","last_undegraded":"2024-04-25T12:22:04.921672+0000","last_fullsized":"2024-04-25T12:22:04.921672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:07:35.092827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:14.944106+0000","last_change":"2024-04-25T12:21:23.103393+0000","last_active":"2024-04-25T12:22:14.944106+0000","last_peered":"2024-04-25T12:22:14.944106+0000","last_clean":"2024-04-25T12:22:14.944106+0000","last_became_active":"2024-04-25T12:21:23.102997+0000","last_became_peered":"2024-04-25T12:21:23.102997+0000","last_unstale":"2024-04-25T12:22:14.944106+0000","last_undegraded":"2024-04-25T12:22:14.944106+0000","last_fullsized":"2024-04-25T12:22:14.944106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:40:23.054158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.885200+0000","last_change":"2024-04-25T12:21:28.384645+0000","last_active":"2024-04-25T12:22:04.885200+0000","last_peered":"2024-04-25T12:22:04.885200+0000","last_clean":"2024-04-25T12:22:04.885200+0000","last_became_active":"2024-04-25T12:21:28.382953+0000","last_became_peered":"2024-04-25T12:21:28.382953+0000","last_unstale":"2024-04-25T12:22:04.885200+0000","last_undegraded":"2024-04-25T12:22:04.885200+0000","last_fullsized":"2024-04-25T12:22:04.885200+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:40:56.218533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.920897+0000","last_change":"2024-04-25T12:21:24.146557+0000","last_active":"2024-04-25T12:22:04.920897+0000","last_peered":"2024-04-25T12:22:04.920897+0000","last_clean":"2024-04-25T12:22:04.920897+0000","last_became_active":"2024-04-25T12:21:24.146162+0000","last_became_peered":"2024-04-25T12:21:24.146162+0000","last_unstale":"2024-04-25T12:22:04.920897+0000","last_undegraded":"2024-04-25T12:22:04.920897+0000","last_fullsized":"2024-04-25T12:22:04.920897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:09:00.995503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.889472+0000","last_change":"2024-04-25T12:21:23.135467+0000","last_active":"2024-04-25T12:22:04.889472+0000","last_peered":"2024-04-25T12:22:04.889472+0000","last_clean":"2024-04-25T12:22:04.889472+0000","last_became_active":"2024-04-25T12:21:23.134441+0000","last_became_peered":"2024-04-25T12:21:23.134441+0000","last_unstale":"2024-04-25T12:22:04.889472+0000","last_undegraded":"2024-04-25T12:22:04.889472+0000","last_fullsized":"2024-04-25T12:22:04.889472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:44:33.069221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.886118+0000","last_change":"2024-04-25T12:21:28.202610+0000","last_active":"2024-04-25T12:22:04.886118+0000","last_peered":"2024-04-25T12:22:04.886118+0000","last_clean":"2024-04-25T12:22:04.886118+0000","last_became_active":"2024-04-25T12:21:28.201479+0000","last_became_peered":"2024-04-25T12:21:28.201479+0000","last_unstale":"2024-04-25T12:22:04.886118+0000","last_undegraded":"2024-04-25T12:22:04.886118+0000","last_fullsized":"2024-04-25T12:22:04.886118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:25:15.458202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.920270+0000","last_change":"2024-04-25T12:21:24.145131+0000","last_active":"2024-04-25T12:22:04.920270+0000","last_peered":"2024-04-25T12:22:04.920270+0000","last_clean":"2024-04-25T12:22:04.920270+0000","last_became_active":"2024-04-25T12:21:24.142422+0000","last_became_peered":"2024-04-25T12:21:24.142422+0000","last_unstale":"2024-04-25T12:22:04.920270+0000","last_undegraded":"2024-04-25T12:22:04.920270+0000","last_fullsized":"2024-04-25T12:22:04.920270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:40:24.312543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'17","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:08.910633+0000","last_change":"2024-04-25T12:21:23.104288+0000","last_active":"2024-04-25T12:22:08.910633+0000","last_peered":"2024-04-25T12:22:08.910633+0000","last_clean":"2024-04-25T12:22:08.910633+0000","last_became_active":"2024-04-25T12:21:23.103680+0000","last_became_peered":"2024-04-25T12:21:23.103680+0000","last_unstale":"2024-04-25T12:22:08.910633+0000","last_undegraded":"2024-04-25T12:22:08.910633+0000","last_fullsized":"2024-04-25T12:22:08.910633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:29.672890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.898513+0000","last_change":"2024-04-25T12:21:28.199834+0000","last_active":"2024-04-25T12:22:04.898513+0000","last_peered":"2024-04-25T12:22:04.898513+0000","last_clean":"2024-04-25T12:22:04.898513+0000","last_became_active":"2024-04-25T12:21:28.199411+0000","last_became_peered":"2024-04-25T12:21:28.199411+0000","last_unstale":"2024-04-25T12:22:04.898513+0000","last_undegraded":"2024-04-25T12:22:04.898513+0000","last_fullsized":"2024-04-25T12:22:04.898513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:52:34.443813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.892493+0000","last_change":"2024-04-25T12:21:24.127488+0000","last_active":"2024-04-25T12:22:04.892493+0000","last_peered":"2024-04-25T12:22:04.892493+0000","last_clean":"2024-04-25T12:22:04.892493+0000","last_became_active":"2024-04-25T12:21:24.126721+0000","last_became_peered":"2024-04-25T12:21:24.126721+0000","last_unstale":"2024-04-25T12:22:04.892493+0000","last_undegraded":"2024-04-25T12:22:04.892493+0000","last_fullsized":"2024-04-25T12:22:04.892493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:02.153025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:23.488464+0000","last_change":"2024-04-25T12:21:23.139626+0000","last_active":"2024-04-25T12:22:23.488464+0000","last_peered":"2024-04-25T12:22:23.488464+0000","last_clean":"2024-04-25T12:22:23.488464+0000","last_became_active":"2024-04-25T12:21:23.138837+0000","last_became_peered":"2024-04-25T12:21:23.138837+0000","last_unstale":"2024-04-25T12:22:23.488464+0000","last_undegraded":"2024-04-25T12:22:23.488464+0000","last_fullsized":"2024-04-25T12:22:23.488464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:09.309384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.888695+0000","last_change":"2024-04-25T12:21:28.383919+0000","last_active":"2024-04-25T12:22:04.888695+0000","last_peered":"2024-04-25T12:22:04.888695+0000","last_clean":"2024-04-25T12:22:04.888695+0000","last_became_active":"2024-04-25T12:21:28.383298+0000","last_became_peered":"2024-04-25T12:21:28.383298+0000","last_unstale":"2024-04-25T12:22:04.888695+0000","last_undegraded":"2024-04-25T12:22:04.888695+0000","last_fullsized":"2024-04-25T12:22:04.888695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:01.115040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.921039+0000","last_change":"2024-04-25T12:21:24.146454+0000","last_active":"2024-04-25T12:22:04.921039+0000","last_peered":"2024-04-25T12:22:04.921039+0000","last_clean":"2024-04-25T12:22:04.921039+0000","last_became_active":"2024-04-25T12:21:24.145931+0000","last_became_peered":"2024-04-25T12:21:24.145931+0000","last_unstale":"2024-04-25T12:22:04.921039+0000","last_undegraded":"2024-04-25T12:22:04.921039+0000","last_fullsized":"2024-04-25T12:22:04.921039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:35:22.490243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:08.909090+0000","last_change":"2024-04-25T12:21:23.122495+0000","last_active":"2024-04-25T12:22:08.909090+0000","last_peered":"2024-04-25T12:22:08.909090+0000","last_clean":"2024-04-25T12:22:08.909090+0000","last_became_active":"2024-04-25T12:21:23.121429+0000","last_became_peered":"2024-04-25T12:21:23.121429+0000","last_unstale":"2024-04-25T12:22:08.909090+0000","last_undegraded":"2024-04-25T12:22:08.909090+0000","last_fullsized":"2024-04-25T12:22:08.909090+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:10.530248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.886402+0000","last_change":"2024-04-25T12:21:28.375971+0000","last_active":"2024-04-25T12:22:04.886402+0000","last_peered":"2024-04-25T12:22:04.886402+0000","last_clean":"2024-04-25T12:22:04.886402+0000","last_became_active":"2024-04-25T12:21:28.375013+0000","last_became_peered":"2024-04-25T12:21:28.375013+0000","last_unstale":"2024-04-25T12:22:04.886402+0000","last_undegraded":"2024-04-25T12:22:04.886402+0000","last_fullsized":"2024-04-25T12:22:04.886402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:56:45.398763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.895854+0000","last_change":"2024-04-25T12:21:24.138293+0000","last_active":"2024-04-25T12:22:04.895854+0000","last_peered":"2024-04-25T12:22:04.895854+0000","last_clean":"2024-04-25T12:22:04.895854+0000","last_became_active":"2024-04-25T12:21:24.138016+0000","last_became_peered":"2024-04-25T12:21:24.138016+0000","last_unstale":"2024-04-25T12:22:04.895854+0000","last_undegraded":"2024-04-25T12:22:04.895854+0000","last_fullsized":"2024-04-25T12:22:04.895854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:48:54.078239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'9","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:14.940825+0000","last_change":"2024-04-25T12:21:23.136227+0000","last_active":"2024-04-25T12:22:14.940825+0000","last_peered":"2024-04-25T12:22:14.940825+0000","last_clean":"2024-04-25T12:22:14.940825+0000","last_became_active":"2024-04-25T12:21:23.135947+0000","last_became_peered":"2024-04-25T12:21:23.135947+0000","last_unstale":"2024-04-25T12:22:14.940825+0000","last_undegraded":"2024-04-25T12:22:14.940825+0000","last_fullsized":"2024-04-25T12:22:14.940825+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:41:24.323924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.886878+0000","last_change":"2024-04-25T12:21:28.378564+0000","last_active":"2024-04-25T12:22:04.886878+0000","last_peered":"2024-04-25T12:22:04.886878+0000","last_clean":"2024-04-25T12:22:04.886878+0000","last_became_active":"2024-04-25T12:21:28.377532+0000","last_became_peered":"2024-04-25T12:21:28.377532+0000","last_unstale":"2024-04-25T12:22:04.886878+0000","last_undegraded":"2024-04-25T12:22:04.886878+0000","last_fullsized":"2024-04-25T12:22:04.886878+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:20.576562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.902496+0000","last_change":"2024-04-25T12:22:04.900963+0000","last_active":"2024-04-25T12:22:04.902496+0000","last_peered":"2024-04-25T12:22:04.902496+0000","last_clean":"2024-04-25T12:22:04.902496+0000","last_became_active":"2024-04-25T12:22:04.899942+0000","last_became_peered":"2024-04-25T12:22:04.899942+0000","last_unstale":"2024-04-25T12:22:04.902496+0000","last_undegraded":"2024-04-25T12:22:04.902496+0000","last_fullsized":"2024-04-25T12:22:04.902496+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:34:36.179214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.14","version":"26'16","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:23.494045+0000","last_change":"2024-04-25T12:21:23.130231+0000","last_active":"2024-04-25T12:22:23.494045+0000","last_peered":"2024-04-25T12:22:23.494045+0000","last_clean":"2024-04-25T12:22:23.494045+0000","last_became_active":"2024-04-25T12:21:23.129474+0000","last_became_peered":"2024-04-25T12:21:23.129474+0000","last_unstale":"2024-04-25T12:22:23.494045+0000","last_undegraded":"2024-04-25T12:22:23.494045+0000","last_fullsized":"2024-04-25T12:22:23.494045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:50.974387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4424,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.920504+0000","last_change":"2024-04-25T12:21:28.200551+0000","last_active":"2024-04-25T12:22:04.920504+0000","last_peered":"2024-04-25T12:22:04.920504+0000","last_clean":"2024-04-25T12:22:04.920504+0000","last_became_active":"2024-04-25T12:21:28.200152+0000","last_became_peered":"2024-04-25T12:21:28.200152+0000","last_unstale":"2024-04-25T12:22:04.920504+0000","last_undegraded":"2024-04-25T12:22:04.920504+0000","last_fullsized":"2024-04-25T12:22:04.920504+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:17:34.847925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.889734+0000","last_change":"2024-04-25T12:21:24.142957+0000","last_active":"2024-04-25T12:22:04.889734+0000","last_peered":"2024-04-25T12:22:04.889734+0000","last_clean":"2024-04-25T12:22:04.889734+0000","last_became_active":"2024-04-25T12:21:24.142594+0000","last_became_peered":"2024-04-25T12:21:24.142594+0000","last_unstale":"2024-04-25T12:22:04.889734+0000","last_undegraded":"2024-04-25T12:22:04.889734+0000","last_fullsized":"2024-04-25T12:22:04.889734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:36:47.719946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.922151+0000","last_change":"2024-04-25T12:21:23.125118+0000","last_active":"2024-04-25T12:22:04.922151+0000","last_peered":"2024-04-25T12:22:04.922151+0000","last_clean":"2024-04-25T12:22:04.922151+0000","last_became_active":"2024-04-25T12:21:23.124836+0000","last_became_peered":"2024-04-25T12:21:23.124836+0000","last_unstale":"2024-04-25T12:22:04.922151+0000","last_undegraded":"2024-04-25T12:22:04.922151+0000","last_fullsized":"2024-04-25T12:22:04.922151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:03:28.500940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.889244+0000","last_change":"2024-04-25T12:21:28.194476+0000","last_active":"2024-04-25T12:22:04.889244+0000","last_peered":"2024-04-25T12:22:04.889244+0000","last_clean":"2024-04-25T12:22:04.889244+0000","last_became_active":"2024-04-25T12:21:28.193277+0000","last_became_peered":"2024-04-25T12:21:28.193277+0000","last_unstale":"2024-04-25T12:22:04.889244+0000","last_undegraded":"2024-04-25T12:22:04.889244+0000","last_fullsized":"2024-04-25T12:22:04.889244+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:31.495441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.898278+0000","last_change":"2024-04-25T12:21:24.115104+0000","last_active":"2024-04-25T12:22:04.898278+0000","last_peered":"2024-04-25T12:22:04.898278+0000","last_clean":"2024-04-25T12:22:04.898278+0000","last_became_active":"2024-04-25T12:21:24.114367+0000","last_became_peered":"2024-04-25T12:21:24.114367+0000","last_unstale":"2024-04-25T12:22:04.898278+0000","last_undegraded":"2024-04-25T12:22:04.898278+0000","last_fullsized":"2024-04-25T12:22:04.898278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:03.107076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:14.951344+0000","last_change":"2024-04-25T12:21:23.132996+0000","last_active":"2024-04-25T12:22:14.951344+0000","last_peered":"2024-04-25T12:22:14.951344+0000","last_clean":"2024-04-25T12:22:14.951344+0000","last_became_active":"2024-04-25T12:21:23.132223+0000","last_became_peered":"2024-04-25T12:21:23.132223+0000","last_unstale":"2024-04-25T12:22:14.951344+0000","last_undegraded":"2024-04-25T12:22:14.951344+0000","last_fullsized":"2024-04-25T12:22:14.951344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:18.689461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.886057+0000","last_change":"2024-04-25T12:21:28.203302+0000","last_active":"2024-04-25T12:22:04.886057+0000","last_peered":"2024-04-25T12:22:04.886057+0000","last_clean":"2024-04-25T12:22:04.886057+0000","last_became_active":"2024-04-25T12:21:28.202800+0000","last_became_peered":"2024-04-25T12:21:28.202800+0000","last_unstale":"2024-04-25T12:22:04.886057+0000","last_undegraded":"2024-04-25T12:22:04.886057+0000","last_fullsized":"2024-04-25T12:22:04.886057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:27:16.676736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.925107+0000","last_change":"2024-04-25T12:22:04.922613+0000","last_active":"2024-04-25T12:22:04.925107+0000","last_peered":"2024-04-25T12:22:04.925107+0000","last_clean":"2024-04-25T12:22:04.925107+0000","last_became_active":"2024-04-25T12:22:04.921770+0000","last_became_peered":"2024-04-25T12:22:04.921770+0000","last_unstale":"2024-04-25T12:22:04.925107+0000","last_undegraded":"2024-04-25T12:22:04.925107+0000","last_fullsized":"2024-04-25T12:22:04.925107+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:19:15.639901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"26'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:23.484338+0000","last_change":"2024-04-25T12:21:23.130843+0000","last_active":"2024-04-25T12:22:23.484338+0000","last_peered":"2024-04-25T12:22:23.484338+0000","last_clean":"2024-04-25T12:22:23.484338+0000","last_became_active":"2024-04-25T12:21:23.129967+0000","last_became_peered":"2024-04-25T12:21:23.129967+0000","last_unstale":"2024-04-25T12:22:23.484338+0000","last_undegraded":"2024-04-25T12:22:23.484338+0000","last_fullsized":"2024-04-25T12:22:23.484338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:19:22.719364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.885925+0000","last_change":"2024-04-25T12:21:28.384082+0000","last_active":"2024-04-25T12:22:04.885925+0000","last_peered":"2024-04-25T12:22:04.885925+0000","last_clean":"2024-04-25T12:22:04.885925+0000","last_became_active":"2024-04-25T12:21:28.383228+0000","last_became_peered":"2024-04-25T12:21:28.383228+0000","last_unstale":"2024-04-25T12:22:04.885925+0000","last_undegraded":"2024-04-25T12:22:04.885925+0000","last_fullsized":"2024-04-25T12:22:04.885925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:14.600341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.898196+0000","last_change":"2024-04-25T12:21:28.378352+0000","last_active":"2024-04-25T12:22:04.898196+0000","last_peered":"2024-04-25T12:22:04.898196+0000","last_clean":"2024-04-25T12:22:04.898196+0000","last_became_active":"2024-04-25T12:21:28.377742+0000","last_became_peered":"2024-04-25T12:21:28.377742+0000","last_unstale":"2024-04-25T12:22:04.898196+0000","last_undegraded":"2024-04-25T12:22:04.898196+0000","last_fullsized":"2024-04-25T12:22:04.898196+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:20.075296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.920494+0000","last_change":"2024-04-25T12:21:24.126158+0000","last_active":"2024-04-25T12:22:04.920494+0000","last_peered":"2024-04-25T12:22:04.920494+0000","last_clean":"2024-04-25T12:22:04.920494+0000","last_became_active":"2024-04-25T12:21:24.125448+0000","last_became_peered":"2024-04-25T12:21:24.125448+0000","last_unstale":"2024-04-25T12:22:04.920494+0000","last_undegraded":"2024-04-25T12:22:04.920494+0000","last_fullsized":"2024-04-25T12:22:04.920494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:42.769206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:08.908401+0000","last_change":"2024-04-25T12:21:23.117159+0000","last_active":"2024-04-25T12:22:08.908401+0000","last_peered":"2024-04-25T12:22:08.908401+0000","last_clean":"2024-04-25T12:22:08.908401+0000","last_became_active":"2024-04-25T12:21:23.115911+0000","last_became_peered":"2024-04-25T12:21:23.115911+0000","last_unstale":"2024-04-25T12:22:08.908401+0000","last_undegraded":"2024-04-25T12:22:08.908401+0000","last_fullsized":"2024-04-25T12:22:08.908401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:46:10.238958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.900044+0000","last_change":"2024-04-25T12:22:04.900044+0000","last_active":"2024-04-25T12:22:04.900044+0000","last_peered":"2024-04-25T12:22:04.900044+0000","last_clean":"2024-04-25T12:22:04.900044+0000","last_became_active":"2024-04-25T12:22:04.899300+0000","last_became_peered":"2024-04-25T12:22:04.899300+0000","last_unstale":"2024-04-25T12:22:04.900044+0000","last_undegraded":"2024-04-25T12:22:04.900044+0000","last_fullsized":"2024-04-25T12:22:04.900044+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:00:51.607957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,0],"acting":[6,5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.886379+0000","last_change":"2024-04-25T12:21:24.137477+0000","last_active":"2024-04-25T12:22:04.886379+0000","last_peered":"2024-04-25T12:22:04.886379+0000","last_clean":"2024-04-25T12:22:04.886379+0000","last_became_active":"2024-04-25T12:21:24.137078+0000","last_became_peered":"2024-04-25T12:21:24.137078+0000","last_unstale":"2024-04-25T12:22:04.886379+0000","last_undegraded":"2024-04-25T12:22:04.886379+0000","last_fullsized":"2024-04-25T12:22:04.886379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:53.321239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.886985+0000","last_change":"2024-04-25T12:21:23.130046+0000","last_active":"2024-04-25T12:22:04.886985+0000","last_peered":"2024-04-25T12:22:04.886985+0000","last_clean":"2024-04-25T12:22:04.886985+0000","last_became_active":"2024-04-25T12:21:23.129779+0000","last_became_peered":"2024-04-25T12:21:23.129779+0000","last_unstale":"2024-04-25T12:22:04.886985+0000","last_undegraded":"2024-04-25T12:22:04.886985+0000","last_fullsized":"2024-04-25T12:22:04.886985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:24:43.733780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:08.910854+0000","last_change":"2024-04-25T12:21:23.138152+0000","last_active":"2024-04-25T12:22:08.910854+0000","last_peered":"2024-04-25T12:22:08.910854+0000","last_clean":"2024-04-25T12:22:08.910854+0000","last_became_active":"2024-04-25T12:21:23.137393+0000","last_became_peered":"2024-04-25T12:21:23.137393+0000","last_unstale":"2024-04-25T12:22:08.910854+0000","last_undegraded":"2024-04-25T12:22:08.910854+0000","last_fullsized":"2024-04-25T12:22:08.910854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:10:42.713304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.897354+0000","last_change":"2024-04-25T12:21:24.122299+0000","last_active":"2024-04-25T12:22:04.897354+0000","last_peered":"2024-04-25T12:22:04.897354+0000","last_clean":"2024-04-25T12:22:04.897354+0000","last_became_active":"2024-04-25T12:21:24.121480+0000","last_became_peered":"2024-04-25T12:21:24.121480+0000","last_unstale":"2024-04-25T12:22:04.897354+0000","last_undegraded":"2024-04-25T12:22:04.897354+0000","last_fullsized":"2024-04-25T12:22:04.897354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:05:46.050357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.900613+0000","last_change":"2024-04-25T12:22:04.900613+0000","last_active":"2024-04-25T12:22:04.900613+0000","last_peered":"2024-04-25T12:22:04.900613+0000","last_clean":"2024-04-25T12:22:04.900613+0000","last_became_active":"2024-04-25T12:22:04.900006+0000","last_became_peered":"2024-04-25T12:22:04.900006+0000","last_unstale":"2024-04-25T12:22:04.900613+0000","last_undegraded":"2024-04-25T12:22:04.900613+0000","last_fullsized":"2024-04-25T12:22:04.900613+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:06:18.454386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,5],"acting":[2,0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:23.483056+0000","last_change":"2024-04-25T12:21:23.113080+0000","last_active":"2024-04-25T12:22:23.483056+0000","last_peered":"2024-04-25T12:22:23.483056+0000","last_clean":"2024-04-25T12:22:23.483056+0000","last_became_active":"2024-04-25T12:21:23.112721+0000","last_became_peered":"2024-04-25T12:21:23.112721+0000","last_unstale":"2024-04-25T12:22:23.483056+0000","last_undegraded":"2024-04-25T12:22:23.483056+0000","last_fullsized":"2024-04-25T12:22:23.483056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:25.396377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.888327+0000","last_change":"2024-04-25T12:21:24.134267+0000","last_active":"2024-04-25T12:22:04.888327+0000","last_peered":"2024-04-25T12:22:04.888327+0000","last_clean":"2024-04-25T12:22:04.888327+0000","last_became_active":"2024-04-25T12:21:24.133493+0000","last_became_peered":"2024-04-25T12:21:24.133493+0000","last_unstale":"2024-04-25T12:22:04.888327+0000","last_undegraded":"2024-04-25T12:22:04.888327+0000","last_fullsized":"2024-04-25T12:22:04.888327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:24:25.810067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.896184+0000","last_change":"2024-04-25T12:22:04.896184+0000","last_active":"2024-04-25T12:22:04.896184+0000","last_peered":"2024-04-25T12:22:04.896184+0000","last_clean":"2024-04-25T12:22:04.896184+0000","last_became_active":"2024-04-25T12:22:04.895198+0000","last_became_peered":"2024-04-25T12:22:04.895198+0000","last_unstale":"2024-04-25T12:22:04.896184+0000","last_undegraded":"2024-04-25T12:22:04.896184+0000","last_fullsized":"2024-04-25T12:22:04.896184+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:00.687023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,2],"acting":[3,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.892094+0000","last_change":"2024-04-25T12:21:24.126582+0000","last_active":"2024-04-25T12:22:04.892094+0000","last_peered":"2024-04-25T12:22:04.892094+0000","last_clean":"2024-04-25T12:22:04.892094+0000","last_became_active":"2024-04-25T12:21:24.125831+0000","last_became_peered":"2024-04-25T12:21:24.125831+0000","last_unstale":"2024-04-25T12:22:04.892094+0000","last_undegraded":"2024-04-25T12:22:04.892094+0000","last_fullsized":"2024-04-25T12:22:04.892094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:53.129274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.891228+0000","last_change":"2024-04-25T12:21:24.117441+0000","last_active":"2024-04-25T12:22:04.891228+0000","last_peered":"2024-04-25T12:22:04.891228+0000","last_clean":"2024-04-25T12:22:04.891228+0000","last_became_active":"2024-04-25T12:21:24.116498+0000","last_became_peered":"2024-04-25T12:21:24.116498+0000","last_unstale":"2024-04-25T12:22:04.891228+0000","last_undegraded":"2024-04-25T12:22:04.891228+0000","last_fullsized":"2024-04-25T12:22:04.891228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:06:45.632199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.886040+0000","last_change":"2024-04-25T12:21:24.117995+0000","last_active":"2024-04-25T12:22:04.886040+0000","last_peered":"2024-04-25T12:22:04.886040+0000","last_clean":"2024-04-25T12:22:04.886040+0000","last_became_active":"2024-04-25T12:21:24.114742+0000","last_became_peered":"2024-04-25T12:21:24.114742+0000","last_unstale":"2024-04-25T12:22:04.886040+0000","last_undegraded":"2024-04-25T12:22:04.886040+0000","last_fullsized":"2024-04-25T12:22:04.886040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:59.864082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.897343+0000","last_change":"2024-04-25T12:21:24.134863+0000","last_active":"2024-04-25T12:22:04.897343+0000","last_peered":"2024-04-25T12:22:04.897343+0000","last_clean":"2024-04-25T12:22:04.897343+0000","last_became_active":"2024-04-25T12:21:24.126476+0000","last_became_peered":"2024-04-25T12:21:24.126476+0000","last_unstale":"2024-04-25T12:22:04.897343+0000","last_undegraded":"2024-04-25T12:22:04.897343+0000","last_fullsized":"2024-04-25T12:22:04.897343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:19:32.516429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.887326+0000","last_change":"2024-04-25T12:21:24.135699+0000","last_active":"2024-04-25T12:22:04.887326+0000","last_peered":"2024-04-25T12:22:04.887326+0000","last_clean":"2024-04-25T12:22:04.887326+0000","last_became_active":"2024-04-25T12:21:24.135257+0000","last_became_peered":"2024-04-25T12:21:24.135257+0000","last_unstale":"2024-04-25T12:22:04.887326+0000","last_undegraded":"2024-04-25T12:22:04.887326+0000","last_fullsized":"2024-04-25T12:22:04.887326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:55:21.195220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.921749+0000","last_change":"2024-04-25T12:21:24.132760+0000","last_active":"2024-04-25T12:22:04.921749+0000","last_peered":"2024-04-25T12:22:04.921749+0000","last_clean":"2024-04-25T12:22:04.921749+0000","last_became_active":"2024-04-25T12:21:24.132225+0000","last_became_peered":"2024-04-25T12:21:24.132225+0000","last_unstale":"2024-04-25T12:22:04.921749+0000","last_undegraded":"2024-04-25T12:22:04.921749+0000","last_fullsized":"2024-04-25T12:22:04.921749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:44:23.025905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.895018+0000","last_change":"2024-04-25T12:21:24.148515+0000","last_active":"2024-04-25T12:22:04.895018+0000","last_peered":"2024-04-25T12:22:04.895018+0000","last_clean":"2024-04-25T12:22:04.895018+0000","last_became_active":"2024-04-25T12:21:24.148025+0000","last_became_peered":"2024-04-25T12:21:24.148025+0000","last_unstale":"2024-04-25T12:22:04.895018+0000","last_undegraded":"2024-04-25T12:22:04.895018+0000","last_fullsized":"2024-04-25T12:22:04.895018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:49:29.665678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.888799+0000","last_change":"2024-04-25T12:21:24.135856+0000","last_active":"2024-04-25T12:22:04.888799+0000","last_peered":"2024-04-25T12:22:04.888799+0000","last_clean":"2024-04-25T12:22:04.888799+0000","last_became_active":"2024-04-25T12:21:24.135310+0000","last_became_peered":"2024-04-25T12:21:24.135310+0000","last_unstale":"2024-04-25T12:22:04.888799+0000","last_undegraded":"2024-04-25T12:22:04.888799+0000","last_fullsized":"2024-04-25T12:22:04.888799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:02.396753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.885451+0000","last_change":"2024-04-25T12:21:24.119002+0000","last_active":"2024-04-25T12:22:04.885451+0000","last_peered":"2024-04-25T12:22:04.885451+0000","last_clean":"2024-04-25T12:22:04.885451+0000","last_became_active":"2024-04-25T12:21:24.112992+0000","last_became_peered":"2024-04-25T12:21:24.112992+0000","last_unstale":"2024-04-25T12:22:04.885451+0000","last_undegraded":"2024-04-25T12:22:04.885451+0000","last_fullsized":"2024-04-25T12:22:04.885451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:44:34.461656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.886239+0000","last_change":"2024-04-25T12:21:24.118251+0000","last_active":"2024-04-25T12:22:04.886239+0000","last_peered":"2024-04-25T12:22:04.886239+0000","last_clean":"2024-04-25T12:22:04.886239+0000","last_became_active":"2024-04-25T12:21:24.117412+0000","last_became_peered":"2024-04-25T12:21:24.117412+0000","last_unstale":"2024-04-25T12:22:04.886239+0000","last_undegraded":"2024-04-25T12:22:04.886239+0000","last_fullsized":"2024-04-25T12:22:04.886239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:44:13.238510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.885958+0000","last_change":"2024-04-25T12:21:24.138641+0000","last_active":"2024-04-25T12:22:04.885958+0000","last_peered":"2024-04-25T12:22:04.885958+0000","last_clean":"2024-04-25T12:22:04.885958+0000","last_became_active":"2024-04-25T12:21:24.137937+0000","last_became_peered":"2024-04-25T12:21:24.137937+0000","last_unstale":"2024-04-25T12:22:04.885958+0000","last_undegraded":"2024-04-25T12:22:04.885958+0000","last_fullsized":"2024-04-25T12:22:04.885958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:55:49.291319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.896812+0000","last_change":"2024-04-25T12:21:24.137779+0000","last_active":"2024-04-25T12:22:04.896812+0000","last_peered":"2024-04-25T12:22:04.896812+0000","last_clean":"2024-04-25T12:22:04.896812+0000","last_became_active":"2024-04-25T12:21:24.137431+0000","last_became_peered":"2024-04-25T12:21:24.137431+0000","last_unstale":"2024-04-25T12:22:04.896812+0000","last_undegraded":"2024-04-25T12:22:04.896812+0000","last_fullsized":"2024-04-25T12:22:04.896812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:24:24.181972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.894528+0000","last_change":"2024-04-25T12:21:24.128960+0000","last_active":"2024-04-25T12:22:04.894528+0000","last_peered":"2024-04-25T12:22:04.894528+0000","last_clean":"2024-04-25T12:22:04.894528+0000","last_became_active":"2024-04-25T12:21:24.128125+0000","last_became_peered":"2024-04-25T12:21:24.128125+0000","last_unstale":"2024-04-25T12:22:04.894528+0000","last_undegraded":"2024-04-25T12:22:04.894528+0000","last_fullsized":"2024-04-25T12:22:04.894528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:01.701850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.921873+0000","last_change":"2024-04-25T12:21:24.149001+0000","last_active":"2024-04-25T12:22:04.921873+0000","last_peered":"2024-04-25T12:22:04.921873+0000","last_clean":"2024-04-25T12:22:04.921873+0000","last_became_active":"2024-04-25T12:21:24.147230+0000","last_became_peered":"2024-04-25T12:21:24.147230+0000","last_unstale":"2024-04-25T12:22:04.921873+0000","last_undegraded":"2024-04-25T12:22:04.921873+0000","last_fullsized":"2024-04-25T12:22:04.921873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:05:17.824845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.891883+0000","last_change":"2024-04-25T12:21:24.119941+0000","last_active":"2024-04-25T12:22:04.891883+0000","last_peered":"2024-04-25T12:22:04.891883+0000","last_clean":"2024-04-25T12:22:04.891883+0000","last_became_active":"2024-04-25T12:21:24.118761+0000","last_became_peered":"2024-04-25T12:21:24.118761+0000","last_unstale":"2024-04-25T12:22:04.891883+0000","last_undegraded":"2024-04-25T12:22:04.891883+0000","last_fullsized":"2024-04-25T12:22:04.891883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:49:41.353812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.887528+0000","last_change":"2024-04-25T12:21:24.144163+0000","last_active":"2024-04-25T12:22:04.887528+0000","last_peered":"2024-04-25T12:22:04.887528+0000","last_clean":"2024-04-25T12:22:04.887528+0000","last_became_active":"2024-04-25T12:21:24.143786+0000","last_became_peered":"2024-04-25T12:21:24.143786+0000","last_unstale":"2024-04-25T12:22:04.887528+0000","last_undegraded":"2024-04-25T12:22:04.887528+0000","last_fullsized":"2024-04-25T12:22:04.887528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:17.961437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.885408+0000","last_change":"2024-04-25T12:21:24.107551+0000","last_active":"2024-04-25T12:22:04.885408+0000","last_peered":"2024-04-25T12:22:04.885408+0000","last_clean":"2024-04-25T12:22:04.885408+0000","last_became_active":"2024-04-25T12:21:24.106818+0000","last_became_peered":"2024-04-25T12:21:24.106818+0000","last_unstale":"2024-04-25T12:22:04.885408+0000","last_undegraded":"2024-04-25T12:22:04.885408+0000","last_fullsized":"2024-04-25T12:22:04.885408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:09:24.627007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.920846+0000","last_change":"2024-04-25T12:21:24.114917+0000","last_active":"2024-04-25T12:22:04.920846+0000","last_peered":"2024-04-25T12:22:04.920846+0000","last_clean":"2024-04-25T12:22:04.920846+0000","last_became_active":"2024-04-25T12:21:24.114237+0000","last_became_peered":"2024-04-25T12:21:24.114237+0000","last_unstale":"2024-04-25T12:22:04.920846+0000","last_undegraded":"2024-04-25T12:22:04.920846+0000","last_fullsized":"2024-04-25T12:22:04.920846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:32:38.296553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.895600+0000","last_change":"2024-04-25T12:21:24.132860+0000","last_active":"2024-04-25T12:22:04.895600+0000","last_peered":"2024-04-25T12:22:04.895600+0000","last_clean":"2024-04-25T12:22:04.895600+0000","last_became_active":"2024-04-25T12:21:24.132094+0000","last_became_peered":"2024-04-25T12:21:24.132094+0000","last_unstale":"2024-04-25T12:22:04.895600+0000","last_undegraded":"2024-04-25T12:22:04.895600+0000","last_fullsized":"2024-04-25T12:22:04.895600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:27:24.026145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.901390+0000","last_change":"2024-04-25T12:22:04.897436+0000","last_active":"2024-04-25T12:22:04.901390+0000","last_peered":"2024-04-25T12:22:04.901390+0000","last_clean":"2024-04-25T12:22:04.901390+0000","last_became_active":"2024-04-25T12:22:04.896529+0000","last_became_peered":"2024-04-25T12:22:04.896529+0000","last_unstale":"2024-04-25T12:22:04.901390+0000","last_undegraded":"2024-04-25T12:22:04.901390+0000","last_fullsized":"2024-04-25T12:22:04.901390+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:02:55.727071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.889462+0000","last_change":"2024-04-25T12:21:24.124288+0000","last_active":"2024-04-25T12:22:04.889462+0000","last_peered":"2024-04-25T12:22:04.889462+0000","last_clean":"2024-04-25T12:22:04.889462+0000","last_became_active":"2024-04-25T12:21:24.116973+0000","last_became_peered":"2024-04-25T12:21:24.116973+0000","last_unstale":"2024-04-25T12:22:04.889462+0000","last_undegraded":"2024-04-25T12:22:04.889462+0000","last_fullsized":"2024-04-25T12:22:04.889462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:34:53.390321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.894234+0000","last_change":"2024-04-25T12:21:24.115615+0000","last_active":"2024-04-25T12:22:04.894234+0000","last_peered":"2024-04-25T12:22:04.894234+0000","last_clean":"2024-04-25T12:22:04.894234+0000","last_became_active":"2024-04-25T12:21:24.114829+0000","last_became_peered":"2024-04-25T12:21:24.114829+0000","last_unstale":"2024-04-25T12:22:04.894234+0000","last_undegraded":"2024-04-25T12:22:04.894234+0000","last_fullsized":"2024-04-25T12:22:04.894234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:17.961437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.895028+0000","last_change":"2024-04-25T12:21:24.117225+0000","last_active":"2024-04-25T12:22:04.895028+0000","last_peered":"2024-04-25T12:22:04.895028+0000","last_clean":"2024-04-25T12:22:04.895028+0000","last_became_active":"2024-04-25T12:21:24.116359+0000","last_became_peered":"2024-04-25T12:21:24.116359+0000","last_unstale":"2024-04-25T12:22:04.895028+0000","last_undegraded":"2024-04-25T12:22:04.895028+0000","last_fullsized":"2024-04-25T12:22:04.895028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:22:27.461512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.921638+0000","last_change":"2024-04-25T12:21:24.145198+0000","last_active":"2024-04-25T12:22:04.921638+0000","last_peered":"2024-04-25T12:22:04.921638+0000","last_clean":"2024-04-25T12:22:04.921638+0000","last_became_active":"2024-04-25T12:21:24.142353+0000","last_became_peered":"2024-04-25T12:21:24.142353+0000","last_unstale":"2024-04-25T12:22:04.921638+0000","last_undegraded":"2024-04-25T12:22:04.921638+0000","last_fullsized":"2024-04-25T12:22:04.921638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:44:24.335226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.885945+0000","last_change":"2024-04-25T12:21:24.128086+0000","last_active":"2024-04-25T12:22:04.885945+0000","last_peered":"2024-04-25T12:22:04.885945+0000","last_clean":"2024-04-25T12:22:04.885945+0000","last_became_active":"2024-04-25T12:21:24.127315+0000","last_became_peered":"2024-04-25T12:21:24.127315+0000","last_unstale":"2024-04-25T12:22:04.885945+0000","last_undegraded":"2024-04-25T12:22:04.885945+0000","last_fullsized":"2024-04-25T12:22:04.885945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:20.513145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.920184+0000","last_change":"2024-04-25T12:21:24.142394+0000","last_active":"2024-04-25T12:22:04.920184+0000","last_peered":"2024-04-25T12:22:04.920184+0000","last_clean":"2024-04-25T12:22:04.920184+0000","last_became_active":"2024-04-25T12:21:24.142029+0000","last_became_peered":"2024-04-25T12:21:24.142029+0000","last_unstale":"2024-04-25T12:22:04.920184+0000","last_undegraded":"2024-04-25T12:22:04.920184+0000","last_fullsized":"2024-04-25T12:22:04.920184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:02:56.129724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.885858+0000","last_change":"2024-04-25T12:21:24.113876+0000","last_active":"2024-04-25T12:22:04.885858+0000","last_peered":"2024-04-25T12:22:04.885858+0000","last_clean":"2024-04-25T12:22:04.885858+0000","last_became_active":"2024-04-25T12:21:24.112339+0000","last_became_peered":"2024-04-25T12:21:24.112339+0000","last_unstale":"2024-04-25T12:22:04.885858+0000","last_undegraded":"2024-04-25T12:22:04.885858+0000","last_fullsized":"2024-04-25T12:22:04.885858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:31:44.641068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.920602+0000","last_change":"2024-04-25T12:21:24.144879+0000","last_active":"2024-04-25T12:22:04.920602+0000","last_peered":"2024-04-25T12:22:04.920602+0000","last_clean":"2024-04-25T12:22:04.920602+0000","last_became_active":"2024-04-25T12:21:24.142422+0000","last_became_peered":"2024-04-25T12:21:24.142422+0000","last_unstale":"2024-04-25T12:22:04.920602+0000","last_undegraded":"2024-04-25T12:22:04.920602+0000","last_fullsized":"2024-04-25T12:22:04.920602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:03.206429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.886225+0000","last_change":"2024-04-25T12:21:24.132561+0000","last_active":"2024-04-25T12:22:04.886225+0000","last_peered":"2024-04-25T12:22:04.886225+0000","last_clean":"2024-04-25T12:22:04.886225+0000","last_became_active":"2024-04-25T12:21:24.131746+0000","last_became_peered":"2024-04-25T12:21:24.131746+0000","last_unstale":"2024-04-25T12:22:04.886225+0000","last_undegraded":"2024-04-25T12:22:04.886225+0000","last_fullsized":"2024-04-25T12:22:04.886225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:24.441417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.898100+0000","last_change":"2024-04-25T12:21:24.111956+0000","last_active":"2024-04-25T12:22:04.898100+0000","last_peered":"2024-04-25T12:22:04.898100+0000","last_clean":"2024-04-25T12:22:04.898100+0000","last_became_active":"2024-04-25T12:21:24.111154+0000","last_became_peered":"2024-04-25T12:21:24.111154+0000","last_unstale":"2024-04-25T12:22:04.898100+0000","last_undegraded":"2024-04-25T12:22:04.898100+0000","last_fullsized":"2024-04-25T12:22:04.898100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:39:56.070884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.922005+0000","last_change":"2024-04-25T12:21:24.134511+0000","last_active":"2024-04-25T12:22:04.922005+0000","last_peered":"2024-04-25T12:22:04.922005+0000","last_clean":"2024-04-25T12:22:04.922005+0000","last_became_active":"2024-04-25T12:21:24.133839+0000","last_became_peered":"2024-04-25T12:21:24.133839+0000","last_unstale":"2024-04-25T12:22:04.922005+0000","last_undegraded":"2024-04-25T12:22:04.922005+0000","last_fullsized":"2024-04-25T12:22:04.922005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:43.263673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.921347+0000","last_change":"2024-04-25T12:21:24.147519+0000","last_active":"2024-04-25T12:22:04.921347+0000","last_peered":"2024-04-25T12:22:04.921347+0000","last_clean":"2024-04-25T12:22:04.921347+0000","last_became_active":"2024-04-25T12:21:24.146805+0000","last_became_peered":"2024-04-25T12:21:24.146805+0000","last_unstale":"2024-04-25T12:22:04.921347+0000","last_undegraded":"2024-04-25T12:22:04.921347+0000","last_fullsized":"2024-04-25T12:22:04.921347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:23.200746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":12592,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":25184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":194,"ondisk_log_size":194,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":909312,"data_stored":707411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":120157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":327680,"data_stored":118875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":116273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":120191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":116405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":115893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":901120,"data_stored":705603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":5796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T12:22:36.102 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T12:22:36.258 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.253+0000 7fe7f873f640 1 Processor -- start 2024-04-25T12:22:36.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.253+0000 7fe7f873f640 1 -- start start 2024-04-25T12:22:36.260 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.257+0000 7fe7f873f640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe7f014ffa0 0x7fe7f006f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:36.260 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.257+0000 7fe7f873f640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe7f0074100 0x7fe7f00c7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:36.260 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.257+0000 7fe7f873f640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7f00c5d70 con 0x7fe7f014fbc0 2024-04-25T12:22:36.260 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.257+0000 7fe7f873f640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7fe7f00c6050 con 0x7fe7f0074100 2024-04-25T12:22:36.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.257+0000 7fe7f873f640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fe7f00c6330 con 0x7fe7f014ffa0 2024-04-25T12:22:36.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.257+0000 7fe7f6cdc640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe7f0074100 0x7fe7f00c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:36.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.257+0000 7fe7f6cdc640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe7f0074100 0x7fe7f00c7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37520/0 (socket says 172.21.15.86:37520) 2024-04-25T12:22:36.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.257+0000 7fe7f6cdc640 1 -- 172.21.15.86:0/906365665 learned_addr learned my addr 172.21.15.86:0/906365665 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:36.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.257+0000 7fe7f5cda640 1 --2- 172.21.15.86:0/906365665 >> v2:172.21.15.134:3300/0 conn(0x7fe7f014ffa0 0x7fe7f006f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:36.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.257+0000 7fe7f6cdc640 1 -- 172.21.15.86:0/906365665 >> v2:172.21.15.134:3300/0 conn(0x7fe7f014ffa0 msgr2=0x7fe7f006f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:36.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.257+0000 7fe7f6cdc640 1 --2- 172.21.15.86:0/906365665 >> v2:172.21.15.134:3300/0 conn(0x7fe7f014ffa0 0x7fe7f006f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:36.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.257+0000 7fe7f6cdc640 1 -- 172.21.15.86:0/906365665 >> v1:172.21.15.134:6789/0 conn(0x7fe7f014fbc0 legacy=0x7fe7f00c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:36.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.257+0000 7fe7f6cdc640 1 -- 172.21.15.86:0/906365665 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7f00c6610 con 0x7fe7f0074100 2024-04-25T12:22:36.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.257+0000 7fe7f5cda640 1 --2- 172.21.15.86:0/906365665 >> v2:172.21.15.134:3300/0 conn(0x7fe7f014ffa0 0x7fe7f006f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:22:36.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.257+0000 7fe7f6cdc640 1 --2- 172.21.15.86:0/906365665 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7f0074100 0x7fe7f00c7250 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe7e8009e50 tx=0x7fe7e801c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e83cc4e53a55d98c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:36.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.257+0000 7fe7f54d9640 1 -- 172.21.15.86:0/906365665 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7e80a5890 con 0x7fe7f0074100 2024-04-25T12:22:36.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.257+0000 7fe7f54d9640 1 -- 172.21.15.86:0/906365665 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7e80a5a30 con 0x7fe7f0074100 2024-04-25T12:22:36.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.257+0000 7fe7f54d9640 1 -- 172.21.15.86:0/906365665 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7e80a5e00 con 0x7fe7f0074100 2024-04-25T12:22:36.264 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.261+0000 7fe7f873f640 1 -- 172.21.15.86:0/906365665 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7f0074100 msgr2=0x7fe7f00c7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:36.264 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.261+0000 7fe7f873f640 1 --2- 172.21.15.86:0/906365665 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7f0074100 0x7fe7f00c7250 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe7e8009e50 tx=0x7fe7e801c9b0 comp rx=0 tx=0).stop 2024-04-25T12:22:36.264 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.261+0000 7fe7f873f640 1 -- 172.21.15.86:0/906365665 shutdown_connections 2024-04-25T12:22:36.264 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.261+0000 7fe7f873f640 1 --2- 172.21.15.86:0/906365665 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7f0074100 0x7fe7f00c7250 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:36.264 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.261+0000 7fe7f873f640 1 --2- 172.21.15.86:0/906365665 >> v2:172.21.15.134:3300/0 conn(0x7fe7f014ffa0 0x7fe7f006f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:36.264 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.261+0000 7fe7f873f640 1 -- 172.21.15.86:0/906365665 >> 172.21.15.86:0/906365665 conn(0x7fe7f006b9d0 msgr2=0x7fe7f006bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:36.264 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.261+0000 7fe7f873f640 1 -- 172.21.15.86:0/906365665 shutdown_connections 2024-04-25T12:22:36.264 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.261+0000 7fe7f873f640 1 -- 172.21.15.86:0/906365665 wait complete. 2024-04-25T12:22:36.265 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.261+0000 7fe7f873f640 1 Processor -- start 2024-04-25T12:22:36.265 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.261+0000 7fe7f873f640 1 -- start start 2024-04-25T12:22:36.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.261+0000 7fe7f873f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7f0074100 0x7fe7f014ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:36.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.261+0000 7fe7f873f640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe7f014fbc0 0x7fe7f014bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:36.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.261+0000 7fe7f873f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7f014ffa0 0x7fe7f01f48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:36.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.261+0000 7fe7f873f640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe7f00c8ab0 con 0x7fe7f0074100 2024-04-25T12:22:36.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.261+0000 7fe7f873f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe7f00c8930 con 0x7fe7f014ffa0 2024-04-25T12:22:36.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.261+0000 7fe7f873f640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fe7f0166090 con 0x7fe7f014fbc0 2024-04-25T12:22:36.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.261+0000 7fe7f64db640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7f0074100 0x7fe7f014ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:36.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.261+0000 7fe7f64db640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7f0074100 0x7fe7f014ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37522/0 (socket says 172.21.15.86:37522) 2024-04-25T12:22:36.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.261+0000 7fe7f64db640 1 -- 172.21.15.86:0/1182863937 learned_addr learned my addr 172.21.15.86:0/1182863937 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:36.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.261+0000 7fe7f64db640 1 -- 172.21.15.86:0/1182863937 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe7f014fbc0 msgr2=0x7fe7f014bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:36.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.261+0000 7fe7f64db640 1 --2- 172.21.15.86:0/1182863937 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe7f014fbc0 0x7fe7f014bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:36.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.261+0000 7fe7f64db640 1 -- 172.21.15.86:0/1182863937 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7f014ffa0 msgr2=0x7fe7f01f48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:36.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.261+0000 7fe7f6cdc640 1 --2- 172.21.15.86:0/1182863937 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7f014ffa0 0x7fe7f01f48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:36.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.261+0000 7fe7f64db640 1 --2- 172.21.15.86:0/1182863937 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7f014ffa0 0x7fe7f01f48b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:36.269 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.261+0000 7fe7f64db640 1 -- 172.21.15.86:0/1182863937 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7f01f57f0 con 0x7fe7f0074100 2024-04-25T12:22:36.269 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.261+0000 7fe7f64db640 1 --2- 172.21.15.86:0/1182863937 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7f0074100 0x7fe7f014ba80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec00c480 tx=0x7fe7ec00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:36.269 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.261+0000 7fe7e6ffd640 1 -- 172.21.15.86:0/1182863937 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7ec012830 con 0x7fe7f0074100 2024-04-25T12:22:36.269 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.261+0000 7fe7e6ffd640 1 -- 172.21.15.86:0/1182863937 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7ec017070 con 0x7fe7f0074100 2024-04-25T12:22:36.269 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.261+0000 7fe7f873f640 1 -- 172.21.15.86:0/1182863937 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7f01f5ad0 con 0x7fe7f0074100 2024-04-25T12:22:36.269 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.261+0000 7fe7e6ffd640 1 -- 172.21.15.86:0/1182863937 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7ec012c10 con 0x7fe7f0074100 2024-04-25T12:22:36.269 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.261+0000 7fe7f873f640 1 -- 172.21.15.86:0/1182863937 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7f01f6090 con 0x7fe7f0074100 2024-04-25T12:22:36.269 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.265+0000 7fe7f873f640 1 -- 172.21.15.86:0/1182863937 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7f0075df0 con 0x7fe7f0074100 2024-04-25T12:22:36.270 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.265+0000 7fe7e6ffd640 1 -- 172.21.15.86:0/1182863937 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe7ec01c460 con 0x7fe7f0074100 2024-04-25T12:22:36.270 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.265+0000 7fe7e6ffd640 1 --2- 172.21.15.86:0/1182863937 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fe7d4068380 0x7fe7d406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:36.271 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.265+0000 7fe7e6ffd640 1 -- 172.21.15.86:0/1182863937 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fe7ec086c90 con 0x7fe7f0074100 2024-04-25T12:22:36.271 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.265+0000 7fe7f5cda640 1 --2- 172.21.15.86:0/1182863937 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fe7d4068380 0x7fe7d406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:36.271 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.265+0000 7fe7f5cda640 1 --2- 172.21.15.86:0/1182863937 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fe7d4068380 0x7fe7d406a840 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe7f0146390 tx=0x7fe7e0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:36.272 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.269+0000 7fe7e6ffd640 1 -- 172.21.15.86:0/1182863937 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe7ec056e40 con 0x7fe7f0074100 2024-04-25T12:22:36.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.425+0000 7fe7f873f640 1 -- 172.21.15.86:0/1182863937 --> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe7f0149c50 con 0x7fe7d4068380 2024-04-25T12:22:36.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.445+0000 7fe7e6ffd640 1 -- 172.21.15.86:0/1182863937 <== mgr.4107 v2:172.21.15.86:6832/3708662606 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332691 (secure 0 0 0) 0x7fe7f0149c50 con 0x7fe7d4068380 2024-04-25T12:22:36.453 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:22:36.455 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2024-04-25T12:22:36.456 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.449+0000 7fe7f873f640 1 -- 172.21.15.86:0/1182863937 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fe7d4068380 msgr2=0x7fe7d406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:36.456 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.449+0000 7fe7f873f640 1 --2- 172.21.15.86:0/1182863937 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fe7d4068380 0x7fe7d406a840 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe7f0146390 tx=0x7fe7e0008040 comp rx=0 tx=0).stop 2024-04-25T12:22:36.456 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.449+0000 7fe7f873f640 1 -- 172.21.15.86:0/1182863937 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7f0074100 msgr2=0x7fe7f014ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:36.456 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.449+0000 7fe7f873f640 1 --2- 172.21.15.86:0/1182863937 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7f0074100 0x7fe7f014ba80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec00c480 tx=0x7fe7ec00c940 comp rx=0 tx=0).stop 2024-04-25T12:22:36.457 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.449+0000 7fe7f873f640 1 -- 172.21.15.86:0/1182863937 shutdown_connections 2024-04-25T12:22:36.457 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.449+0000 7fe7f873f640 1 --2- 172.21.15.86:0/1182863937 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7f014ffa0 0x7fe7f01f48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:36.457 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.449+0000 7fe7f873f640 1 --2- 172.21.15.86:0/1182863937 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe7f014fbc0 0x7fe7f014bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:36.457 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.449+0000 7fe7f873f640 1 --2- 172.21.15.86:0/1182863937 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fe7d4068380 0x7fe7d406a840 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:36.457 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.449+0000 7fe7f873f640 1 --2- 172.21.15.86:0/1182863937 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7f0074100 0x7fe7f014ba80 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:36.457 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.449+0000 7fe7f873f640 1 -- 172.21.15.86:0/1182863937 >> 172.21.15.86:0/1182863937 conn(0x7fe7f006b9d0 msgr2=0x7fe7f006ed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:36.457 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.449+0000 7fe7f873f640 1 -- 172.21.15.86:0/1182863937 shutdown_connections 2024-04-25T12:22:36.457 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.449+0000 7fe7f873f640 1 -- 172.21.15.86:0/1182863937 wait complete. 2024-04-25T12:22:36.471 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2024-04-25T12:22:35.822910+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":602960,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":379,"num_write_kb":2494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":311,"ondisk_log_size":311,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219720,"kb_used_data":3592,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755000,"statfs":{"total":773094113280,"available":772869120000,"internally_reserved":0,"allocated":3678208,"data_stored":2120808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2328,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004752"},"pg_stats":[{"pgid":"2.1f","version":"26'13","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:14.941362+0000","last_change":"2024-04-25T12:21:23.124053+0000","last_active":"2024-04-25T12:22:14.941362+0000","last_peered":"2024-04-25T12:22:14.941362+0000","last_clean":"2024-04-25T12:22:14.941362+0000","last_became_active":"2024-04-25T12:21:23.123863+0000","last_became_peered":"2024-04-25T12:21:23.123863+0000","last_unstale":"2024-04-25T12:22:14.941362+0000","last_undegraded":"2024-04-25T12:22:14.941362+0000","last_fullsized":"2024-04-25T12:22:14.941362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:52:10.500619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.889057+0000","last_change":"2024-04-25T12:21:24.141874+0000","last_active":"2024-04-25T12:22:04.889057+0000","last_peered":"2024-04-25T12:22:04.889057+0000","last_clean":"2024-04-25T12:22:04.889057+0000","last_became_active":"2024-04-25T12:21:24.141482+0000","last_became_peered":"2024-04-25T12:21:24.141482+0000","last_unstale":"2024-04-25T12:22:04.889057+0000","last_undegraded":"2024-04-25T12:22:04.889057+0000","last_fullsized":"2024-04-25T12:22:04.889057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:45.364004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.885753+0000","last_change":"2024-04-25T12:21:28.377921+0000","last_active":"2024-04-25T12:22:04.885753+0000","last_peered":"2024-04-25T12:22:04.885753+0000","last_clean":"2024-04-25T12:22:04.885753+0000","last_became_active":"2024-04-25T12:21:28.376966+0000","last_became_peered":"2024-04-25T12:21:28.376966+0000","last_unstale":"2024-04-25T12:22:04.885753+0000","last_undegraded":"2024-04-25T12:22:04.885753+0000","last_fullsized":"2024-04-25T12:22:04.885753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:50:43.460694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.889523+0000","last_change":"2024-04-25T12:21:23.113889+0000","last_active":"2024-04-25T12:22:04.889523+0000","last_peered":"2024-04-25T12:22:04.889523+0000","last_clean":"2024-04-25T12:22:04.889523+0000","last_became_active":"2024-04-25T12:21:23.113605+0000","last_became_peered":"2024-04-25T12:21:23.113605+0000","last_unstale":"2024-04-25T12:22:04.889523+0000","last_undegraded":"2024-04-25T12:22:04.889523+0000","last_fullsized":"2024-04-25T12:22:04.889523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:01.082322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.926635+0000","last_change":"2024-04-25T12:22:04.926635+0000","last_active":"2024-04-25T12:22:04.926635+0000","last_peered":"2024-04-25T12:22:04.926635+0000","last_clean":"2024-04-25T12:22:04.926635+0000","last_became_active":"2024-04-25T12:22:04.925895+0000","last_became_peered":"2024-04-25T12:22:04.925895+0000","last_unstale":"2024-04-25T12:22:04.926635+0000","last_undegraded":"2024-04-25T12:22:04.926635+0000","last_fullsized":"2024-04-25T12:22:04.926635+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:58:49.313708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.886429+0000","last_change":"2024-04-25T12:21:28.205320+0000","last_active":"2024-04-25T12:22:04.886429+0000","last_peered":"2024-04-25T12:22:04.886429+0000","last_clean":"2024-04-25T12:22:04.886429+0000","last_became_active":"2024-04-25T12:21:28.204404+0000","last_became_peered":"2024-04-25T12:21:28.204404+0000","last_unstale":"2024-04-25T12:22:04.886429+0000","last_undegraded":"2024-04-25T12:22:04.886429+0000","last_fullsized":"2024-04-25T12:22:04.886429+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:03:17.730928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'12","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:14.950869+0000","last_change":"2024-04-25T12:21:23.132332+0000","last_active":"2024-04-25T12:22:14.950869+0000","last_peered":"2024-04-25T12:22:14.950869+0000","last_clean":"2024-04-25T12:22:14.950869+0000","last_became_active":"2024-04-25T12:21:23.131566+0000","last_became_peered":"2024-04-25T12:21:23.131566+0000","last_unstale":"2024-04-25T12:22:14.950869+0000","last_undegraded":"2024-04-25T12:22:14.950869+0000","last_fullsized":"2024-04-25T12:22:14.950869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:02.429838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.886464+0000","last_change":"2024-04-25T12:21:24.128824+0000","last_active":"2024-04-25T12:22:04.886464+0000","last_peered":"2024-04-25T12:22:04.886464+0000","last_clean":"2024-04-25T12:22:04.886464+0000","last_became_active":"2024-04-25T12:21:24.128027+0000","last_became_peered":"2024-04-25T12:21:24.128027+0000","last_unstale":"2024-04-25T12:22:04.886464+0000","last_undegraded":"2024-04-25T12:22:04.886464+0000","last_fullsized":"2024-04-25T12:22:04.886464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:57:44.137044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.888676+0000","last_change":"2024-04-25T12:21:28.202389+0000","last_active":"2024-04-25T12:22:04.888676+0000","last_peered":"2024-04-25T12:22:04.888676+0000","last_clean":"2024-04-25T12:22:04.888676+0000","last_became_active":"2024-04-25T12:21:28.201228+0000","last_became_peered":"2024-04-25T12:21:28.201228+0000","last_unstale":"2024-04-25T12:22:04.888676+0000","last_undegraded":"2024-04-25T12:22:04.888676+0000","last_fullsized":"2024-04-25T12:22:04.888676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:45:30.365480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:14.953252+0000","last_change":"2024-04-25T12:21:23.128355+0000","last_active":"2024-04-25T12:22:14.953252+0000","last_peered":"2024-04-25T12:22:14.953252+0000","last_clean":"2024-04-25T12:22:14.953252+0000","last_became_active":"2024-04-25T12:21:23.127717+0000","last_became_peered":"2024-04-25T12:21:23.127717+0000","last_unstale":"2024-04-25T12:22:14.953252+0000","last_undegraded":"2024-04-25T12:22:14.953252+0000","last_fullsized":"2024-04-25T12:22:14.953252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:26.319715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.886973+0000","last_change":"2024-04-25T12:21:24.122098+0000","last_active":"2024-04-25T12:22:04.886973+0000","last_peered":"2024-04-25T12:22:04.886973+0000","last_clean":"2024-04-25T12:22:04.886973+0000","last_became_active":"2024-04-25T12:21:24.121392+0000","last_became_peered":"2024-04-25T12:21:24.121392+0000","last_unstale":"2024-04-25T12:22:04.886973+0000","last_undegraded":"2024-04-25T12:22:04.886973+0000","last_fullsized":"2024-04-25T12:22:04.886973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:11:35.116222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.887755+0000","last_change":"2024-04-25T12:21:28.189048+0000","last_active":"2024-04-25T12:22:04.887755+0000","last_peered":"2024-04-25T12:22:04.887755+0000","last_clean":"2024-04-25T12:22:04.887755+0000","last_became_active":"2024-04-25T12:21:28.187340+0000","last_became_peered":"2024-04-25T12:21:28.187340+0000","last_unstale":"2024-04-25T12:22:04.887755+0000","last_undegraded":"2024-04-25T12:22:04.887755+0000","last_fullsized":"2024-04-25T12:22:04.887755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:47:13.797595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.893836+0000","last_change":"2024-04-25T12:21:24.126211+0000","last_active":"2024-04-25T12:22:04.893836+0000","last_peered":"2024-04-25T12:22:04.893836+0000","last_clean":"2024-04-25T12:22:04.893836+0000","last_became_active":"2024-04-25T12:21:24.123695+0000","last_became_peered":"2024-04-25T12:21:24.123695+0000","last_unstale":"2024-04-25T12:22:04.893836+0000","last_undegraded":"2024-04-25T12:22:04.893836+0000","last_fullsized":"2024-04-25T12:22:04.893836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:09:04.327157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"24'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.921191+0000","last_change":"2024-04-25T12:21:23.139676+0000","last_active":"2024-04-25T12:22:04.921191+0000","last_peered":"2024-04-25T12:22:04.921191+0000","last_clean":"2024-04-25T12:22:04.921191+0000","last_became_active":"2024-04-25T12:21:23.139025+0000","last_became_peered":"2024-04-25T12:21:23.139025+0000","last_unstale":"2024-04-25T12:22:04.921191+0000","last_undegraded":"2024-04-25T12:22:04.921191+0000","last_fullsized":"2024-04-25T12:22:04.921191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:43:51.445149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.889613+0000","last_change":"2024-04-25T12:21:28.188852+0000","last_active":"2024-04-25T12:22:04.889613+0000","last_peered":"2024-04-25T12:22:04.889613+0000","last_clean":"2024-04-25T12:22:04.889613+0000","last_became_active":"2024-04-25T12:21:28.187619+0000","last_became_peered":"2024-04-25T12:21:28.187619+0000","last_unstale":"2024-04-25T12:22:04.889613+0000","last_undegraded":"2024-04-25T12:22:04.889613+0000","last_fullsized":"2024-04-25T12:22:04.889613+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:12:14.726245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.888266+0000","last_change":"2024-04-25T12:21:24.136925+0000","last_active":"2024-04-25T12:22:04.888266+0000","last_peered":"2024-04-25T12:22:04.888266+0000","last_clean":"2024-04-25T12:22:04.888266+0000","last_became_active":"2024-04-25T12:21:24.136535+0000","last_became_peered":"2024-04-25T12:21:24.136535+0000","last_unstale":"2024-04-25T12:22:04.888266+0000","last_undegraded":"2024-04-25T12:22:04.888266+0000","last_fullsized":"2024-04-25T12:22:04.888266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:28:23.965010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:08.913144+0000","last_change":"2024-04-25T12:21:23.105571+0000","last_active":"2024-04-25T12:22:08.913144+0000","last_peered":"2024-04-25T12:22:08.913144+0000","last_clean":"2024-04-25T12:22:08.913144+0000","last_became_active":"2024-04-25T12:21:23.105051+0000","last_became_peered":"2024-04-25T12:21:23.105051+0000","last_unstale":"2024-04-25T12:22:08.913144+0000","last_undegraded":"2024-04-25T12:22:08.913144+0000","last_fullsized":"2024-04-25T12:22:08.913144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:52:40.783100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.888765+0000","last_change":"2024-04-25T12:21:28.202632+0000","last_active":"2024-04-25T12:22:04.888765+0000","last_peered":"2024-04-25T12:22:04.888765+0000","last_clean":"2024-04-25T12:22:04.888765+0000","last_became_active":"2024-04-25T12:21:28.201389+0000","last_became_peered":"2024-04-25T12:21:28.201389+0000","last_unstale":"2024-04-25T12:22:04.888765+0000","last_undegraded":"2024-04-25T12:22:04.888765+0000","last_fullsized":"2024-04-25T12:22:04.888765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:48:58.246610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.887395+0000","last_change":"2024-04-25T12:21:24.138749+0000","last_active":"2024-04-25T12:22:04.887395+0000","last_peered":"2024-04-25T12:22:04.887395+0000","last_clean":"2024-04-25T12:22:04.887395+0000","last_became_active":"2024-04-25T12:21:24.138446+0000","last_became_peered":"2024-04-25T12:21:24.138446+0000","last_unstale":"2024-04-25T12:22:04.887395+0000","last_undegraded":"2024-04-25T12:22:04.887395+0000","last_fullsized":"2024-04-25T12:22:04.887395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:22:03.856237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:14.941093+0000","last_change":"2024-04-25T12:21:23.126871+0000","last_active":"2024-04-25T12:22:14.941093+0000","last_peered":"2024-04-25T12:22:14.941093+0000","last_clean":"2024-04-25T12:22:14.941093+0000","last_became_active":"2024-04-25T12:21:23.126521+0000","last_became_peered":"2024-04-25T12:21:23.126521+0000","last_unstale":"2024-04-25T12:22:14.941093+0000","last_undegraded":"2024-04-25T12:22:14.941093+0000","last_fullsized":"2024-04-25T12:22:14.941093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:12:31.353951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.922140+0000","last_change":"2024-04-25T12:21:28.383996+0000","last_active":"2024-04-25T12:22:04.922140+0000","last_peered":"2024-04-25T12:22:04.922140+0000","last_clean":"2024-04-25T12:22:04.922140+0000","last_became_active":"2024-04-25T12:21:28.383568+0000","last_became_peered":"2024-04-25T12:21:28.383568+0000","last_unstale":"2024-04-25T12:22:04.922140+0000","last_undegraded":"2024-04-25T12:22:04.922140+0000","last_fullsized":"2024-04-25T12:22:04.922140+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:19:41.564694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.887535+0000","last_change":"2024-04-25T12:21:24.125112+0000","last_active":"2024-04-25T12:22:04.887535+0000","last_peered":"2024-04-25T12:22:04.887535+0000","last_clean":"2024-04-25T12:22:04.887535+0000","last_became_active":"2024-04-25T12:21:24.121963+0000","last_became_peered":"2024-04-25T12:21:24.121963+0000","last_unstale":"2024-04-25T12:22:04.887535+0000","last_undegraded":"2024-04-25T12:22:04.887535+0000","last_fullsized":"2024-04-25T12:22:04.887535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:33:14.123119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"24'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.919771+0000","last_change":"2024-04-25T12:21:23.117114+0000","last_active":"2024-04-25T12:22:04.919771+0000","last_peered":"2024-04-25T12:22:04.919771+0000","last_clean":"2024-04-25T12:22:04.919771+0000","last_became_active":"2024-04-25T12:21:23.115571+0000","last_became_peered":"2024-04-25T12:21:23.115571+0000","last_unstale":"2024-04-25T12:22:04.919771+0000","last_undegraded":"2024-04-25T12:22:04.919771+0000","last_fullsized":"2024-04-25T12:22:04.919771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:47.838299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.888900+0000","last_change":"2024-04-25T12:21:28.202374+0000","last_active":"2024-04-25T12:22:04.888900+0000","last_peered":"2024-04-25T12:22:04.888900+0000","last_clean":"2024-04-25T12:22:04.888900+0000","last_became_active":"2024-04-25T12:21:28.201297+0000","last_became_peered":"2024-04-25T12:21:28.201297+0000","last_unstale":"2024-04-25T12:22:04.888900+0000","last_undegraded":"2024-04-25T12:22:04.888900+0000","last_fullsized":"2024-04-25T12:22:04.888900+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:13.461169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.899183+0000","last_change":"2024-04-25T12:21:24.133827+0000","last_active":"2024-04-25T12:22:04.899183+0000","last_peered":"2024-04-25T12:22:04.899183+0000","last_clean":"2024-04-25T12:22:04.899183+0000","last_became_active":"2024-04-25T12:21:24.132703+0000","last_became_peered":"2024-04-25T12:21:24.132703+0000","last_unstale":"2024-04-25T12:22:04.899183+0000","last_undegraded":"2024-04-25T12:22:04.899183+0000","last_fullsized":"2024-04-25T12:22:04.899183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:06:22.849827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:14.949919+0000","last_change":"2024-04-25T12:21:23.132331+0000","last_active":"2024-04-25T12:22:14.949919+0000","last_peered":"2024-04-25T12:22:14.949919+0000","last_clean":"2024-04-25T12:22:14.949919+0000","last_became_active":"2024-04-25T12:21:23.131628+0000","last_became_peered":"2024-04-25T12:21:23.131628+0000","last_unstale":"2024-04-25T12:22:14.949919+0000","last_undegraded":"2024-04-25T12:22:14.949919+0000","last_fullsized":"2024-04-25T12:22:14.949919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:19:13.372172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.887229+0000","last_change":"2024-04-25T12:21:28.377407+0000","last_active":"2024-04-25T12:22:04.887229+0000","last_peered":"2024-04-25T12:22:04.887229+0000","last_clean":"2024-04-25T12:22:04.887229+0000","last_became_active":"2024-04-25T12:21:28.376224+0000","last_became_peered":"2024-04-25T12:21:28.376224+0000","last_unstale":"2024-04-25T12:22:04.887229+0000","last_undegraded":"2024-04-25T12:22:04.887229+0000","last_fullsized":"2024-04-25T12:22:04.887229+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:13:02.955979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.888952+0000","last_change":"2024-04-25T12:21:24.145468+0000","last_active":"2024-04-25T12:22:04.888952+0000","last_peered":"2024-04-25T12:22:04.888952+0000","last_clean":"2024-04-25T12:22:04.888952+0000","last_became_active":"2024-04-25T12:21:24.145132+0000","last_became_peered":"2024-04-25T12:21:24.145132+0000","last_unstale":"2024-04-25T12:22:04.888952+0000","last_undegraded":"2024-04-25T12:22:04.888952+0000","last_fullsized":"2024-04-25T12:22:04.888952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:46:44.281270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:08.911698+0000","last_change":"2024-04-25T12:21:23.131029+0000","last_active":"2024-04-25T12:22:08.911698+0000","last_peered":"2024-04-25T12:22:08.911698+0000","last_clean":"2024-04-25T12:22:08.911698+0000","last_became_active":"2024-04-25T12:21:23.130612+0000","last_became_peered":"2024-04-25T12:21:23.130612+0000","last_unstale":"2024-04-25T12:22:08.911698+0000","last_undegraded":"2024-04-25T12:22:08.911698+0000","last_fullsized":"2024-04-25T12:22:08.911698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:02.146986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.885579+0000","last_change":"2024-04-25T12:21:28.375231+0000","last_active":"2024-04-25T12:22:04.885579+0000","last_peered":"2024-04-25T12:22:04.885579+0000","last_clean":"2024-04-25T12:22:04.885579+0000","last_became_active":"2024-04-25T12:21:28.374813+0000","last_became_peered":"2024-04-25T12:21:28.374813+0000","last_unstale":"2024-04-25T12:22:04.885579+0000","last_undegraded":"2024-04-25T12:22:04.885579+0000","last_fullsized":"2024-04-25T12:22:04.885579+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:16.393582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.922376+0000","last_change":"2024-04-25T12:21:24.112280+0000","last_active":"2024-04-25T12:22:04.922376+0000","last_peered":"2024-04-25T12:22:04.922376+0000","last_clean":"2024-04-25T12:22:04.922376+0000","last_became_active":"2024-04-25T12:21:24.111430+0000","last_became_peered":"2024-04-25T12:21:24.111430+0000","last_unstale":"2024-04-25T12:22:04.922376+0000","last_undegraded":"2024-04-25T12:22:04.922376+0000","last_fullsized":"2024-04-25T12:22:04.922376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:58.325720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:08.912181+0000","last_change":"2024-04-25T12:21:23.124271+0000","last_active":"2024-04-25T12:22:08.912181+0000","last_peered":"2024-04-25T12:22:08.912181+0000","last_clean":"2024-04-25T12:22:08.912181+0000","last_became_active":"2024-04-25T12:21:23.123492+0000","last_became_peered":"2024-04-25T12:21:23.123492+0000","last_unstale":"2024-04-25T12:22:08.912181+0000","last_undegraded":"2024-04-25T12:22:08.912181+0000","last_fullsized":"2024-04-25T12:22:08.912181+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:31:09.080478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.896489+0000","last_change":"2024-04-25T12:21:28.375801+0000","last_active":"2024-04-25T12:22:04.896489+0000","last_peered":"2024-04-25T12:22:04.896489+0000","last_clean":"2024-04-25T12:22:04.896489+0000","last_became_active":"2024-04-25T12:21:28.375119+0000","last_became_peered":"2024-04-25T12:21:28.375119+0000","last_unstale":"2024-04-25T12:22:04.896489+0000","last_undegraded":"2024-04-25T12:22:04.896489+0000","last_fullsized":"2024-04-25T12:22:04.896489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:00:29.908954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.886990+0000","last_change":"2024-04-25T12:21:24.131673+0000","last_active":"2024-04-25T12:22:04.886990+0000","last_peered":"2024-04-25T12:22:04.886990+0000","last_clean":"2024-04-25T12:22:04.886990+0000","last_became_active":"2024-04-25T12:21:24.130866+0000","last_became_peered":"2024-04-25T12:21:24.130866+0000","last_unstale":"2024-04-25T12:22:04.886990+0000","last_undegraded":"2024-04-25T12:22:04.886990+0000","last_fullsized":"2024-04-25T12:22:04.886990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:09:04.327157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"26'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.922773+0000","last_change":"2024-04-25T12:21:23.106785+0000","last_active":"2024-04-25T12:22:04.922773+0000","last_peered":"2024-04-25T12:22:04.922773+0000","last_clean":"2024-04-25T12:22:04.922773+0000","last_became_active":"2024-04-25T12:21:23.105809+0000","last_became_peered":"2024-04-25T12:21:23.105809+0000","last_unstale":"2024-04-25T12:22:04.922773+0000","last_undegraded":"2024-04-25T12:22:04.922773+0000","last_fullsized":"2024-04-25T12:22:04.922773+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:17.185116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.920337+0000","last_change":"2024-04-25T12:21:28.193242+0000","last_active":"2024-04-25T12:22:04.920337+0000","last_peered":"2024-04-25T12:22:04.920337+0000","last_clean":"2024-04-25T12:22:04.920337+0000","last_became_active":"2024-04-25T12:21:28.192835+0000","last_became_peered":"2024-04-25T12:21:28.192835+0000","last_unstale":"2024-04-25T12:22:04.920337+0000","last_undegraded":"2024-04-25T12:22:04.920337+0000","last_fullsized":"2024-04-25T12:22:04.920337+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:42:52.476024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.889648+0000","last_change":"2024-04-25T12:21:24.128902+0000","last_active":"2024-04-25T12:22:04.889648+0000","last_peered":"2024-04-25T12:22:04.889648+0000","last_clean":"2024-04-25T12:22:04.889648+0000","last_became_active":"2024-04-25T12:21:24.124563+0000","last_became_peered":"2024-04-25T12:21:24.124563+0000","last_unstale":"2024-04-25T12:22:04.889648+0000","last_undegraded":"2024-04-25T12:22:04.889648+0000","last_fullsized":"2024-04-25T12:22:04.889648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:16.937980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:14.953290+0000","last_change":"2024-04-25T12:21:23.114222+0000","last_active":"2024-04-25T12:22:14.953290+0000","last_peered":"2024-04-25T12:22:14.953290+0000","last_clean":"2024-04-25T12:22:14.953290+0000","last_became_active":"2024-04-25T12:21:23.113504+0000","last_became_peered":"2024-04-25T12:21:23.113504+0000","last_unstale":"2024-04-25T12:22:14.953290+0000","last_undegraded":"2024-04-25T12:22:14.953290+0000","last_fullsized":"2024-04-25T12:22:14.953290+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:37:42.382391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.922111+0000","last_change":"2024-04-25T12:21:28.200532+0000","last_active":"2024-04-25T12:22:04.922111+0000","last_peered":"2024-04-25T12:22:04.922111+0000","last_clean":"2024-04-25T12:22:04.922111+0000","last_became_active":"2024-04-25T12:21:28.200082+0000","last_became_peered":"2024-04-25T12:21:28.200082+0000","last_unstale":"2024-04-25T12:22:04.922111+0000","last_undegraded":"2024-04-25T12:22:04.922111+0000","last_fullsized":"2024-04-25T12:22:04.922111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:24.889665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.920686+0000","last_change":"2024-04-25T12:21:24.112524+0000","last_active":"2024-04-25T12:22:04.920686+0000","last_peered":"2024-04-25T12:22:04.920686+0000","last_clean":"2024-04-25T12:22:04.920686+0000","last_became_active":"2024-04-25T12:21:24.111503+0000","last_became_peered":"2024-04-25T12:21:24.111503+0000","last_unstale":"2024-04-25T12:22:04.920686+0000","last_undegraded":"2024-04-25T12:22:04.920686+0000","last_fullsized":"2024-04-25T12:22:04.920686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:03:35.982959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:14.944694+0000","last_change":"2024-04-25T12:21:23.108434+0000","last_active":"2024-04-25T12:22:14.944694+0000","last_peered":"2024-04-25T12:22:14.944694+0000","last_clean":"2024-04-25T12:22:14.944694+0000","last_became_active":"2024-04-25T12:21:23.108051+0000","last_became_peered":"2024-04-25T12:21:23.108051+0000","last_unstale":"2024-04-25T12:22:14.944694+0000","last_undegraded":"2024-04-25T12:22:14.944694+0000","last_fullsized":"2024-04-25T12:22:14.944694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:49.222950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.922506+0000","last_change":"2024-04-25T12:21:28.189825+0000","last_active":"2024-04-25T12:22:04.922506+0000","last_peered":"2024-04-25T12:22:04.922506+0000","last_clean":"2024-04-25T12:22:04.922506+0000","last_became_active":"2024-04-25T12:21:28.189247+0000","last_became_peered":"2024-04-25T12:21:28.189247+0000","last_unstale":"2024-04-25T12:22:04.922506+0000","last_undegraded":"2024-04-25T12:22:04.922506+0000","last_fullsized":"2024-04-25T12:22:04.922506+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:54:02.752212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.894738+0000","last_change":"2024-04-25T12:21:24.105746+0000","last_active":"2024-04-25T12:22:04.894738+0000","last_peered":"2024-04-25T12:22:04.894738+0000","last_clean":"2024-04-25T12:22:04.894738+0000","last_became_active":"2024-04-25T12:21:24.104947+0000","last_became_peered":"2024-04-25T12:21:24.104947+0000","last_unstale":"2024-04-25T12:22:04.894738+0000","last_undegraded":"2024-04-25T12:22:04.894738+0000","last_fullsized":"2024-04-25T12:22:04.894738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:46:14.853789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.919808+0000","last_change":"2024-04-25T12:21:23.114591+0000","last_active":"2024-04-25T12:22:04.919808+0000","last_peered":"2024-04-25T12:22:04.919808+0000","last_clean":"2024-04-25T12:22:04.919808+0000","last_became_active":"2024-04-25T12:21:23.113829+0000","last_became_peered":"2024-04-25T12:21:23.113829+0000","last_unstale":"2024-04-25T12:22:04.919808+0000","last_undegraded":"2024-04-25T12:22:04.919808+0000","last_fullsized":"2024-04-25T12:22:04.919808+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:51:38.471436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.898786+0000","last_change":"2024-04-25T12:21:28.378024+0000","last_active":"2024-04-25T12:22:04.898786+0000","last_peered":"2024-04-25T12:22:04.898786+0000","last_clean":"2024-04-25T12:22:04.898786+0000","last_became_active":"2024-04-25T12:21:28.377639+0000","last_became_peered":"2024-04-25T12:21:28.377639+0000","last_unstale":"2024-04-25T12:22:04.898786+0000","last_undegraded":"2024-04-25T12:22:04.898786+0000","last_fullsized":"2024-04-25T12:22:04.898786+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:18:40.723659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.886368+0000","last_change":"2024-04-25T12:21:24.120719+0000","last_active":"2024-04-25T12:22:04.886368+0000","last_peered":"2024-04-25T12:22:04.886368+0000","last_clean":"2024-04-25T12:22:04.886368+0000","last_became_active":"2024-04-25T12:21:24.119870+0000","last_became_peered":"2024-04-25T12:21:24.119870+0000","last_unstale":"2024-04-25T12:22:04.886368+0000","last_undegraded":"2024-04-25T12:22:04.886368+0000","last_fullsized":"2024-04-25T12:22:04.886368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:53:15.175473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:08.909810+0000","last_change":"2024-04-25T12:21:23.103524+0000","last_active":"2024-04-25T12:22:08.909810+0000","last_peered":"2024-04-25T12:22:08.909810+0000","last_clean":"2024-04-25T12:22:08.909810+0000","last_became_active":"2024-04-25T12:21:23.102790+0000","last_became_peered":"2024-04-25T12:21:23.102790+0000","last_unstale":"2024-04-25T12:22:08.909810+0000","last_undegraded":"2024-04-25T12:22:08.909810+0000","last_fullsized":"2024-04-25T12:22:08.909810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:15:54.796303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":182,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.919869+0000","last_change":"2024-04-25T12:21:13.081186+0000","last_active":"2024-04-25T12:22:04.919869+0000","last_peered":"2024-04-25T12:22:04.919869+0000","last_clean":"2024-04-25T12:22:04.919869+0000","last_became_active":"2024-04-25T12:21:13.076753+0000","last_became_peered":"2024-04-25T12:21:13.076753+0000","last_unstale":"2024-04-25T12:22:04.919869+0000","last_undegraded":"2024-04-25T12:22:04.919869+0000","last_fullsized":"2024-04-25T12:22:04.919869+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:12.013694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:12.013694+0000","last_clean_scrub_stamp":"2024-04-25T12:21:12.013694+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:18:03.288120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.894131+0000","last_change":"2024-04-25T12:21:28.379372+0000","last_active":"2024-04-25T12:22:04.894131+0000","last_peered":"2024-04-25T12:22:04.894131+0000","last_clean":"2024-04-25T12:22:04.894131+0000","last_became_active":"2024-04-25T12:21:28.378522+0000","last_became_peered":"2024-04-25T12:21:28.378522+0000","last_unstale":"2024-04-25T12:22:04.894131+0000","last_undegraded":"2024-04-25T12:22:04.894131+0000","last_fullsized":"2024-04-25T12:22:04.894131+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:54:35.288829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.921450+0000","last_change":"2024-04-25T12:21:24.144632+0000","last_active":"2024-04-25T12:22:04.921450+0000","last_peered":"2024-04-25T12:22:04.921450+0000","last_clean":"2024-04-25T12:22:04.921450+0000","last_became_active":"2024-04-25T12:21:24.142085+0000","last_became_peered":"2024-04-25T12:21:24.142085+0000","last_unstale":"2024-04-25T12:22:04.921450+0000","last_undegraded":"2024-04-25T12:22:04.921450+0000","last_fullsized":"2024-04-25T12:22:04.921450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:16:55.634329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:23.478572+0000","last_change":"2024-04-25T12:21:23.126527+0000","last_active":"2024-04-25T12:22:23.478572+0000","last_peered":"2024-04-25T12:22:23.478572+0000","last_clean":"2024-04-25T12:22:23.478572+0000","last_became_active":"2024-04-25T12:21:23.126103+0000","last_became_peered":"2024-04-25T12:21:23.126103+0000","last_unstale":"2024-04-25T12:22:23.478572+0000","last_undegraded":"2024-04-25T12:22:23.478572+0000","last_fullsized":"2024-04-25T12:22:23.478572+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:16:36.502824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.891785+0000","last_change":"2024-04-25T12:21:28.379480+0000","last_active":"2024-04-25T12:22:04.891785+0000","last_peered":"2024-04-25T12:22:04.891785+0000","last_clean":"2024-04-25T12:22:04.891785+0000","last_became_active":"2024-04-25T12:21:28.378559+0000","last_became_peered":"2024-04-25T12:21:28.378559+0000","last_unstale":"2024-04-25T12:22:04.891785+0000","last_undegraded":"2024-04-25T12:22:04.891785+0000","last_fullsized":"2024-04-25T12:22:04.891785+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:40.975592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.886708+0000","last_change":"2024-04-25T12:21:24.129518+0000","last_active":"2024-04-25T12:22:04.886708+0000","last_peered":"2024-04-25T12:22:04.886708+0000","last_clean":"2024-04-25T12:22:04.886708+0000","last_became_active":"2024-04-25T12:21:24.126968+0000","last_became_peered":"2024-04-25T12:21:24.126968+0000","last_unstale":"2024-04-25T12:22:04.886708+0000","last_undegraded":"2024-04-25T12:22:04.886708+0000","last_fullsized":"2024-04-25T12:22:04.886708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:49.243645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:08.913274+0000","last_change":"2024-04-25T12:21:23.116529+0000","last_active":"2024-04-25T12:22:08.913274+0000","last_peered":"2024-04-25T12:22:08.913274+0000","last_clean":"2024-04-25T12:22:08.913274+0000","last_became_active":"2024-04-25T12:21:23.116148+0000","last_became_peered":"2024-04-25T12:21:23.116148+0000","last_unstale":"2024-04-25T12:22:08.913274+0000","last_undegraded":"2024-04-25T12:22:08.913274+0000","last_fullsized":"2024-04-25T12:22:08.913274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:01:45.567238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.897064+0000","last_change":"2024-04-25T12:21:28.194823+0000","last_active":"2024-04-25T12:22:04.897064+0000","last_peered":"2024-04-25T12:22:04.897064+0000","last_clean":"2024-04-25T12:22:04.897064+0000","last_became_active":"2024-04-25T12:21:28.194191+0000","last_became_peered":"2024-04-25T12:21:28.194191+0000","last_unstale":"2024-04-25T12:22:04.897064+0000","last_undegraded":"2024-04-25T12:22:04.897064+0000","last_fullsized":"2024-04-25T12:22:04.897064+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:50:30.454926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.921672+0000","last_change":"2024-04-25T12:21:24.146733+0000","last_active":"2024-04-25T12:22:04.921672+0000","last_peered":"2024-04-25T12:22:04.921672+0000","last_clean":"2024-04-25T12:22:04.921672+0000","last_became_active":"2024-04-25T12:21:24.145807+0000","last_became_peered":"2024-04-25T12:21:24.145807+0000","last_unstale":"2024-04-25T12:22:04.921672+0000","last_undegraded":"2024-04-25T12:22:04.921672+0000","last_fullsized":"2024-04-25T12:22:04.921672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:07:35.092827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:14.944106+0000","last_change":"2024-04-25T12:21:23.103393+0000","last_active":"2024-04-25T12:22:14.944106+0000","last_peered":"2024-04-25T12:22:14.944106+0000","last_clean":"2024-04-25T12:22:14.944106+0000","last_became_active":"2024-04-25T12:21:23.102997+0000","last_became_peered":"2024-04-25T12:21:23.102997+0000","last_unstale":"2024-04-25T12:22:14.944106+0000","last_undegraded":"2024-04-25T12:22:14.944106+0000","last_fullsized":"2024-04-25T12:22:14.944106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:40:23.054158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.885200+0000","last_change":"2024-04-25T12:21:28.384645+0000","last_active":"2024-04-25T12:22:04.885200+0000","last_peered":"2024-04-25T12:22:04.885200+0000","last_clean":"2024-04-25T12:22:04.885200+0000","last_became_active":"2024-04-25T12:21:28.382953+0000","last_became_peered":"2024-04-25T12:21:28.382953+0000","last_unstale":"2024-04-25T12:22:04.885200+0000","last_undegraded":"2024-04-25T12:22:04.885200+0000","last_fullsized":"2024-04-25T12:22:04.885200+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:40:56.218533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.920897+0000","last_change":"2024-04-25T12:21:24.146557+0000","last_active":"2024-04-25T12:22:04.920897+0000","last_peered":"2024-04-25T12:22:04.920897+0000","last_clean":"2024-04-25T12:22:04.920897+0000","last_became_active":"2024-04-25T12:21:24.146162+0000","last_became_peered":"2024-04-25T12:21:24.146162+0000","last_unstale":"2024-04-25T12:22:04.920897+0000","last_undegraded":"2024-04-25T12:22:04.920897+0000","last_fullsized":"2024-04-25T12:22:04.920897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:09:00.995503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.889472+0000","last_change":"2024-04-25T12:21:23.135467+0000","last_active":"2024-04-25T12:22:04.889472+0000","last_peered":"2024-04-25T12:22:04.889472+0000","last_clean":"2024-04-25T12:22:04.889472+0000","last_became_active":"2024-04-25T12:21:23.134441+0000","last_became_peered":"2024-04-25T12:21:23.134441+0000","last_unstale":"2024-04-25T12:22:04.889472+0000","last_undegraded":"2024-04-25T12:22:04.889472+0000","last_fullsized":"2024-04-25T12:22:04.889472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:44:33.069221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.886118+0000","last_change":"2024-04-25T12:21:28.202610+0000","last_active":"2024-04-25T12:22:04.886118+0000","last_peered":"2024-04-25T12:22:04.886118+0000","last_clean":"2024-04-25T12:22:04.886118+0000","last_became_active":"2024-04-25T12:21:28.201479+0000","last_became_peered":"2024-04-25T12:21:28.201479+0000","last_unstale":"2024-04-25T12:22:04.886118+0000","last_undegraded":"2024-04-25T12:22:04.886118+0000","last_fullsized":"2024-04-25T12:22:04.886118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:25:15.458202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.920270+0000","last_change":"2024-04-25T12:21:24.145131+0000","last_active":"2024-04-25T12:22:04.920270+0000","last_peered":"2024-04-25T12:22:04.920270+0000","last_clean":"2024-04-25T12:22:04.920270+0000","last_became_active":"2024-04-25T12:21:24.142422+0000","last_became_peered":"2024-04-25T12:21:24.142422+0000","last_unstale":"2024-04-25T12:22:04.920270+0000","last_undegraded":"2024-04-25T12:22:04.920270+0000","last_fullsized":"2024-04-25T12:22:04.920270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:40:24.312543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'17","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:08.910633+0000","last_change":"2024-04-25T12:21:23.104288+0000","last_active":"2024-04-25T12:22:08.910633+0000","last_peered":"2024-04-25T12:22:08.910633+0000","last_clean":"2024-04-25T12:22:08.910633+0000","last_became_active":"2024-04-25T12:21:23.103680+0000","last_became_peered":"2024-04-25T12:21:23.103680+0000","last_unstale":"2024-04-25T12:22:08.910633+0000","last_undegraded":"2024-04-25T12:22:08.910633+0000","last_fullsized":"2024-04-25T12:22:08.910633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:29.672890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.898513+0000","last_change":"2024-04-25T12:21:28.199834+0000","last_active":"2024-04-25T12:22:04.898513+0000","last_peered":"2024-04-25T12:22:04.898513+0000","last_clean":"2024-04-25T12:22:04.898513+0000","last_became_active":"2024-04-25T12:21:28.199411+0000","last_became_peered":"2024-04-25T12:21:28.199411+0000","last_unstale":"2024-04-25T12:22:04.898513+0000","last_undegraded":"2024-04-25T12:22:04.898513+0000","last_fullsized":"2024-04-25T12:22:04.898513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:52:34.443813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.892493+0000","last_change":"2024-04-25T12:21:24.127488+0000","last_active":"2024-04-25T12:22:04.892493+0000","last_peered":"2024-04-25T12:22:04.892493+0000","last_clean":"2024-04-25T12:22:04.892493+0000","last_became_active":"2024-04-25T12:21:24.126721+0000","last_became_peered":"2024-04-25T12:21:24.126721+0000","last_unstale":"2024-04-25T12:22:04.892493+0000","last_undegraded":"2024-04-25T12:22:04.892493+0000","last_fullsized":"2024-04-25T12:22:04.892493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:02.153025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:23.488464+0000","last_change":"2024-04-25T12:21:23.139626+0000","last_active":"2024-04-25T12:22:23.488464+0000","last_peered":"2024-04-25T12:22:23.488464+0000","last_clean":"2024-04-25T12:22:23.488464+0000","last_became_active":"2024-04-25T12:21:23.138837+0000","last_became_peered":"2024-04-25T12:21:23.138837+0000","last_unstale":"2024-04-25T12:22:23.488464+0000","last_undegraded":"2024-04-25T12:22:23.488464+0000","last_fullsized":"2024-04-25T12:22:23.488464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:09.309384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.888695+0000","last_change":"2024-04-25T12:21:28.383919+0000","last_active":"2024-04-25T12:22:04.888695+0000","last_peered":"2024-04-25T12:22:04.888695+0000","last_clean":"2024-04-25T12:22:04.888695+0000","last_became_active":"2024-04-25T12:21:28.383298+0000","last_became_peered":"2024-04-25T12:21:28.383298+0000","last_unstale":"2024-04-25T12:22:04.888695+0000","last_undegraded":"2024-04-25T12:22:04.888695+0000","last_fullsized":"2024-04-25T12:22:04.888695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:01.115040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.921039+0000","last_change":"2024-04-25T12:21:24.146454+0000","last_active":"2024-04-25T12:22:04.921039+0000","last_peered":"2024-04-25T12:22:04.921039+0000","last_clean":"2024-04-25T12:22:04.921039+0000","last_became_active":"2024-04-25T12:21:24.145931+0000","last_became_peered":"2024-04-25T12:21:24.145931+0000","last_unstale":"2024-04-25T12:22:04.921039+0000","last_undegraded":"2024-04-25T12:22:04.921039+0000","last_fullsized":"2024-04-25T12:22:04.921039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:35:22.490243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:08.909090+0000","last_change":"2024-04-25T12:21:23.122495+0000","last_active":"2024-04-25T12:22:08.909090+0000","last_peered":"2024-04-25T12:22:08.909090+0000","last_clean":"2024-04-25T12:22:08.909090+0000","last_became_active":"2024-04-25T12:21:23.121429+0000","last_became_peered":"2024-04-25T12:21:23.121429+0000","last_unstale":"2024-04-25T12:22:08.909090+0000","last_undegraded":"2024-04-25T12:22:08.909090+0000","last_fullsized":"2024-04-25T12:22:08.909090+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:10.530248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.886402+0000","last_change":"2024-04-25T12:21:28.375971+0000","last_active":"2024-04-25T12:22:04.886402+0000","last_peered":"2024-04-25T12:22:04.886402+0000","last_clean":"2024-04-25T12:22:04.886402+0000","last_became_active":"2024-04-25T12:21:28.375013+0000","last_became_peered":"2024-04-25T12:21:28.375013+0000","last_unstale":"2024-04-25T12:22:04.886402+0000","last_undegraded":"2024-04-25T12:22:04.886402+0000","last_fullsized":"2024-04-25T12:22:04.886402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:56:45.398763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.895854+0000","last_change":"2024-04-25T12:21:24.138293+0000","last_active":"2024-04-25T12:22:04.895854+0000","last_peered":"2024-04-25T12:22:04.895854+0000","last_clean":"2024-04-25T12:22:04.895854+0000","last_became_active":"2024-04-25T12:21:24.138016+0000","last_became_peered":"2024-04-25T12:21:24.138016+0000","last_unstale":"2024-04-25T12:22:04.895854+0000","last_undegraded":"2024-04-25T12:22:04.895854+0000","last_fullsized":"2024-04-25T12:22:04.895854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:48:54.078239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'9","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:14.940825+0000","last_change":"2024-04-25T12:21:23.136227+0000","last_active":"2024-04-25T12:22:14.940825+0000","last_peered":"2024-04-25T12:22:14.940825+0000","last_clean":"2024-04-25T12:22:14.940825+0000","last_became_active":"2024-04-25T12:21:23.135947+0000","last_became_peered":"2024-04-25T12:21:23.135947+0000","last_unstale":"2024-04-25T12:22:14.940825+0000","last_undegraded":"2024-04-25T12:22:14.940825+0000","last_fullsized":"2024-04-25T12:22:14.940825+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:41:24.323924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.886878+0000","last_change":"2024-04-25T12:21:28.378564+0000","last_active":"2024-04-25T12:22:04.886878+0000","last_peered":"2024-04-25T12:22:04.886878+0000","last_clean":"2024-04-25T12:22:04.886878+0000","last_became_active":"2024-04-25T12:21:28.377532+0000","last_became_peered":"2024-04-25T12:21:28.377532+0000","last_unstale":"2024-04-25T12:22:04.886878+0000","last_undegraded":"2024-04-25T12:22:04.886878+0000","last_fullsized":"2024-04-25T12:22:04.886878+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:20.576562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.902496+0000","last_change":"2024-04-25T12:22:04.900963+0000","last_active":"2024-04-25T12:22:04.902496+0000","last_peered":"2024-04-25T12:22:04.902496+0000","last_clean":"2024-04-25T12:22:04.902496+0000","last_became_active":"2024-04-25T12:22:04.899942+0000","last_became_peered":"2024-04-25T12:22:04.899942+0000","last_unstale":"2024-04-25T12:22:04.902496+0000","last_undegraded":"2024-04-25T12:22:04.902496+0000","last_fullsized":"2024-04-25T12:22:04.902496+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:34:36.179214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.14","version":"26'16","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:23.494045+0000","last_change":"2024-04-25T12:21:23.130231+0000","last_active":"2024-04-25T12:22:23.494045+0000","last_peered":"2024-04-25T12:22:23.494045+0000","last_clean":"2024-04-25T12:22:23.494045+0000","last_became_active":"2024-04-25T12:21:23.129474+0000","last_became_peered":"2024-04-25T12:21:23.129474+0000","last_unstale":"2024-04-25T12:22:23.494045+0000","last_undegraded":"2024-04-25T12:22:23.494045+0000","last_fullsized":"2024-04-25T12:22:23.494045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:50.974387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4424,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.920504+0000","last_change":"2024-04-25T12:21:28.200551+0000","last_active":"2024-04-25T12:22:04.920504+0000","last_peered":"2024-04-25T12:22:04.920504+0000","last_clean":"2024-04-25T12:22:04.920504+0000","last_became_active":"2024-04-25T12:21:28.200152+0000","last_became_peered":"2024-04-25T12:21:28.200152+0000","last_unstale":"2024-04-25T12:22:04.920504+0000","last_undegraded":"2024-04-25T12:22:04.920504+0000","last_fullsized":"2024-04-25T12:22:04.920504+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:17:34.847925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.889734+0000","last_change":"2024-04-25T12:21:24.142957+0000","last_active":"2024-04-25T12:22:04.889734+0000","last_peered":"2024-04-25T12:22:04.889734+0000","last_clean":"2024-04-25T12:22:04.889734+0000","last_became_active":"2024-04-25T12:21:24.142594+0000","last_became_peered":"2024-04-25T12:21:24.142594+0000","last_unstale":"2024-04-25T12:22:04.889734+0000","last_undegraded":"2024-04-25T12:22:04.889734+0000","last_fullsized":"2024-04-25T12:22:04.889734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:36:47.719946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.922151+0000","last_change":"2024-04-25T12:21:23.125118+0000","last_active":"2024-04-25T12:22:04.922151+0000","last_peered":"2024-04-25T12:22:04.922151+0000","last_clean":"2024-04-25T12:22:04.922151+0000","last_became_active":"2024-04-25T12:21:23.124836+0000","last_became_peered":"2024-04-25T12:21:23.124836+0000","last_unstale":"2024-04-25T12:22:04.922151+0000","last_undegraded":"2024-04-25T12:22:04.922151+0000","last_fullsized":"2024-04-25T12:22:04.922151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:03:28.500940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.889244+0000","last_change":"2024-04-25T12:21:28.194476+0000","last_active":"2024-04-25T12:22:04.889244+0000","last_peered":"2024-04-25T12:22:04.889244+0000","last_clean":"2024-04-25T12:22:04.889244+0000","last_became_active":"2024-04-25T12:21:28.193277+0000","last_became_peered":"2024-04-25T12:21:28.193277+0000","last_unstale":"2024-04-25T12:22:04.889244+0000","last_undegraded":"2024-04-25T12:22:04.889244+0000","last_fullsized":"2024-04-25T12:22:04.889244+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:31.495441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.898278+0000","last_change":"2024-04-25T12:21:24.115104+0000","last_active":"2024-04-25T12:22:04.898278+0000","last_peered":"2024-04-25T12:22:04.898278+0000","last_clean":"2024-04-25T12:22:04.898278+0000","last_became_active":"2024-04-25T12:21:24.114367+0000","last_became_peered":"2024-04-25T12:21:24.114367+0000","last_unstale":"2024-04-25T12:22:04.898278+0000","last_undegraded":"2024-04-25T12:22:04.898278+0000","last_fullsized":"2024-04-25T12:22:04.898278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:03.107076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:14.951344+0000","last_change":"2024-04-25T12:21:23.132996+0000","last_active":"2024-04-25T12:22:14.951344+0000","last_peered":"2024-04-25T12:22:14.951344+0000","last_clean":"2024-04-25T12:22:14.951344+0000","last_became_active":"2024-04-25T12:21:23.132223+0000","last_became_peered":"2024-04-25T12:21:23.132223+0000","last_unstale":"2024-04-25T12:22:14.951344+0000","last_undegraded":"2024-04-25T12:22:14.951344+0000","last_fullsized":"2024-04-25T12:22:14.951344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:18.689461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.886057+0000","last_change":"2024-04-25T12:21:28.203302+0000","last_active":"2024-04-25T12:22:04.886057+0000","last_peered":"2024-04-25T12:22:04.886057+0000","last_clean":"2024-04-25T12:22:04.886057+0000","last_became_active":"2024-04-25T12:21:28.202800+0000","last_became_peered":"2024-04-25T12:21:28.202800+0000","last_unstale":"2024-04-25T12:22:04.886057+0000","last_undegraded":"2024-04-25T12:22:04.886057+0000","last_fullsized":"2024-04-25T12:22:04.886057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:27:16.676736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.925107+0000","last_change":"2024-04-25T12:22:04.922613+0000","last_active":"2024-04-25T12:22:04.925107+0000","last_peered":"2024-04-25T12:22:04.925107+0000","last_clean":"2024-04-25T12:22:04.925107+0000","last_became_active":"2024-04-25T12:22:04.921770+0000","last_became_peered":"2024-04-25T12:22:04.921770+0000","last_unstale":"2024-04-25T12:22:04.925107+0000","last_undegraded":"2024-04-25T12:22:04.925107+0000","last_fullsized":"2024-04-25T12:22:04.925107+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:19:15.639901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"26'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:23.484338+0000","last_change":"2024-04-25T12:21:23.130843+0000","last_active":"2024-04-25T12:22:23.484338+0000","last_peered":"2024-04-25T12:22:23.484338+0000","last_clean":"2024-04-25T12:22:23.484338+0000","last_became_active":"2024-04-25T12:21:23.129967+0000","last_became_peered":"2024-04-25T12:21:23.129967+0000","last_unstale":"2024-04-25T12:22:23.484338+0000","last_undegraded":"2024-04-25T12:22:23.484338+0000","last_fullsized":"2024-04-25T12:22:23.484338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:19:22.719364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.885925+0000","last_change":"2024-04-25T12:21:28.384082+0000","last_active":"2024-04-25T12:22:04.885925+0000","last_peered":"2024-04-25T12:22:04.885925+0000","last_clean":"2024-04-25T12:22:04.885925+0000","last_became_active":"2024-04-25T12:21:28.383228+0000","last_became_peered":"2024-04-25T12:21:28.383228+0000","last_unstale":"2024-04-25T12:22:04.885925+0000","last_undegraded":"2024-04-25T12:22:04.885925+0000","last_fullsized":"2024-04-25T12:22:04.885925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:14.600341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.898196+0000","last_change":"2024-04-25T12:21:28.378352+0000","last_active":"2024-04-25T12:22:04.898196+0000","last_peered":"2024-04-25T12:22:04.898196+0000","last_clean":"2024-04-25T12:22:04.898196+0000","last_became_active":"2024-04-25T12:21:28.377742+0000","last_became_peered":"2024-04-25T12:21:28.377742+0000","last_unstale":"2024-04-25T12:22:04.898196+0000","last_undegraded":"2024-04-25T12:22:04.898196+0000","last_fullsized":"2024-04-25T12:22:04.898196+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:20.075296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.920494+0000","last_change":"2024-04-25T12:21:24.126158+0000","last_active":"2024-04-25T12:22:04.920494+0000","last_peered":"2024-04-25T12:22:04.920494+0000","last_clean":"2024-04-25T12:22:04.920494+0000","last_became_active":"2024-04-25T12:21:24.125448+0000","last_became_peered":"2024-04-25T12:21:24.125448+0000","last_unstale":"2024-04-25T12:22:04.920494+0000","last_undegraded":"2024-04-25T12:22:04.920494+0000","last_fullsized":"2024-04-25T12:22:04.920494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:42.769206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:08.908401+0000","last_change":"2024-04-25T12:21:23.117159+0000","last_active":"2024-04-25T12:22:08.908401+0000","last_peered":"2024-04-25T12:22:08.908401+0000","last_clean":"2024-04-25T12:22:08.908401+0000","last_became_active":"2024-04-25T12:21:23.115911+0000","last_became_peered":"2024-04-25T12:21:23.115911+0000","last_unstale":"2024-04-25T12:22:08.908401+0000","last_undegraded":"2024-04-25T12:22:08.908401+0000","last_fullsized":"2024-04-25T12:22:08.908401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:46:10.238958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.900044+0000","last_change":"2024-04-25T12:22:04.900044+0000","last_active":"2024-04-25T12:22:04.900044+0000","last_peered":"2024-04-25T12:22:04.900044+0000","last_clean":"2024-04-25T12:22:04.900044+0000","last_became_active":"2024-04-25T12:22:04.899300+0000","last_became_peered":"2024-04-25T12:22:04.899300+0000","last_unstale":"2024-04-25T12:22:04.900044+0000","last_undegraded":"2024-04-25T12:22:04.900044+0000","last_fullsized":"2024-04-25T12:22:04.900044+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:00:51.607957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,0],"acting":[6,5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.886379+0000","last_change":"2024-04-25T12:21:24.137477+0000","last_active":"2024-04-25T12:22:04.886379+0000","last_peered":"2024-04-25T12:22:04.886379+0000","last_clean":"2024-04-25T12:22:04.886379+0000","last_became_active":"2024-04-25T12:21:24.137078+0000","last_became_peered":"2024-04-25T12:21:24.137078+0000","last_unstale":"2024-04-25T12:22:04.886379+0000","last_undegraded":"2024-04-25T12:22:04.886379+0000","last_fullsized":"2024-04-25T12:22:04.886379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:53.321239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.886985+0000","last_change":"2024-04-25T12:21:23.130046+0000","last_active":"2024-04-25T12:22:04.886985+0000","last_peered":"2024-04-25T12:22:04.886985+0000","last_clean":"2024-04-25T12:22:04.886985+0000","last_became_active":"2024-04-25T12:21:23.129779+0000","last_became_peered":"2024-04-25T12:21:23.129779+0000","last_unstale":"2024-04-25T12:22:04.886985+0000","last_undegraded":"2024-04-25T12:22:04.886985+0000","last_fullsized":"2024-04-25T12:22:04.886985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:24:43.733780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:08.910854+0000","last_change":"2024-04-25T12:21:23.138152+0000","last_active":"2024-04-25T12:22:08.910854+0000","last_peered":"2024-04-25T12:22:08.910854+0000","last_clean":"2024-04-25T12:22:08.910854+0000","last_became_active":"2024-04-25T12:21:23.137393+0000","last_became_peered":"2024-04-25T12:21:23.137393+0000","last_unstale":"2024-04-25T12:22:08.910854+0000","last_undegraded":"2024-04-25T12:22:08.910854+0000","last_fullsized":"2024-04-25T12:22:08.910854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:10:42.713304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.897354+0000","last_change":"2024-04-25T12:21:24.122299+0000","last_active":"2024-04-25T12:22:04.897354+0000","last_peered":"2024-04-25T12:22:04.897354+0000","last_clean":"2024-04-25T12:22:04.897354+0000","last_became_active":"2024-04-25T12:21:24.121480+0000","last_became_peered":"2024-04-25T12:21:24.121480+0000","last_unstale":"2024-04-25T12:22:04.897354+0000","last_undegraded":"2024-04-25T12:22:04.897354+0000","last_fullsized":"2024-04-25T12:22:04.897354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:05:46.050357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.900613+0000","last_change":"2024-04-25T12:22:04.900613+0000","last_active":"2024-04-25T12:22:04.900613+0000","last_peered":"2024-04-25T12:22:04.900613+0000","last_clean":"2024-04-25T12:22:04.900613+0000","last_became_active":"2024-04-25T12:22:04.900006+0000","last_became_peered":"2024-04-25T12:22:04.900006+0000","last_unstale":"2024-04-25T12:22:04.900613+0000","last_undegraded":"2024-04-25T12:22:04.900613+0000","last_fullsized":"2024-04-25T12:22:04.900613+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:06:18.454386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,5],"acting":[2,0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:23.483056+0000","last_change":"2024-04-25T12:21:23.113080+0000","last_active":"2024-04-25T12:22:23.483056+0000","last_peered":"2024-04-25T12:22:23.483056+0000","last_clean":"2024-04-25T12:22:23.483056+0000","last_became_active":"2024-04-25T12:21:23.112721+0000","last_became_peered":"2024-04-25T12:21:23.112721+0000","last_unstale":"2024-04-25T12:22:23.483056+0000","last_undegraded":"2024-04-25T12:22:23.483056+0000","last_fullsized":"2024-04-25T12:22:23.483056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:25.396377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.888327+0000","last_change":"2024-04-25T12:21:24.134267+0000","last_active":"2024-04-25T12:22:04.888327+0000","last_peered":"2024-04-25T12:22:04.888327+0000","last_clean":"2024-04-25T12:22:04.888327+0000","last_became_active":"2024-04-25T12:21:24.133493+0000","last_became_peered":"2024-04-25T12:21:24.133493+0000","last_unstale":"2024-04-25T12:22:04.888327+0000","last_undegraded":"2024-04-25T12:22:04.888327+0000","last_fullsized":"2024-04-25T12:22:04.888327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:24:25.810067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.896184+0000","last_change":"2024-04-25T12:22:04.896184+0000","last_active":"2024-04-25T12:22:04.896184+0000","last_peered":"2024-04-25T12:22:04.896184+0000","last_clean":"2024-04-25T12:22:04.896184+0000","last_became_active":"2024-04-25T12:22:04.895198+0000","last_became_peered":"2024-04-25T12:22:04.895198+0000","last_unstale":"2024-04-25T12:22:04.896184+0000","last_undegraded":"2024-04-25T12:22:04.896184+0000","last_fullsized":"2024-04-25T12:22:04.896184+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:00.687023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,2],"acting":[3,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.892094+0000","last_change":"2024-04-25T12:21:24.126582+0000","last_active":"2024-04-25T12:22:04.892094+0000","last_peered":"2024-04-25T12:22:04.892094+0000","last_clean":"2024-04-25T12:22:04.892094+0000","last_became_active":"2024-04-25T12:21:24.125831+0000","last_became_peered":"2024-04-25T12:21:24.125831+0000","last_unstale":"2024-04-25T12:22:04.892094+0000","last_undegraded":"2024-04-25T12:22:04.892094+0000","last_fullsized":"2024-04-25T12:22:04.892094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:53.129274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.891228+0000","last_change":"2024-04-25T12:21:24.117441+0000","last_active":"2024-04-25T12:22:04.891228+0000","last_peered":"2024-04-25T12:22:04.891228+0000","last_clean":"2024-04-25T12:22:04.891228+0000","last_became_active":"2024-04-25T12:21:24.116498+0000","last_became_peered":"2024-04-25T12:21:24.116498+0000","last_unstale":"2024-04-25T12:22:04.891228+0000","last_undegraded":"2024-04-25T12:22:04.891228+0000","last_fullsized":"2024-04-25T12:22:04.891228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:06:45.632199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.886040+0000","last_change":"2024-04-25T12:21:24.117995+0000","last_active":"2024-04-25T12:22:04.886040+0000","last_peered":"2024-04-25T12:22:04.886040+0000","last_clean":"2024-04-25T12:22:04.886040+0000","last_became_active":"2024-04-25T12:21:24.114742+0000","last_became_peered":"2024-04-25T12:21:24.114742+0000","last_unstale":"2024-04-25T12:22:04.886040+0000","last_undegraded":"2024-04-25T12:22:04.886040+0000","last_fullsized":"2024-04-25T12:22:04.886040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:59.864082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.897343+0000","last_change":"2024-04-25T12:21:24.134863+0000","last_active":"2024-04-25T12:22:04.897343+0000","last_peered":"2024-04-25T12:22:04.897343+0000","last_clean":"2024-04-25T12:22:04.897343+0000","last_became_active":"2024-04-25T12:21:24.126476+0000","last_became_peered":"2024-04-25T12:21:24.126476+0000","last_unstale":"2024-04-25T12:22:04.897343+0000","last_undegraded":"2024-04-25T12:22:04.897343+0000","last_fullsized":"2024-04-25T12:22:04.897343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:19:32.516429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.887326+0000","last_change":"2024-04-25T12:21:24.135699+0000","last_active":"2024-04-25T12:22:04.887326+0000","last_peered":"2024-04-25T12:22:04.887326+0000","last_clean":"2024-04-25T12:22:04.887326+0000","last_became_active":"2024-04-25T12:21:24.135257+0000","last_became_peered":"2024-04-25T12:21:24.135257+0000","last_unstale":"2024-04-25T12:22:04.887326+0000","last_undegraded":"2024-04-25T12:22:04.887326+0000","last_fullsized":"2024-04-25T12:22:04.887326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:55:21.195220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.921749+0000","last_change":"2024-04-25T12:21:24.132760+0000","last_active":"2024-04-25T12:22:04.921749+0000","last_peered":"2024-04-25T12:22:04.921749+0000","last_clean":"2024-04-25T12:22:04.921749+0000","last_became_active":"2024-04-25T12:21:24.132225+0000","last_became_peered":"2024-04-25T12:21:24.132225+0000","last_unstale":"2024-04-25T12:22:04.921749+0000","last_undegraded":"2024-04-25T12:22:04.921749+0000","last_fullsized":"2024-04-25T12:22:04.921749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:44:23.025905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.895018+0000","last_change":"2024-04-25T12:21:24.148515+0000","last_active":"2024-04-25T12:22:04.895018+0000","last_peered":"2024-04-25T12:22:04.895018+0000","last_clean":"2024-04-25T12:22:04.895018+0000","last_became_active":"2024-04-25T12:21:24.148025+0000","last_became_peered":"2024-04-25T12:21:24.148025+0000","last_unstale":"2024-04-25T12:22:04.895018+0000","last_undegraded":"2024-04-25T12:22:04.895018+0000","last_fullsized":"2024-04-25T12:22:04.895018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:49:29.665678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.888799+0000","last_change":"2024-04-25T12:21:24.135856+0000","last_active":"2024-04-25T12:22:04.888799+0000","last_peered":"2024-04-25T12:22:04.888799+0000","last_clean":"2024-04-25T12:22:04.888799+0000","last_became_active":"2024-04-25T12:21:24.135310+0000","last_became_peered":"2024-04-25T12:21:24.135310+0000","last_unstale":"2024-04-25T12:22:04.888799+0000","last_undegraded":"2024-04-25T12:22:04.888799+0000","last_fullsized":"2024-04-25T12:22:04.888799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:02.396753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.885451+0000","last_change":"2024-04-25T12:21:24.119002+0000","last_active":"2024-04-25T12:22:04.885451+0000","last_peered":"2024-04-25T12:22:04.885451+0000","last_clean":"2024-04-25T12:22:04.885451+0000","last_became_active":"2024-04-25T12:21:24.112992+0000","last_became_peered":"2024-04-25T12:21:24.112992+0000","last_unstale":"2024-04-25T12:22:04.885451+0000","last_undegraded":"2024-04-25T12:22:04.885451+0000","last_fullsized":"2024-04-25T12:22:04.885451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:44:34.461656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.886239+0000","last_change":"2024-04-25T12:21:24.118251+0000","last_active":"2024-04-25T12:22:04.886239+0000","last_peered":"2024-04-25T12:22:04.886239+0000","last_clean":"2024-04-25T12:22:04.886239+0000","last_became_active":"2024-04-25T12:21:24.117412+0000","last_became_peered":"2024-04-25T12:21:24.117412+0000","last_unstale":"2024-04-25T12:22:04.886239+0000","last_undegraded":"2024-04-25T12:22:04.886239+0000","last_fullsized":"2024-04-25T12:22:04.886239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:44:13.238510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.885958+0000","last_change":"2024-04-25T12:21:24.138641+0000","last_active":"2024-04-25T12:22:04.885958+0000","last_peered":"2024-04-25T12:22:04.885958+0000","last_clean":"2024-04-25T12:22:04.885958+0000","last_became_active":"2024-04-25T12:21:24.137937+0000","last_became_peered":"2024-04-25T12:21:24.137937+0000","last_unstale":"2024-04-25T12:22:04.885958+0000","last_undegraded":"2024-04-25T12:22:04.885958+0000","last_fullsized":"2024-04-25T12:22:04.885958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:55:49.291319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.896812+0000","last_change":"2024-04-25T12:21:24.137779+0000","last_active":"2024-04-25T12:22:04.896812+0000","last_peered":"2024-04-25T12:22:04.896812+0000","last_clean":"2024-04-25T12:22:04.896812+0000","last_became_active":"2024-04-25T12:21:24.137431+0000","last_became_peered":"2024-04-25T12:21:24.137431+0000","last_unstale":"2024-04-25T12:22:04.896812+0000","last_undegraded":"2024-04-25T12:22:04.896812+0000","last_fullsized":"2024-04-25T12:22:04.896812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:24:24.181972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.894528+0000","last_change":"2024-04-25T12:21:24.128960+0000","last_active":"2024-04-25T12:22:04.894528+0000","last_peered":"2024-04-25T12:22:04.894528+0000","last_clean":"2024-04-25T12:22:04.894528+0000","last_became_active":"2024-04-25T12:21:24.128125+0000","last_became_peered":"2024-04-25T12:21:24.128125+0000","last_unstale":"2024-04-25T12:22:04.894528+0000","last_undegraded":"2024-04-25T12:22:04.894528+0000","last_fullsized":"2024-04-25T12:22:04.894528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:01.701850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.921873+0000","last_change":"2024-04-25T12:21:24.149001+0000","last_active":"2024-04-25T12:22:04.921873+0000","last_peered":"2024-04-25T12:22:04.921873+0000","last_clean":"2024-04-25T12:22:04.921873+0000","last_became_active":"2024-04-25T12:21:24.147230+0000","last_became_peered":"2024-04-25T12:21:24.147230+0000","last_unstale":"2024-04-25T12:22:04.921873+0000","last_undegraded":"2024-04-25T12:22:04.921873+0000","last_fullsized":"2024-04-25T12:22:04.921873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:05:17.824845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.891883+0000","last_change":"2024-04-25T12:21:24.119941+0000","last_active":"2024-04-25T12:22:04.891883+0000","last_peered":"2024-04-25T12:22:04.891883+0000","last_clean":"2024-04-25T12:22:04.891883+0000","last_became_active":"2024-04-25T12:21:24.118761+0000","last_became_peered":"2024-04-25T12:21:24.118761+0000","last_unstale":"2024-04-25T12:22:04.891883+0000","last_undegraded":"2024-04-25T12:22:04.891883+0000","last_fullsized":"2024-04-25T12:22:04.891883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:49:41.353812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.887528+0000","last_change":"2024-04-25T12:21:24.144163+0000","last_active":"2024-04-25T12:22:04.887528+0000","last_peered":"2024-04-25T12:22:04.887528+0000","last_clean":"2024-04-25T12:22:04.887528+0000","last_became_active":"2024-04-25T12:21:24.143786+0000","last_became_peered":"2024-04-25T12:21:24.143786+0000","last_unstale":"2024-04-25T12:22:04.887528+0000","last_undegraded":"2024-04-25T12:22:04.887528+0000","last_fullsized":"2024-04-25T12:22:04.887528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:17.961437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.885408+0000","last_change":"2024-04-25T12:21:24.107551+0000","last_active":"2024-04-25T12:22:04.885408+0000","last_peered":"2024-04-25T12:22:04.885408+0000","last_clean":"2024-04-25T12:22:04.885408+0000","last_became_active":"2024-04-25T12:21:24.106818+0000","last_became_peered":"2024-04-25T12:21:24.106818+0000","last_unstale":"2024-04-25T12:22:04.885408+0000","last_undegraded":"2024-04-25T12:22:04.885408+0000","last_fullsized":"2024-04-25T12:22:04.885408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:09:24.627007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.920846+0000","last_change":"2024-04-25T12:21:24.114917+0000","last_active":"2024-04-25T12:22:04.920846+0000","last_peered":"2024-04-25T12:22:04.920846+0000","last_clean":"2024-04-25T12:22:04.920846+0000","last_became_active":"2024-04-25T12:21:24.114237+0000","last_became_peered":"2024-04-25T12:21:24.114237+0000","last_unstale":"2024-04-25T12:22:04.920846+0000","last_undegraded":"2024-04-25T12:22:04.920846+0000","last_fullsized":"2024-04-25T12:22:04.920846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:32:38.296553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.895600+0000","last_change":"2024-04-25T12:21:24.132860+0000","last_active":"2024-04-25T12:22:04.895600+0000","last_peered":"2024-04-25T12:22:04.895600+0000","last_clean":"2024-04-25T12:22:04.895600+0000","last_became_active":"2024-04-25T12:21:24.132094+0000","last_became_peered":"2024-04-25T12:21:24.132094+0000","last_unstale":"2024-04-25T12:22:04.895600+0000","last_undegraded":"2024-04-25T12:22:04.895600+0000","last_fullsized":"2024-04-25T12:22:04.895600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:27:24.026145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.901390+0000","last_change":"2024-04-25T12:22:04.897436+0000","last_active":"2024-04-25T12:22:04.901390+0000","last_peered":"2024-04-25T12:22:04.901390+0000","last_clean":"2024-04-25T12:22:04.901390+0000","last_became_active":"2024-04-25T12:22:04.896529+0000","last_became_peered":"2024-04-25T12:22:04.896529+0000","last_unstale":"2024-04-25T12:22:04.901390+0000","last_undegraded":"2024-04-25T12:22:04.901390+0000","last_fullsized":"2024-04-25T12:22:04.901390+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:02:55.727071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.889462+0000","last_change":"2024-04-25T12:21:24.124288+0000","last_active":"2024-04-25T12:22:04.889462+0000","last_peered":"2024-04-25T12:22:04.889462+0000","last_clean":"2024-04-25T12:22:04.889462+0000","last_became_active":"2024-04-25T12:21:24.116973+0000","last_became_peered":"2024-04-25T12:21:24.116973+0000","last_unstale":"2024-04-25T12:22:04.889462+0000","last_undegraded":"2024-04-25T12:22:04.889462+0000","last_fullsized":"2024-04-25T12:22:04.889462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:34:53.390321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.894234+0000","last_change":"2024-04-25T12:21:24.115615+0000","last_active":"2024-04-25T12:22:04.894234+0000","last_peered":"2024-04-25T12:22:04.894234+0000","last_clean":"2024-04-25T12:22:04.894234+0000","last_became_active":"2024-04-25T12:21:24.114829+0000","last_became_peered":"2024-04-25T12:21:24.114829+0000","last_unstale":"2024-04-25T12:22:04.894234+0000","last_undegraded":"2024-04-25T12:22:04.894234+0000","last_fullsized":"2024-04-25T12:22:04.894234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:17.961437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.895028+0000","last_change":"2024-04-25T12:21:24.117225+0000","last_active":"2024-04-25T12:22:04.895028+0000","last_peered":"2024-04-25T12:22:04.895028+0000","last_clean":"2024-04-25T12:22:04.895028+0000","last_became_active":"2024-04-25T12:21:24.116359+0000","last_became_peered":"2024-04-25T12:21:24.116359+0000","last_unstale":"2024-04-25T12:22:04.895028+0000","last_undegraded":"2024-04-25T12:22:04.895028+0000","last_fullsized":"2024-04-25T12:22:04.895028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:22:27.461512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.921638+0000","last_change":"2024-04-25T12:21:24.145198+0000","last_active":"2024-04-25T12:22:04.921638+0000","last_peered":"2024-04-25T12:22:04.921638+0000","last_clean":"2024-04-25T12:22:04.921638+0000","last_became_active":"2024-04-25T12:21:24.142353+0000","last_became_peered":"2024-04-25T12:21:24.142353+0000","last_unstale":"2024-04-25T12:22:04.921638+0000","last_undegraded":"2024-04-25T12:22:04.921638+0000","last_fullsized":"2024-04-25T12:22:04.921638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:44:24.335226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.885945+0000","last_change":"2024-04-25T12:21:24.128086+0000","last_active":"2024-04-25T12:22:04.885945+0000","last_peered":"2024-04-25T12:22:04.885945+0000","last_clean":"2024-04-25T12:22:04.885945+0000","last_became_active":"2024-04-25T12:21:24.127315+0000","last_became_peered":"2024-04-25T12:21:24.127315+0000","last_unstale":"2024-04-25T12:22:04.885945+0000","last_undegraded":"2024-04-25T12:22:04.885945+0000","last_fullsized":"2024-04-25T12:22:04.885945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:20.513145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.920184+0000","last_change":"2024-04-25T12:21:24.142394+0000","last_active":"2024-04-25T12:22:04.920184+0000","last_peered":"2024-04-25T12:22:04.920184+0000","last_clean":"2024-04-25T12:22:04.920184+0000","last_became_active":"2024-04-25T12:21:24.142029+0000","last_became_peered":"2024-04-25T12:21:24.142029+0000","last_unstale":"2024-04-25T12:22:04.920184+0000","last_undegraded":"2024-04-25T12:22:04.920184+0000","last_fullsized":"2024-04-25T12:22:04.920184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:02:56.129724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.885858+0000","last_change":"2024-04-25T12:21:24.113876+0000","last_active":"2024-04-25T12:22:04.885858+0000","last_peered":"2024-04-25T12:22:04.885858+0000","last_clean":"2024-04-25T12:22:04.885858+0000","last_became_active":"2024-04-25T12:21:24.112339+0000","last_became_peered":"2024-04-25T12:21:24.112339+0000","last_unstale":"2024-04-25T12:22:04.885858+0000","last_undegraded":"2024-04-25T12:22:04.885858+0000","last_fullsized":"2024-04-25T12:22:04.885858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:31:44.641068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.920602+0000","last_change":"2024-04-25T12:21:24.144879+0000","last_active":"2024-04-25T12:22:04.920602+0000","last_peered":"2024-04-25T12:22:04.920602+0000","last_clean":"2024-04-25T12:22:04.920602+0000","last_became_active":"2024-04-25T12:21:24.142422+0000","last_became_peered":"2024-04-25T12:21:24.142422+0000","last_unstale":"2024-04-25T12:22:04.920602+0000","last_undegraded":"2024-04-25T12:22:04.920602+0000","last_fullsized":"2024-04-25T12:22:04.920602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:03.206429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.886225+0000","last_change":"2024-04-25T12:21:24.132561+0000","last_active":"2024-04-25T12:22:04.886225+0000","last_peered":"2024-04-25T12:22:04.886225+0000","last_clean":"2024-04-25T12:22:04.886225+0000","last_became_active":"2024-04-25T12:21:24.131746+0000","last_became_peered":"2024-04-25T12:21:24.131746+0000","last_unstale":"2024-04-25T12:22:04.886225+0000","last_undegraded":"2024-04-25T12:22:04.886225+0000","last_fullsized":"2024-04-25T12:22:04.886225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:24.441417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.898100+0000","last_change":"2024-04-25T12:21:24.111956+0000","last_active":"2024-04-25T12:22:04.898100+0000","last_peered":"2024-04-25T12:22:04.898100+0000","last_clean":"2024-04-25T12:22:04.898100+0000","last_became_active":"2024-04-25T12:21:24.111154+0000","last_became_peered":"2024-04-25T12:21:24.111154+0000","last_unstale":"2024-04-25T12:22:04.898100+0000","last_undegraded":"2024-04-25T12:22:04.898100+0000","last_fullsized":"2024-04-25T12:22:04.898100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:39:56.070884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.922005+0000","last_change":"2024-04-25T12:21:24.134511+0000","last_active":"2024-04-25T12:22:04.922005+0000","last_peered":"2024-04-25T12:22:04.922005+0000","last_clean":"2024-04-25T12:22:04.922005+0000","last_became_active":"2024-04-25T12:21:24.133839+0000","last_became_peered":"2024-04-25T12:21:24.133839+0000","last_unstale":"2024-04-25T12:22:04.922005+0000","last_undegraded":"2024-04-25T12:22:04.922005+0000","last_fullsized":"2024-04-25T12:22:04.922005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:43.263673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.921347+0000","last_change":"2024-04-25T12:21:24.147519+0000","last_active":"2024-04-25T12:22:04.921347+0000","last_peered":"2024-04-25T12:22:04.921347+0000","last_clean":"2024-04-25T12:22:04.921347+0000","last_became_active":"2024-04-25T12:21:24.146805+0000","last_became_peered":"2024-04-25T12:21:24.146805+0000","last_unstale":"2024-04-25T12:22:04.921347+0000","last_undegraded":"2024-04-25T12:22:04.921347+0000","last_fullsized":"2024-04-25T12:22:04.921347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:23.200746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":12592,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":25184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":194,"ondisk_log_size":194,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":909312,"data_stored":707411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":120157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":327680,"data_stored":118875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":116273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":120191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":116405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":115893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":901120,"data_stored":705603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":5796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T12:22:36.475 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T12:22:36.476 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T12:22:36.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.633+0000 7fe0cd641640 1 Processor -- start 2024-04-25T12:22:36.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.633+0000 7fe0cd641640 1 -- start start 2024-04-25T12:22:36.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.633+0000 7fe0cd641640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe0c814fbc0 0x7fe0c806f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:36.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.633+0000 7fe0cd641640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe0c814ffa0 0x7fe0c80c8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:36.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.633+0000 7fe0cd641640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe0c8074100 0x7fe0c80c8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:36.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.633+0000 7fe0cd641640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7fe0c80c5d70 con 0x7fe0c814fbc0 2024-04-25T12:22:36.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.633+0000 7fe0cd641640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fe0c80c6050 con 0x7fe0c814ffa0 2024-04-25T12:22:36.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.633+0000 7fe0cd641640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fe0c80c6330 con 0x7fe0c8074100 2024-04-25T12:22:36.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.633+0000 7fe0c6ffd640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe0c814fbc0 0x7fe0c806f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:36.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.633+0000 7fe0c6ffd640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe0c814fbc0 0x7fe0c806f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37526/0 (socket says 172.21.15.86:37526) 2024-04-25T12:22:36.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.633+0000 7fe0c6ffd640 1 -- 172.21.15.86:0/1331833853 learned_addr learned my addr 172.21.15.86:0/1331833853 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:36.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.633+0000 7fe0c77fe640 1 --2- 172.21.15.86:0/1331833853 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe0c8074100 0x7fe0c80c8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:36.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.633+0000 7fe0c6ffd640 1 -- 172.21.15.86:0/1331833853 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe0c8074100 msgr2=0x7fe0c80c8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:36.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.633+0000 7fe0c6ffd640 1 --2- 172.21.15.86:0/1331833853 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe0c8074100 0x7fe0c80c8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:36.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.633+0000 7fe0c6ffd640 1 -- 172.21.15.86:0/1331833853 >> v2:172.21.15.134:3300/0 conn(0x7fe0c814ffa0 msgr2=0x7fe0c80c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:36.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.633+0000 7fe0c6ffd640 1 --2- 172.21.15.86:0/1331833853 >> v2:172.21.15.134:3300/0 conn(0x7fe0c814ffa0 0x7fe0c80c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:36.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.633+0000 7fe0c6ffd640 1 -- 172.21.15.86:0/1331833853 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0c80c6610 con 0x7fe0c814fbc0 2024-04-25T12:22:36.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.633+0000 7fe0c77fe640 1 --2- 172.21.15.86:0/1331833853 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe0c8074100 0x7fe0c80c8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:22:36.640 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.637+0000 7fe0c6ffd640 1 --2- 172.21.15.86:0/1331833853 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0c814fbc0 0x7fe0c806f700 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe0c80691a0 tx=0x7fe0bc01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7abb8cc4f3414615 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:36.640 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.637+0000 7fe0c5ffb640 1 -- 172.21.15.86:0/1331833853 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc0a5890 con 0x7fe0c814fbc0 2024-04-25T12:22:36.640 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.637+0000 7fe0c5ffb640 1 -- 172.21.15.86:0/1331833853 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0bc0a5a30 con 0x7fe0c814fbc0 2024-04-25T12:22:36.640 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.637+0000 7fe0c5ffb640 1 -- 172.21.15.86:0/1331833853 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc0a5e00 con 0x7fe0c814fbc0 2024-04-25T12:22:36.640 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.637+0000 7fe0cd641640 1 -- 172.21.15.86:0/1331833853 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0c814fbc0 msgr2=0x7fe0c806f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:36.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.637+0000 7fe0cd641640 1 --2- 172.21.15.86:0/1331833853 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0c814fbc0 0x7fe0c806f700 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe0c80691a0 tx=0x7fe0bc01c9f0 comp rx=0 tx=0).stop 2024-04-25T12:22:36.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.637+0000 7fe0cd641640 1 -- 172.21.15.86:0/1331833853 shutdown_connections 2024-04-25T12:22:36.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.637+0000 7fe0cd641640 1 --2- 172.21.15.86:0/1331833853 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe0c8074100 0x7fe0c80c8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:36.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.637+0000 7fe0cd641640 1 --2- 172.21.15.86:0/1331833853 >> v2:172.21.15.134:3300/0 conn(0x7fe0c814ffa0 0x7fe0c80c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:36.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.637+0000 7fe0cd641640 1 --2- 172.21.15.86:0/1331833853 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0c814fbc0 0x7fe0c806f700 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:36.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.637+0000 7fe0cd641640 1 -- 172.21.15.86:0/1331833853 >> 172.21.15.86:0/1331833853 conn(0x7fe0c806b9d0 msgr2=0x7fe0c806bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:36.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.637+0000 7fe0cd641640 1 -- 172.21.15.86:0/1331833853 shutdown_connections 2024-04-25T12:22:36.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.637+0000 7fe0cd641640 1 -- 172.21.15.86:0/1331833853 wait complete. 2024-04-25T12:22:36.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.637+0000 7fe0cd641640 1 Processor -- start 2024-04-25T12:22:36.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.637+0000 7fe0cd641640 1 -- start start 2024-04-25T12:22:36.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.637+0000 7fe0cd641640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0c8074100 0x7fe0c80cbec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:36.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.637+0000 7fe0cd641640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe0c814fbc0 0x7fe0c813f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:36.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.637+0000 7fe0cd641640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0c814ffa0 0x7fe0c806e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:36.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.637+0000 7fe0cd641640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c81592e0 con 0x7fe0c8074100 2024-04-25T12:22:36.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.637+0000 7fe0cd641640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c8159160 con 0x7fe0c814ffa0 2024-04-25T12:22:36.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.637+0000 7fe0cd641640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fe0c8159460 con 0x7fe0c814fbc0 2024-04-25T12:22:36.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.637+0000 7fe0c6ffd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0c8074100 0x7fe0c80cbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:36.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.637+0000 7fe0c6ffd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0c8074100 0x7fe0c80cbec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37534/0 (socket says 172.21.15.86:37534) 2024-04-25T12:22:36.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.637+0000 7fe0c6ffd640 1 -- 172.21.15.86:0/2635268910 learned_addr learned my addr 172.21.15.86:0/2635268910 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:36.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.637+0000 7fe0c77fe640 1 --2- 172.21.15.86:0/2635268910 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0c814ffa0 0x7fe0c806e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:36.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.637+0000 7fe0c6ffd640 1 -- 172.21.15.86:0/2635268910 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe0c814fbc0 msgr2=0x7fe0c813f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:36.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.637+0000 7fe0c67fc640 1 --2- 172.21.15.86:0/2635268910 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe0c814fbc0 0x7fe0c813f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:36.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.637+0000 7fe0c6ffd640 1 --2- 172.21.15.86:0/2635268910 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe0c814fbc0 0x7fe0c813f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:36.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.637+0000 7fe0c6ffd640 1 -- 172.21.15.86:0/2635268910 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0c814ffa0 msgr2=0x7fe0c806e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:36.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.637+0000 7fe0c6ffd640 1 --2- 172.21.15.86:0/2635268910 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0c814ffa0 0x7fe0c806e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:36.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.637+0000 7fe0c6ffd640 1 -- 172.21.15.86:0/2635268910 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0c815c6f0 con 0x7fe0c8074100 2024-04-25T12:22:36.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.637+0000 7fe0c77fe640 1 --2- 172.21.15.86:0/2635268910 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0c814ffa0 0x7fe0c806e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:22:36.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.637+0000 7fe0c6ffd640 1 --2- 172.21.15.86:0/2635268910 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0c8074100 0x7fe0c80cbec0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc0af040 tx=0x7fe0bc019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:36.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.637+0000 7fe0af7fe640 1 -- 172.21.15.86:0/2635268910 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc0b8880 con 0x7fe0c8074100 2024-04-25T12:22:36.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.637+0000 7fe0af7fe640 1 -- 172.21.15.86:0/2635268910 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0bc0be070 con 0x7fe0c8074100 2024-04-25T12:22:36.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.637+0000 7fe0cd641640 1 -- 172.21.15.86:0/2635268910 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0c815c9d0 con 0x7fe0c8074100 2024-04-25T12:22:36.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.637+0000 7fe0af7fe640 1 -- 172.21.15.86:0/2635268910 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc0b8c60 con 0x7fe0c8074100 2024-04-25T12:22:36.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.637+0000 7fe0cd641640 1 -- 172.21.15.86:0/2635268910 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0c815a0b0 con 0x7fe0c8074100 2024-04-25T12:22:36.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.641+0000 7fe0cd641640 1 -- 172.21.15.86:0/2635268910 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0c8075df0 con 0x7fe0c8074100 2024-04-25T12:22:36.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.641+0000 7fe0af7fe640 1 -- 172.21.15.86:0/2635268910 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe0bc0c3460 con 0x7fe0c8074100 2024-04-25T12:22:36.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.641+0000 7fe0af7fe640 1 --2- 172.21.15.86:0/2635268910 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fe0b4068380 0x7fe0b406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:36.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.641+0000 7fe0af7fe640 1 -- 172.21.15.86:0/2635268910 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fe0bc122a40 con 0x7fe0c8074100 2024-04-25T12:22:36.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.641+0000 7fe0c67fc640 1 --2- 172.21.15.86:0/2635268910 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fe0b4068380 0x7fe0b406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:36.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.641+0000 7fe0c67fc640 1 --2- 172.21.15.86:0/2635268910 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fe0b4068380 0x7fe0b406a840 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe0c8073e90 tx=0x7fe0b8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:36.648 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.645+0000 7fe0af7fe640 1 -- 172.21.15.86:0/2635268910 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe0bc0165e0 con 0x7fe0c8074100 2024-04-25T12:22:36.809 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.805+0000 7fe0cd641640 1 -- 172.21.15.86:0/2635268910 --> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe0c814dc40 con 0x7fe0b4068380 2024-04-25T12:22:36.818 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.813+0000 7fe0af7fe640 1 -- 172.21.15.86:0/2635268910 <== mgr.4107 v2:172.21.15.86:6832/3708662606 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332691 (secure 0 0 0) 0x7fe0c814dc40 con 0x7fe0b4068380 2024-04-25T12:22:36.821 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:22:36.823 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2024-04-25T12:22:36.824 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.817+0000 7fe0cd641640 1 -- 172.21.15.86:0/2635268910 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fe0b4068380 msgr2=0x7fe0b406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:36.824 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.817+0000 7fe0cd641640 1 --2- 172.21.15.86:0/2635268910 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fe0b4068380 0x7fe0b406a840 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe0c8073e90 tx=0x7fe0b8008040 comp rx=0 tx=0).stop 2024-04-25T12:22:36.824 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.817+0000 7fe0cd641640 1 -- 172.21.15.86:0/2635268910 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0c8074100 msgr2=0x7fe0c80cbec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:36.824 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.817+0000 7fe0cd641640 1 --2- 172.21.15.86:0/2635268910 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0c8074100 0x7fe0c80cbec0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc0af040 tx=0x7fe0bc019790 comp rx=0 tx=0).stop 2024-04-25T12:22:36.824 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.817+0000 7fe0cd641640 1 -- 172.21.15.86:0/2635268910 shutdown_connections 2024-04-25T12:22:36.824 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.817+0000 7fe0cd641640 1 --2- 172.21.15.86:0/2635268910 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0c814ffa0 0x7fe0c806e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:36.825 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.817+0000 7fe0cd641640 1 --2- 172.21.15.86:0/2635268910 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe0c814fbc0 0x7fe0c813f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:36.825 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.817+0000 7fe0cd641640 1 --2- 172.21.15.86:0/2635268910 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fe0b4068380 0x7fe0b406a840 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:36.825 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.817+0000 7fe0cd641640 1 --2- 172.21.15.86:0/2635268910 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0c8074100 0x7fe0c80cbec0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:36.825 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.817+0000 7fe0cd641640 1 -- 172.21.15.86:0/2635268910 >> 172.21.15.86:0/2635268910 conn(0x7fe0c806b9d0 msgr2=0x7fe0c806bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:36.825 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.817+0000 7fe0cd641640 1 -- 172.21.15.86:0/2635268910 shutdown_connections 2024-04-25T12:22:36.825 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.817+0000 7fe0cd641640 1 -- 172.21.15.86:0/2635268910 wait complete. 2024-04-25T12:22:36.839 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2024-04-25T12:22:35.822910+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":602960,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":379,"num_write_kb":2494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":311,"ondisk_log_size":311,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219720,"kb_used_data":3592,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755000,"statfs":{"total":773094113280,"available":772869120000,"internally_reserved":0,"allocated":3678208,"data_stored":2120808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2328,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004752"},"pg_stats":[{"pgid":"2.1f","version":"26'13","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:14.941362+0000","last_change":"2024-04-25T12:21:23.124053+0000","last_active":"2024-04-25T12:22:14.941362+0000","last_peered":"2024-04-25T12:22:14.941362+0000","last_clean":"2024-04-25T12:22:14.941362+0000","last_became_active":"2024-04-25T12:21:23.123863+0000","last_became_peered":"2024-04-25T12:21:23.123863+0000","last_unstale":"2024-04-25T12:22:14.941362+0000","last_undegraded":"2024-04-25T12:22:14.941362+0000","last_fullsized":"2024-04-25T12:22:14.941362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:52:10.500619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.889057+0000","last_change":"2024-04-25T12:21:24.141874+0000","last_active":"2024-04-25T12:22:04.889057+0000","last_peered":"2024-04-25T12:22:04.889057+0000","last_clean":"2024-04-25T12:22:04.889057+0000","last_became_active":"2024-04-25T12:21:24.141482+0000","last_became_peered":"2024-04-25T12:21:24.141482+0000","last_unstale":"2024-04-25T12:22:04.889057+0000","last_undegraded":"2024-04-25T12:22:04.889057+0000","last_fullsized":"2024-04-25T12:22:04.889057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:45.364004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.885753+0000","last_change":"2024-04-25T12:21:28.377921+0000","last_active":"2024-04-25T12:22:04.885753+0000","last_peered":"2024-04-25T12:22:04.885753+0000","last_clean":"2024-04-25T12:22:04.885753+0000","last_became_active":"2024-04-25T12:21:28.376966+0000","last_became_peered":"2024-04-25T12:21:28.376966+0000","last_unstale":"2024-04-25T12:22:04.885753+0000","last_undegraded":"2024-04-25T12:22:04.885753+0000","last_fullsized":"2024-04-25T12:22:04.885753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:50:43.460694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.889523+0000","last_change":"2024-04-25T12:21:23.113889+0000","last_active":"2024-04-25T12:22:04.889523+0000","last_peered":"2024-04-25T12:22:04.889523+0000","last_clean":"2024-04-25T12:22:04.889523+0000","last_became_active":"2024-04-25T12:21:23.113605+0000","last_became_peered":"2024-04-25T12:21:23.113605+0000","last_unstale":"2024-04-25T12:22:04.889523+0000","last_undegraded":"2024-04-25T12:22:04.889523+0000","last_fullsized":"2024-04-25T12:22:04.889523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:01.082322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.926635+0000","last_change":"2024-04-25T12:22:04.926635+0000","last_active":"2024-04-25T12:22:04.926635+0000","last_peered":"2024-04-25T12:22:04.926635+0000","last_clean":"2024-04-25T12:22:04.926635+0000","last_became_active":"2024-04-25T12:22:04.925895+0000","last_became_peered":"2024-04-25T12:22:04.925895+0000","last_unstale":"2024-04-25T12:22:04.926635+0000","last_undegraded":"2024-04-25T12:22:04.926635+0000","last_fullsized":"2024-04-25T12:22:04.926635+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:58:49.313708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.886429+0000","last_change":"2024-04-25T12:21:28.205320+0000","last_active":"2024-04-25T12:22:04.886429+0000","last_peered":"2024-04-25T12:22:04.886429+0000","last_clean":"2024-04-25T12:22:04.886429+0000","last_became_active":"2024-04-25T12:21:28.204404+0000","last_became_peered":"2024-04-25T12:21:28.204404+0000","last_unstale":"2024-04-25T12:22:04.886429+0000","last_undegraded":"2024-04-25T12:22:04.886429+0000","last_fullsized":"2024-04-25T12:22:04.886429+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:03:17.730928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'12","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:14.950869+0000","last_change":"2024-04-25T12:21:23.132332+0000","last_active":"2024-04-25T12:22:14.950869+0000","last_peered":"2024-04-25T12:22:14.950869+0000","last_clean":"2024-04-25T12:22:14.950869+0000","last_became_active":"2024-04-25T12:21:23.131566+0000","last_became_peered":"2024-04-25T12:21:23.131566+0000","last_unstale":"2024-04-25T12:22:14.950869+0000","last_undegraded":"2024-04-25T12:22:14.950869+0000","last_fullsized":"2024-04-25T12:22:14.950869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:02.429838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.886464+0000","last_change":"2024-04-25T12:21:24.128824+0000","last_active":"2024-04-25T12:22:04.886464+0000","last_peered":"2024-04-25T12:22:04.886464+0000","last_clean":"2024-04-25T12:22:04.886464+0000","last_became_active":"2024-04-25T12:21:24.128027+0000","last_became_peered":"2024-04-25T12:21:24.128027+0000","last_unstale":"2024-04-25T12:22:04.886464+0000","last_undegraded":"2024-04-25T12:22:04.886464+0000","last_fullsized":"2024-04-25T12:22:04.886464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:57:44.137044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.888676+0000","last_change":"2024-04-25T12:21:28.202389+0000","last_active":"2024-04-25T12:22:04.888676+0000","last_peered":"2024-04-25T12:22:04.888676+0000","last_clean":"2024-04-25T12:22:04.888676+0000","last_became_active":"2024-04-25T12:21:28.201228+0000","last_became_peered":"2024-04-25T12:21:28.201228+0000","last_unstale":"2024-04-25T12:22:04.888676+0000","last_undegraded":"2024-04-25T12:22:04.888676+0000","last_fullsized":"2024-04-25T12:22:04.888676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:45:30.365480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:14.953252+0000","last_change":"2024-04-25T12:21:23.128355+0000","last_active":"2024-04-25T12:22:14.953252+0000","last_peered":"2024-04-25T12:22:14.953252+0000","last_clean":"2024-04-25T12:22:14.953252+0000","last_became_active":"2024-04-25T12:21:23.127717+0000","last_became_peered":"2024-04-25T12:21:23.127717+0000","last_unstale":"2024-04-25T12:22:14.953252+0000","last_undegraded":"2024-04-25T12:22:14.953252+0000","last_fullsized":"2024-04-25T12:22:14.953252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:26.319715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.886973+0000","last_change":"2024-04-25T12:21:24.122098+0000","last_active":"2024-04-25T12:22:04.886973+0000","last_peered":"2024-04-25T12:22:04.886973+0000","last_clean":"2024-04-25T12:22:04.886973+0000","last_became_active":"2024-04-25T12:21:24.121392+0000","last_became_peered":"2024-04-25T12:21:24.121392+0000","last_unstale":"2024-04-25T12:22:04.886973+0000","last_undegraded":"2024-04-25T12:22:04.886973+0000","last_fullsized":"2024-04-25T12:22:04.886973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:11:35.116222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.887755+0000","last_change":"2024-04-25T12:21:28.189048+0000","last_active":"2024-04-25T12:22:04.887755+0000","last_peered":"2024-04-25T12:22:04.887755+0000","last_clean":"2024-04-25T12:22:04.887755+0000","last_became_active":"2024-04-25T12:21:28.187340+0000","last_became_peered":"2024-04-25T12:21:28.187340+0000","last_unstale":"2024-04-25T12:22:04.887755+0000","last_undegraded":"2024-04-25T12:22:04.887755+0000","last_fullsized":"2024-04-25T12:22:04.887755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:47:13.797595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.893836+0000","last_change":"2024-04-25T12:21:24.126211+0000","last_active":"2024-04-25T12:22:04.893836+0000","last_peered":"2024-04-25T12:22:04.893836+0000","last_clean":"2024-04-25T12:22:04.893836+0000","last_became_active":"2024-04-25T12:21:24.123695+0000","last_became_peered":"2024-04-25T12:21:24.123695+0000","last_unstale":"2024-04-25T12:22:04.893836+0000","last_undegraded":"2024-04-25T12:22:04.893836+0000","last_fullsized":"2024-04-25T12:22:04.893836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:09:04.327157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"24'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.921191+0000","last_change":"2024-04-25T12:21:23.139676+0000","last_active":"2024-04-25T12:22:04.921191+0000","last_peered":"2024-04-25T12:22:04.921191+0000","last_clean":"2024-04-25T12:22:04.921191+0000","last_became_active":"2024-04-25T12:21:23.139025+0000","last_became_peered":"2024-04-25T12:21:23.139025+0000","last_unstale":"2024-04-25T12:22:04.921191+0000","last_undegraded":"2024-04-25T12:22:04.921191+0000","last_fullsized":"2024-04-25T12:22:04.921191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:43:51.445149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.889613+0000","last_change":"2024-04-25T12:21:28.188852+0000","last_active":"2024-04-25T12:22:04.889613+0000","last_peered":"2024-04-25T12:22:04.889613+0000","last_clean":"2024-04-25T12:22:04.889613+0000","last_became_active":"2024-04-25T12:21:28.187619+0000","last_became_peered":"2024-04-25T12:21:28.187619+0000","last_unstale":"2024-04-25T12:22:04.889613+0000","last_undegraded":"2024-04-25T12:22:04.889613+0000","last_fullsized":"2024-04-25T12:22:04.889613+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:12:14.726245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.888266+0000","last_change":"2024-04-25T12:21:24.136925+0000","last_active":"2024-04-25T12:22:04.888266+0000","last_peered":"2024-04-25T12:22:04.888266+0000","last_clean":"2024-04-25T12:22:04.888266+0000","last_became_active":"2024-04-25T12:21:24.136535+0000","last_became_peered":"2024-04-25T12:21:24.136535+0000","last_unstale":"2024-04-25T12:22:04.888266+0000","last_undegraded":"2024-04-25T12:22:04.888266+0000","last_fullsized":"2024-04-25T12:22:04.888266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:28:23.965010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:08.913144+0000","last_change":"2024-04-25T12:21:23.105571+0000","last_active":"2024-04-25T12:22:08.913144+0000","last_peered":"2024-04-25T12:22:08.913144+0000","last_clean":"2024-04-25T12:22:08.913144+0000","last_became_active":"2024-04-25T12:21:23.105051+0000","last_became_peered":"2024-04-25T12:21:23.105051+0000","last_unstale":"2024-04-25T12:22:08.913144+0000","last_undegraded":"2024-04-25T12:22:08.913144+0000","last_fullsized":"2024-04-25T12:22:08.913144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:52:40.783100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.888765+0000","last_change":"2024-04-25T12:21:28.202632+0000","last_active":"2024-04-25T12:22:04.888765+0000","last_peered":"2024-04-25T12:22:04.888765+0000","last_clean":"2024-04-25T12:22:04.888765+0000","last_became_active":"2024-04-25T12:21:28.201389+0000","last_became_peered":"2024-04-25T12:21:28.201389+0000","last_unstale":"2024-04-25T12:22:04.888765+0000","last_undegraded":"2024-04-25T12:22:04.888765+0000","last_fullsized":"2024-04-25T12:22:04.888765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:48:58.246610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.887395+0000","last_change":"2024-04-25T12:21:24.138749+0000","last_active":"2024-04-25T12:22:04.887395+0000","last_peered":"2024-04-25T12:22:04.887395+0000","last_clean":"2024-04-25T12:22:04.887395+0000","last_became_active":"2024-04-25T12:21:24.138446+0000","last_became_peered":"2024-04-25T12:21:24.138446+0000","last_unstale":"2024-04-25T12:22:04.887395+0000","last_undegraded":"2024-04-25T12:22:04.887395+0000","last_fullsized":"2024-04-25T12:22:04.887395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:22:03.856237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:14.941093+0000","last_change":"2024-04-25T12:21:23.126871+0000","last_active":"2024-04-25T12:22:14.941093+0000","last_peered":"2024-04-25T12:22:14.941093+0000","last_clean":"2024-04-25T12:22:14.941093+0000","last_became_active":"2024-04-25T12:21:23.126521+0000","last_became_peered":"2024-04-25T12:21:23.126521+0000","last_unstale":"2024-04-25T12:22:14.941093+0000","last_undegraded":"2024-04-25T12:22:14.941093+0000","last_fullsized":"2024-04-25T12:22:14.941093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:12:31.353951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.922140+0000","last_change":"2024-04-25T12:21:28.383996+0000","last_active":"2024-04-25T12:22:04.922140+0000","last_peered":"2024-04-25T12:22:04.922140+0000","last_clean":"2024-04-25T12:22:04.922140+0000","last_became_active":"2024-04-25T12:21:28.383568+0000","last_became_peered":"2024-04-25T12:21:28.383568+0000","last_unstale":"2024-04-25T12:22:04.922140+0000","last_undegraded":"2024-04-25T12:22:04.922140+0000","last_fullsized":"2024-04-25T12:22:04.922140+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:19:41.564694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.887535+0000","last_change":"2024-04-25T12:21:24.125112+0000","last_active":"2024-04-25T12:22:04.887535+0000","last_peered":"2024-04-25T12:22:04.887535+0000","last_clean":"2024-04-25T12:22:04.887535+0000","last_became_active":"2024-04-25T12:21:24.121963+0000","last_became_peered":"2024-04-25T12:21:24.121963+0000","last_unstale":"2024-04-25T12:22:04.887535+0000","last_undegraded":"2024-04-25T12:22:04.887535+0000","last_fullsized":"2024-04-25T12:22:04.887535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:33:14.123119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"24'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.919771+0000","last_change":"2024-04-25T12:21:23.117114+0000","last_active":"2024-04-25T12:22:04.919771+0000","last_peered":"2024-04-25T12:22:04.919771+0000","last_clean":"2024-04-25T12:22:04.919771+0000","last_became_active":"2024-04-25T12:21:23.115571+0000","last_became_peered":"2024-04-25T12:21:23.115571+0000","last_unstale":"2024-04-25T12:22:04.919771+0000","last_undegraded":"2024-04-25T12:22:04.919771+0000","last_fullsized":"2024-04-25T12:22:04.919771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:47.838299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.888900+0000","last_change":"2024-04-25T12:21:28.202374+0000","last_active":"2024-04-25T12:22:04.888900+0000","last_peered":"2024-04-25T12:22:04.888900+0000","last_clean":"2024-04-25T12:22:04.888900+0000","last_became_active":"2024-04-25T12:21:28.201297+0000","last_became_peered":"2024-04-25T12:21:28.201297+0000","last_unstale":"2024-04-25T12:22:04.888900+0000","last_undegraded":"2024-04-25T12:22:04.888900+0000","last_fullsized":"2024-04-25T12:22:04.888900+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:13.461169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.899183+0000","last_change":"2024-04-25T12:21:24.133827+0000","last_active":"2024-04-25T12:22:04.899183+0000","last_peered":"2024-04-25T12:22:04.899183+0000","last_clean":"2024-04-25T12:22:04.899183+0000","last_became_active":"2024-04-25T12:21:24.132703+0000","last_became_peered":"2024-04-25T12:21:24.132703+0000","last_unstale":"2024-04-25T12:22:04.899183+0000","last_undegraded":"2024-04-25T12:22:04.899183+0000","last_fullsized":"2024-04-25T12:22:04.899183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:06:22.849827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:14.949919+0000","last_change":"2024-04-25T12:21:23.132331+0000","last_active":"2024-04-25T12:22:14.949919+0000","last_peered":"2024-04-25T12:22:14.949919+0000","last_clean":"2024-04-25T12:22:14.949919+0000","last_became_active":"2024-04-25T12:21:23.131628+0000","last_became_peered":"2024-04-25T12:21:23.131628+0000","last_unstale":"2024-04-25T12:22:14.949919+0000","last_undegraded":"2024-04-25T12:22:14.949919+0000","last_fullsized":"2024-04-25T12:22:14.949919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:19:13.372172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.887229+0000","last_change":"2024-04-25T12:21:28.377407+0000","last_active":"2024-04-25T12:22:04.887229+0000","last_peered":"2024-04-25T12:22:04.887229+0000","last_clean":"2024-04-25T12:22:04.887229+0000","last_became_active":"2024-04-25T12:21:28.376224+0000","last_became_peered":"2024-04-25T12:21:28.376224+0000","last_unstale":"2024-04-25T12:22:04.887229+0000","last_undegraded":"2024-04-25T12:22:04.887229+0000","last_fullsized":"2024-04-25T12:22:04.887229+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:13:02.955979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.888952+0000","last_change":"2024-04-25T12:21:24.145468+0000","last_active":"2024-04-25T12:22:04.888952+0000","last_peered":"2024-04-25T12:22:04.888952+0000","last_clean":"2024-04-25T12:22:04.888952+0000","last_became_active":"2024-04-25T12:21:24.145132+0000","last_became_peered":"2024-04-25T12:21:24.145132+0000","last_unstale":"2024-04-25T12:22:04.888952+0000","last_undegraded":"2024-04-25T12:22:04.888952+0000","last_fullsized":"2024-04-25T12:22:04.888952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:46:44.281270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:08.911698+0000","last_change":"2024-04-25T12:21:23.131029+0000","last_active":"2024-04-25T12:22:08.911698+0000","last_peered":"2024-04-25T12:22:08.911698+0000","last_clean":"2024-04-25T12:22:08.911698+0000","last_became_active":"2024-04-25T12:21:23.130612+0000","last_became_peered":"2024-04-25T12:21:23.130612+0000","last_unstale":"2024-04-25T12:22:08.911698+0000","last_undegraded":"2024-04-25T12:22:08.911698+0000","last_fullsized":"2024-04-25T12:22:08.911698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:02.146986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.885579+0000","last_change":"2024-04-25T12:21:28.375231+0000","last_active":"2024-04-25T12:22:04.885579+0000","last_peered":"2024-04-25T12:22:04.885579+0000","last_clean":"2024-04-25T12:22:04.885579+0000","last_became_active":"2024-04-25T12:21:28.374813+0000","last_became_peered":"2024-04-25T12:21:28.374813+0000","last_unstale":"2024-04-25T12:22:04.885579+0000","last_undegraded":"2024-04-25T12:22:04.885579+0000","last_fullsized":"2024-04-25T12:22:04.885579+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:16.393582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.922376+0000","last_change":"2024-04-25T12:21:24.112280+0000","last_active":"2024-04-25T12:22:04.922376+0000","last_peered":"2024-04-25T12:22:04.922376+0000","last_clean":"2024-04-25T12:22:04.922376+0000","last_became_active":"2024-04-25T12:21:24.111430+0000","last_became_peered":"2024-04-25T12:21:24.111430+0000","last_unstale":"2024-04-25T12:22:04.922376+0000","last_undegraded":"2024-04-25T12:22:04.922376+0000","last_fullsized":"2024-04-25T12:22:04.922376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:58.325720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:08.912181+0000","last_change":"2024-04-25T12:21:23.124271+0000","last_active":"2024-04-25T12:22:08.912181+0000","last_peered":"2024-04-25T12:22:08.912181+0000","last_clean":"2024-04-25T12:22:08.912181+0000","last_became_active":"2024-04-25T12:21:23.123492+0000","last_became_peered":"2024-04-25T12:21:23.123492+0000","last_unstale":"2024-04-25T12:22:08.912181+0000","last_undegraded":"2024-04-25T12:22:08.912181+0000","last_fullsized":"2024-04-25T12:22:08.912181+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:31:09.080478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.896489+0000","last_change":"2024-04-25T12:21:28.375801+0000","last_active":"2024-04-25T12:22:04.896489+0000","last_peered":"2024-04-25T12:22:04.896489+0000","last_clean":"2024-04-25T12:22:04.896489+0000","last_became_active":"2024-04-25T12:21:28.375119+0000","last_became_peered":"2024-04-25T12:21:28.375119+0000","last_unstale":"2024-04-25T12:22:04.896489+0000","last_undegraded":"2024-04-25T12:22:04.896489+0000","last_fullsized":"2024-04-25T12:22:04.896489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:00:29.908954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.886990+0000","last_change":"2024-04-25T12:21:24.131673+0000","last_active":"2024-04-25T12:22:04.886990+0000","last_peered":"2024-04-25T12:22:04.886990+0000","last_clean":"2024-04-25T12:22:04.886990+0000","last_became_active":"2024-04-25T12:21:24.130866+0000","last_became_peered":"2024-04-25T12:21:24.130866+0000","last_unstale":"2024-04-25T12:22:04.886990+0000","last_undegraded":"2024-04-25T12:22:04.886990+0000","last_fullsized":"2024-04-25T12:22:04.886990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:09:04.327157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"26'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.922773+0000","last_change":"2024-04-25T12:21:23.106785+0000","last_active":"2024-04-25T12:22:04.922773+0000","last_peered":"2024-04-25T12:22:04.922773+0000","last_clean":"2024-04-25T12:22:04.922773+0000","last_became_active":"2024-04-25T12:21:23.105809+0000","last_became_peered":"2024-04-25T12:21:23.105809+0000","last_unstale":"2024-04-25T12:22:04.922773+0000","last_undegraded":"2024-04-25T12:22:04.922773+0000","last_fullsized":"2024-04-25T12:22:04.922773+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:17.185116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.920337+0000","last_change":"2024-04-25T12:21:28.193242+0000","last_active":"2024-04-25T12:22:04.920337+0000","last_peered":"2024-04-25T12:22:04.920337+0000","last_clean":"2024-04-25T12:22:04.920337+0000","last_became_active":"2024-04-25T12:21:28.192835+0000","last_became_peered":"2024-04-25T12:21:28.192835+0000","last_unstale":"2024-04-25T12:22:04.920337+0000","last_undegraded":"2024-04-25T12:22:04.920337+0000","last_fullsized":"2024-04-25T12:22:04.920337+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:42:52.476024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.889648+0000","last_change":"2024-04-25T12:21:24.128902+0000","last_active":"2024-04-25T12:22:04.889648+0000","last_peered":"2024-04-25T12:22:04.889648+0000","last_clean":"2024-04-25T12:22:04.889648+0000","last_became_active":"2024-04-25T12:21:24.124563+0000","last_became_peered":"2024-04-25T12:21:24.124563+0000","last_unstale":"2024-04-25T12:22:04.889648+0000","last_undegraded":"2024-04-25T12:22:04.889648+0000","last_fullsized":"2024-04-25T12:22:04.889648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:16.937980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:14.953290+0000","last_change":"2024-04-25T12:21:23.114222+0000","last_active":"2024-04-25T12:22:14.953290+0000","last_peered":"2024-04-25T12:22:14.953290+0000","last_clean":"2024-04-25T12:22:14.953290+0000","last_became_active":"2024-04-25T12:21:23.113504+0000","last_became_peered":"2024-04-25T12:21:23.113504+0000","last_unstale":"2024-04-25T12:22:14.953290+0000","last_undegraded":"2024-04-25T12:22:14.953290+0000","last_fullsized":"2024-04-25T12:22:14.953290+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:37:42.382391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.922111+0000","last_change":"2024-04-25T12:21:28.200532+0000","last_active":"2024-04-25T12:22:04.922111+0000","last_peered":"2024-04-25T12:22:04.922111+0000","last_clean":"2024-04-25T12:22:04.922111+0000","last_became_active":"2024-04-25T12:21:28.200082+0000","last_became_peered":"2024-04-25T12:21:28.200082+0000","last_unstale":"2024-04-25T12:22:04.922111+0000","last_undegraded":"2024-04-25T12:22:04.922111+0000","last_fullsized":"2024-04-25T12:22:04.922111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:24.889665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.920686+0000","last_change":"2024-04-25T12:21:24.112524+0000","last_active":"2024-04-25T12:22:04.920686+0000","last_peered":"2024-04-25T12:22:04.920686+0000","last_clean":"2024-04-25T12:22:04.920686+0000","last_became_active":"2024-04-25T12:21:24.111503+0000","last_became_peered":"2024-04-25T12:21:24.111503+0000","last_unstale":"2024-04-25T12:22:04.920686+0000","last_undegraded":"2024-04-25T12:22:04.920686+0000","last_fullsized":"2024-04-25T12:22:04.920686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:03:35.982959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:14.944694+0000","last_change":"2024-04-25T12:21:23.108434+0000","last_active":"2024-04-25T12:22:14.944694+0000","last_peered":"2024-04-25T12:22:14.944694+0000","last_clean":"2024-04-25T12:22:14.944694+0000","last_became_active":"2024-04-25T12:21:23.108051+0000","last_became_peered":"2024-04-25T12:21:23.108051+0000","last_unstale":"2024-04-25T12:22:14.944694+0000","last_undegraded":"2024-04-25T12:22:14.944694+0000","last_fullsized":"2024-04-25T12:22:14.944694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:49.222950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.922506+0000","last_change":"2024-04-25T12:21:28.189825+0000","last_active":"2024-04-25T12:22:04.922506+0000","last_peered":"2024-04-25T12:22:04.922506+0000","last_clean":"2024-04-25T12:22:04.922506+0000","last_became_active":"2024-04-25T12:21:28.189247+0000","last_became_peered":"2024-04-25T12:21:28.189247+0000","last_unstale":"2024-04-25T12:22:04.922506+0000","last_undegraded":"2024-04-25T12:22:04.922506+0000","last_fullsized":"2024-04-25T12:22:04.922506+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:54:02.752212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.894738+0000","last_change":"2024-04-25T12:21:24.105746+0000","last_active":"2024-04-25T12:22:04.894738+0000","last_peered":"2024-04-25T12:22:04.894738+0000","last_clean":"2024-04-25T12:22:04.894738+0000","last_became_active":"2024-04-25T12:21:24.104947+0000","last_became_peered":"2024-04-25T12:21:24.104947+0000","last_unstale":"2024-04-25T12:22:04.894738+0000","last_undegraded":"2024-04-25T12:22:04.894738+0000","last_fullsized":"2024-04-25T12:22:04.894738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:46:14.853789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.919808+0000","last_change":"2024-04-25T12:21:23.114591+0000","last_active":"2024-04-25T12:22:04.919808+0000","last_peered":"2024-04-25T12:22:04.919808+0000","last_clean":"2024-04-25T12:22:04.919808+0000","last_became_active":"2024-04-25T12:21:23.113829+0000","last_became_peered":"2024-04-25T12:21:23.113829+0000","last_unstale":"2024-04-25T12:22:04.919808+0000","last_undegraded":"2024-04-25T12:22:04.919808+0000","last_fullsized":"2024-04-25T12:22:04.919808+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:51:38.471436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.898786+0000","last_change":"2024-04-25T12:21:28.378024+0000","last_active":"2024-04-25T12:22:04.898786+0000","last_peered":"2024-04-25T12:22:04.898786+0000","last_clean":"2024-04-25T12:22:04.898786+0000","last_became_active":"2024-04-25T12:21:28.377639+0000","last_became_peered":"2024-04-25T12:21:28.377639+0000","last_unstale":"2024-04-25T12:22:04.898786+0000","last_undegraded":"2024-04-25T12:22:04.898786+0000","last_fullsized":"2024-04-25T12:22:04.898786+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:18:40.723659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.886368+0000","last_change":"2024-04-25T12:21:24.120719+0000","last_active":"2024-04-25T12:22:04.886368+0000","last_peered":"2024-04-25T12:22:04.886368+0000","last_clean":"2024-04-25T12:22:04.886368+0000","last_became_active":"2024-04-25T12:21:24.119870+0000","last_became_peered":"2024-04-25T12:21:24.119870+0000","last_unstale":"2024-04-25T12:22:04.886368+0000","last_undegraded":"2024-04-25T12:22:04.886368+0000","last_fullsized":"2024-04-25T12:22:04.886368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:53:15.175473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:08.909810+0000","last_change":"2024-04-25T12:21:23.103524+0000","last_active":"2024-04-25T12:22:08.909810+0000","last_peered":"2024-04-25T12:22:08.909810+0000","last_clean":"2024-04-25T12:22:08.909810+0000","last_became_active":"2024-04-25T12:21:23.102790+0000","last_became_peered":"2024-04-25T12:21:23.102790+0000","last_unstale":"2024-04-25T12:22:08.909810+0000","last_undegraded":"2024-04-25T12:22:08.909810+0000","last_fullsized":"2024-04-25T12:22:08.909810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:15:54.796303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":182,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.919869+0000","last_change":"2024-04-25T12:21:13.081186+0000","last_active":"2024-04-25T12:22:04.919869+0000","last_peered":"2024-04-25T12:22:04.919869+0000","last_clean":"2024-04-25T12:22:04.919869+0000","last_became_active":"2024-04-25T12:21:13.076753+0000","last_became_peered":"2024-04-25T12:21:13.076753+0000","last_unstale":"2024-04-25T12:22:04.919869+0000","last_undegraded":"2024-04-25T12:22:04.919869+0000","last_fullsized":"2024-04-25T12:22:04.919869+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:12.013694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:12.013694+0000","last_clean_scrub_stamp":"2024-04-25T12:21:12.013694+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:18:03.288120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.894131+0000","last_change":"2024-04-25T12:21:28.379372+0000","last_active":"2024-04-25T12:22:04.894131+0000","last_peered":"2024-04-25T12:22:04.894131+0000","last_clean":"2024-04-25T12:22:04.894131+0000","last_became_active":"2024-04-25T12:21:28.378522+0000","last_became_peered":"2024-04-25T12:21:28.378522+0000","last_unstale":"2024-04-25T12:22:04.894131+0000","last_undegraded":"2024-04-25T12:22:04.894131+0000","last_fullsized":"2024-04-25T12:22:04.894131+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:54:35.288829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.921450+0000","last_change":"2024-04-25T12:21:24.144632+0000","last_active":"2024-04-25T12:22:04.921450+0000","last_peered":"2024-04-25T12:22:04.921450+0000","last_clean":"2024-04-25T12:22:04.921450+0000","last_became_active":"2024-04-25T12:21:24.142085+0000","last_became_peered":"2024-04-25T12:21:24.142085+0000","last_unstale":"2024-04-25T12:22:04.921450+0000","last_undegraded":"2024-04-25T12:22:04.921450+0000","last_fullsized":"2024-04-25T12:22:04.921450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:16:55.634329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:23.478572+0000","last_change":"2024-04-25T12:21:23.126527+0000","last_active":"2024-04-25T12:22:23.478572+0000","last_peered":"2024-04-25T12:22:23.478572+0000","last_clean":"2024-04-25T12:22:23.478572+0000","last_became_active":"2024-04-25T12:21:23.126103+0000","last_became_peered":"2024-04-25T12:21:23.126103+0000","last_unstale":"2024-04-25T12:22:23.478572+0000","last_undegraded":"2024-04-25T12:22:23.478572+0000","last_fullsized":"2024-04-25T12:22:23.478572+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:16:36.502824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.891785+0000","last_change":"2024-04-25T12:21:28.379480+0000","last_active":"2024-04-25T12:22:04.891785+0000","last_peered":"2024-04-25T12:22:04.891785+0000","last_clean":"2024-04-25T12:22:04.891785+0000","last_became_active":"2024-04-25T12:21:28.378559+0000","last_became_peered":"2024-04-25T12:21:28.378559+0000","last_unstale":"2024-04-25T12:22:04.891785+0000","last_undegraded":"2024-04-25T12:22:04.891785+0000","last_fullsized":"2024-04-25T12:22:04.891785+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:40.975592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.886708+0000","last_change":"2024-04-25T12:21:24.129518+0000","last_active":"2024-04-25T12:22:04.886708+0000","last_peered":"2024-04-25T12:22:04.886708+0000","last_clean":"2024-04-25T12:22:04.886708+0000","last_became_active":"2024-04-25T12:21:24.126968+0000","last_became_peered":"2024-04-25T12:21:24.126968+0000","last_unstale":"2024-04-25T12:22:04.886708+0000","last_undegraded":"2024-04-25T12:22:04.886708+0000","last_fullsized":"2024-04-25T12:22:04.886708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:49.243645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:08.913274+0000","last_change":"2024-04-25T12:21:23.116529+0000","last_active":"2024-04-25T12:22:08.913274+0000","last_peered":"2024-04-25T12:22:08.913274+0000","last_clean":"2024-04-25T12:22:08.913274+0000","last_became_active":"2024-04-25T12:21:23.116148+0000","last_became_peered":"2024-04-25T12:21:23.116148+0000","last_unstale":"2024-04-25T12:22:08.913274+0000","last_undegraded":"2024-04-25T12:22:08.913274+0000","last_fullsized":"2024-04-25T12:22:08.913274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:01:45.567238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.897064+0000","last_change":"2024-04-25T12:21:28.194823+0000","last_active":"2024-04-25T12:22:04.897064+0000","last_peered":"2024-04-25T12:22:04.897064+0000","last_clean":"2024-04-25T12:22:04.897064+0000","last_became_active":"2024-04-25T12:21:28.194191+0000","last_became_peered":"2024-04-25T12:21:28.194191+0000","last_unstale":"2024-04-25T12:22:04.897064+0000","last_undegraded":"2024-04-25T12:22:04.897064+0000","last_fullsized":"2024-04-25T12:22:04.897064+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:50:30.454926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.921672+0000","last_change":"2024-04-25T12:21:24.146733+0000","last_active":"2024-04-25T12:22:04.921672+0000","last_peered":"2024-04-25T12:22:04.921672+0000","last_clean":"2024-04-25T12:22:04.921672+0000","last_became_active":"2024-04-25T12:21:24.145807+0000","last_became_peered":"2024-04-25T12:21:24.145807+0000","last_unstale":"2024-04-25T12:22:04.921672+0000","last_undegraded":"2024-04-25T12:22:04.921672+0000","last_fullsized":"2024-04-25T12:22:04.921672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:07:35.092827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:14.944106+0000","last_change":"2024-04-25T12:21:23.103393+0000","last_active":"2024-04-25T12:22:14.944106+0000","last_peered":"2024-04-25T12:22:14.944106+0000","last_clean":"2024-04-25T12:22:14.944106+0000","last_became_active":"2024-04-25T12:21:23.102997+0000","last_became_peered":"2024-04-25T12:21:23.102997+0000","last_unstale":"2024-04-25T12:22:14.944106+0000","last_undegraded":"2024-04-25T12:22:14.944106+0000","last_fullsized":"2024-04-25T12:22:14.944106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:40:23.054158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.885200+0000","last_change":"2024-04-25T12:21:28.384645+0000","last_active":"2024-04-25T12:22:04.885200+0000","last_peered":"2024-04-25T12:22:04.885200+0000","last_clean":"2024-04-25T12:22:04.885200+0000","last_became_active":"2024-04-25T12:21:28.382953+0000","last_became_peered":"2024-04-25T12:21:28.382953+0000","last_unstale":"2024-04-25T12:22:04.885200+0000","last_undegraded":"2024-04-25T12:22:04.885200+0000","last_fullsized":"2024-04-25T12:22:04.885200+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:40:56.218533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.920897+0000","last_change":"2024-04-25T12:21:24.146557+0000","last_active":"2024-04-25T12:22:04.920897+0000","last_peered":"2024-04-25T12:22:04.920897+0000","last_clean":"2024-04-25T12:22:04.920897+0000","last_became_active":"2024-04-25T12:21:24.146162+0000","last_became_peered":"2024-04-25T12:21:24.146162+0000","last_unstale":"2024-04-25T12:22:04.920897+0000","last_undegraded":"2024-04-25T12:22:04.920897+0000","last_fullsized":"2024-04-25T12:22:04.920897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:09:00.995503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.889472+0000","last_change":"2024-04-25T12:21:23.135467+0000","last_active":"2024-04-25T12:22:04.889472+0000","last_peered":"2024-04-25T12:22:04.889472+0000","last_clean":"2024-04-25T12:22:04.889472+0000","last_became_active":"2024-04-25T12:21:23.134441+0000","last_became_peered":"2024-04-25T12:21:23.134441+0000","last_unstale":"2024-04-25T12:22:04.889472+0000","last_undegraded":"2024-04-25T12:22:04.889472+0000","last_fullsized":"2024-04-25T12:22:04.889472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:44:33.069221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.886118+0000","last_change":"2024-04-25T12:21:28.202610+0000","last_active":"2024-04-25T12:22:04.886118+0000","last_peered":"2024-04-25T12:22:04.886118+0000","last_clean":"2024-04-25T12:22:04.886118+0000","last_became_active":"2024-04-25T12:21:28.201479+0000","last_became_peered":"2024-04-25T12:21:28.201479+0000","last_unstale":"2024-04-25T12:22:04.886118+0000","last_undegraded":"2024-04-25T12:22:04.886118+0000","last_fullsized":"2024-04-25T12:22:04.886118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:25:15.458202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.920270+0000","last_change":"2024-04-25T12:21:24.145131+0000","last_active":"2024-04-25T12:22:04.920270+0000","last_peered":"2024-04-25T12:22:04.920270+0000","last_clean":"2024-04-25T12:22:04.920270+0000","last_became_active":"2024-04-25T12:21:24.142422+0000","last_became_peered":"2024-04-25T12:21:24.142422+0000","last_unstale":"2024-04-25T12:22:04.920270+0000","last_undegraded":"2024-04-25T12:22:04.920270+0000","last_fullsized":"2024-04-25T12:22:04.920270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:40:24.312543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'17","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:08.910633+0000","last_change":"2024-04-25T12:21:23.104288+0000","last_active":"2024-04-25T12:22:08.910633+0000","last_peered":"2024-04-25T12:22:08.910633+0000","last_clean":"2024-04-25T12:22:08.910633+0000","last_became_active":"2024-04-25T12:21:23.103680+0000","last_became_peered":"2024-04-25T12:21:23.103680+0000","last_unstale":"2024-04-25T12:22:08.910633+0000","last_undegraded":"2024-04-25T12:22:08.910633+0000","last_fullsized":"2024-04-25T12:22:08.910633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:29.672890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.898513+0000","last_change":"2024-04-25T12:21:28.199834+0000","last_active":"2024-04-25T12:22:04.898513+0000","last_peered":"2024-04-25T12:22:04.898513+0000","last_clean":"2024-04-25T12:22:04.898513+0000","last_became_active":"2024-04-25T12:21:28.199411+0000","last_became_peered":"2024-04-25T12:21:28.199411+0000","last_unstale":"2024-04-25T12:22:04.898513+0000","last_undegraded":"2024-04-25T12:22:04.898513+0000","last_fullsized":"2024-04-25T12:22:04.898513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:52:34.443813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.892493+0000","last_change":"2024-04-25T12:21:24.127488+0000","last_active":"2024-04-25T12:22:04.892493+0000","last_peered":"2024-04-25T12:22:04.892493+0000","last_clean":"2024-04-25T12:22:04.892493+0000","last_became_active":"2024-04-25T12:21:24.126721+0000","last_became_peered":"2024-04-25T12:21:24.126721+0000","last_unstale":"2024-04-25T12:22:04.892493+0000","last_undegraded":"2024-04-25T12:22:04.892493+0000","last_fullsized":"2024-04-25T12:22:04.892493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:02.153025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:23.488464+0000","last_change":"2024-04-25T12:21:23.139626+0000","last_active":"2024-04-25T12:22:23.488464+0000","last_peered":"2024-04-25T12:22:23.488464+0000","last_clean":"2024-04-25T12:22:23.488464+0000","last_became_active":"2024-04-25T12:21:23.138837+0000","last_became_peered":"2024-04-25T12:21:23.138837+0000","last_unstale":"2024-04-25T12:22:23.488464+0000","last_undegraded":"2024-04-25T12:22:23.488464+0000","last_fullsized":"2024-04-25T12:22:23.488464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:09.309384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.888695+0000","last_change":"2024-04-25T12:21:28.383919+0000","last_active":"2024-04-25T12:22:04.888695+0000","last_peered":"2024-04-25T12:22:04.888695+0000","last_clean":"2024-04-25T12:22:04.888695+0000","last_became_active":"2024-04-25T12:21:28.383298+0000","last_became_peered":"2024-04-25T12:21:28.383298+0000","last_unstale":"2024-04-25T12:22:04.888695+0000","last_undegraded":"2024-04-25T12:22:04.888695+0000","last_fullsized":"2024-04-25T12:22:04.888695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:01.115040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.921039+0000","last_change":"2024-04-25T12:21:24.146454+0000","last_active":"2024-04-25T12:22:04.921039+0000","last_peered":"2024-04-25T12:22:04.921039+0000","last_clean":"2024-04-25T12:22:04.921039+0000","last_became_active":"2024-04-25T12:21:24.145931+0000","last_became_peered":"2024-04-25T12:21:24.145931+0000","last_unstale":"2024-04-25T12:22:04.921039+0000","last_undegraded":"2024-04-25T12:22:04.921039+0000","last_fullsized":"2024-04-25T12:22:04.921039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:35:22.490243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:08.909090+0000","last_change":"2024-04-25T12:21:23.122495+0000","last_active":"2024-04-25T12:22:08.909090+0000","last_peered":"2024-04-25T12:22:08.909090+0000","last_clean":"2024-04-25T12:22:08.909090+0000","last_became_active":"2024-04-25T12:21:23.121429+0000","last_became_peered":"2024-04-25T12:21:23.121429+0000","last_unstale":"2024-04-25T12:22:08.909090+0000","last_undegraded":"2024-04-25T12:22:08.909090+0000","last_fullsized":"2024-04-25T12:22:08.909090+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:10.530248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.886402+0000","last_change":"2024-04-25T12:21:28.375971+0000","last_active":"2024-04-25T12:22:04.886402+0000","last_peered":"2024-04-25T12:22:04.886402+0000","last_clean":"2024-04-25T12:22:04.886402+0000","last_became_active":"2024-04-25T12:21:28.375013+0000","last_became_peered":"2024-04-25T12:21:28.375013+0000","last_unstale":"2024-04-25T12:22:04.886402+0000","last_undegraded":"2024-04-25T12:22:04.886402+0000","last_fullsized":"2024-04-25T12:22:04.886402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:56:45.398763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.895854+0000","last_change":"2024-04-25T12:21:24.138293+0000","last_active":"2024-04-25T12:22:04.895854+0000","last_peered":"2024-04-25T12:22:04.895854+0000","last_clean":"2024-04-25T12:22:04.895854+0000","last_became_active":"2024-04-25T12:21:24.138016+0000","last_became_peered":"2024-04-25T12:21:24.138016+0000","last_unstale":"2024-04-25T12:22:04.895854+0000","last_undegraded":"2024-04-25T12:22:04.895854+0000","last_fullsized":"2024-04-25T12:22:04.895854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:48:54.078239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'9","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:14.940825+0000","last_change":"2024-04-25T12:21:23.136227+0000","last_active":"2024-04-25T12:22:14.940825+0000","last_peered":"2024-04-25T12:22:14.940825+0000","last_clean":"2024-04-25T12:22:14.940825+0000","last_became_active":"2024-04-25T12:21:23.135947+0000","last_became_peered":"2024-04-25T12:21:23.135947+0000","last_unstale":"2024-04-25T12:22:14.940825+0000","last_undegraded":"2024-04-25T12:22:14.940825+0000","last_fullsized":"2024-04-25T12:22:14.940825+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:41:24.323924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.886878+0000","last_change":"2024-04-25T12:21:28.378564+0000","last_active":"2024-04-25T12:22:04.886878+0000","last_peered":"2024-04-25T12:22:04.886878+0000","last_clean":"2024-04-25T12:22:04.886878+0000","last_became_active":"2024-04-25T12:21:28.377532+0000","last_became_peered":"2024-04-25T12:21:28.377532+0000","last_unstale":"2024-04-25T12:22:04.886878+0000","last_undegraded":"2024-04-25T12:22:04.886878+0000","last_fullsized":"2024-04-25T12:22:04.886878+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:20.576562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.902496+0000","last_change":"2024-04-25T12:22:04.900963+0000","last_active":"2024-04-25T12:22:04.902496+0000","last_peered":"2024-04-25T12:22:04.902496+0000","last_clean":"2024-04-25T12:22:04.902496+0000","last_became_active":"2024-04-25T12:22:04.899942+0000","last_became_peered":"2024-04-25T12:22:04.899942+0000","last_unstale":"2024-04-25T12:22:04.902496+0000","last_undegraded":"2024-04-25T12:22:04.902496+0000","last_fullsized":"2024-04-25T12:22:04.902496+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:34:36.179214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.14","version":"26'16","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:23.494045+0000","last_change":"2024-04-25T12:21:23.130231+0000","last_active":"2024-04-25T12:22:23.494045+0000","last_peered":"2024-04-25T12:22:23.494045+0000","last_clean":"2024-04-25T12:22:23.494045+0000","last_became_active":"2024-04-25T12:21:23.129474+0000","last_became_peered":"2024-04-25T12:21:23.129474+0000","last_unstale":"2024-04-25T12:22:23.494045+0000","last_undegraded":"2024-04-25T12:22:23.494045+0000","last_fullsized":"2024-04-25T12:22:23.494045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:50.974387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4424,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.920504+0000","last_change":"2024-04-25T12:21:28.200551+0000","last_active":"2024-04-25T12:22:04.920504+0000","last_peered":"2024-04-25T12:22:04.920504+0000","last_clean":"2024-04-25T12:22:04.920504+0000","last_became_active":"2024-04-25T12:21:28.200152+0000","last_became_peered":"2024-04-25T12:21:28.200152+0000","last_unstale":"2024-04-25T12:22:04.920504+0000","last_undegraded":"2024-04-25T12:22:04.920504+0000","last_fullsized":"2024-04-25T12:22:04.920504+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:17:34.847925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.889734+0000","last_change":"2024-04-25T12:21:24.142957+0000","last_active":"2024-04-25T12:22:04.889734+0000","last_peered":"2024-04-25T12:22:04.889734+0000","last_clean":"2024-04-25T12:22:04.889734+0000","last_became_active":"2024-04-25T12:21:24.142594+0000","last_became_peered":"2024-04-25T12:21:24.142594+0000","last_unstale":"2024-04-25T12:22:04.889734+0000","last_undegraded":"2024-04-25T12:22:04.889734+0000","last_fullsized":"2024-04-25T12:22:04.889734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:36:47.719946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.922151+0000","last_change":"2024-04-25T12:21:23.125118+0000","last_active":"2024-04-25T12:22:04.922151+0000","last_peered":"2024-04-25T12:22:04.922151+0000","last_clean":"2024-04-25T12:22:04.922151+0000","last_became_active":"2024-04-25T12:21:23.124836+0000","last_became_peered":"2024-04-25T12:21:23.124836+0000","last_unstale":"2024-04-25T12:22:04.922151+0000","last_undegraded":"2024-04-25T12:22:04.922151+0000","last_fullsized":"2024-04-25T12:22:04.922151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:03:28.500940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.889244+0000","last_change":"2024-04-25T12:21:28.194476+0000","last_active":"2024-04-25T12:22:04.889244+0000","last_peered":"2024-04-25T12:22:04.889244+0000","last_clean":"2024-04-25T12:22:04.889244+0000","last_became_active":"2024-04-25T12:21:28.193277+0000","last_became_peered":"2024-04-25T12:21:28.193277+0000","last_unstale":"2024-04-25T12:22:04.889244+0000","last_undegraded":"2024-04-25T12:22:04.889244+0000","last_fullsized":"2024-04-25T12:22:04.889244+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:31.495441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.898278+0000","last_change":"2024-04-25T12:21:24.115104+0000","last_active":"2024-04-25T12:22:04.898278+0000","last_peered":"2024-04-25T12:22:04.898278+0000","last_clean":"2024-04-25T12:22:04.898278+0000","last_became_active":"2024-04-25T12:21:24.114367+0000","last_became_peered":"2024-04-25T12:21:24.114367+0000","last_unstale":"2024-04-25T12:22:04.898278+0000","last_undegraded":"2024-04-25T12:22:04.898278+0000","last_fullsized":"2024-04-25T12:22:04.898278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:03.107076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:14.951344+0000","last_change":"2024-04-25T12:21:23.132996+0000","last_active":"2024-04-25T12:22:14.951344+0000","last_peered":"2024-04-25T12:22:14.951344+0000","last_clean":"2024-04-25T12:22:14.951344+0000","last_became_active":"2024-04-25T12:21:23.132223+0000","last_became_peered":"2024-04-25T12:21:23.132223+0000","last_unstale":"2024-04-25T12:22:14.951344+0000","last_undegraded":"2024-04-25T12:22:14.951344+0000","last_fullsized":"2024-04-25T12:22:14.951344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:18.689461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.886057+0000","last_change":"2024-04-25T12:21:28.203302+0000","last_active":"2024-04-25T12:22:04.886057+0000","last_peered":"2024-04-25T12:22:04.886057+0000","last_clean":"2024-04-25T12:22:04.886057+0000","last_became_active":"2024-04-25T12:21:28.202800+0000","last_became_peered":"2024-04-25T12:21:28.202800+0000","last_unstale":"2024-04-25T12:22:04.886057+0000","last_undegraded":"2024-04-25T12:22:04.886057+0000","last_fullsized":"2024-04-25T12:22:04.886057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:27:16.676736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.925107+0000","last_change":"2024-04-25T12:22:04.922613+0000","last_active":"2024-04-25T12:22:04.925107+0000","last_peered":"2024-04-25T12:22:04.925107+0000","last_clean":"2024-04-25T12:22:04.925107+0000","last_became_active":"2024-04-25T12:22:04.921770+0000","last_became_peered":"2024-04-25T12:22:04.921770+0000","last_unstale":"2024-04-25T12:22:04.925107+0000","last_undegraded":"2024-04-25T12:22:04.925107+0000","last_fullsized":"2024-04-25T12:22:04.925107+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:19:15.639901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"26'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:23.484338+0000","last_change":"2024-04-25T12:21:23.130843+0000","last_active":"2024-04-25T12:22:23.484338+0000","last_peered":"2024-04-25T12:22:23.484338+0000","last_clean":"2024-04-25T12:22:23.484338+0000","last_became_active":"2024-04-25T12:21:23.129967+0000","last_became_peered":"2024-04-25T12:21:23.129967+0000","last_unstale":"2024-04-25T12:22:23.484338+0000","last_undegraded":"2024-04-25T12:22:23.484338+0000","last_fullsized":"2024-04-25T12:22:23.484338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:19:22.719364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.885925+0000","last_change":"2024-04-25T12:21:28.384082+0000","last_active":"2024-04-25T12:22:04.885925+0000","last_peered":"2024-04-25T12:22:04.885925+0000","last_clean":"2024-04-25T12:22:04.885925+0000","last_became_active":"2024-04-25T12:21:28.383228+0000","last_became_peered":"2024-04-25T12:21:28.383228+0000","last_unstale":"2024-04-25T12:22:04.885925+0000","last_undegraded":"2024-04-25T12:22:04.885925+0000","last_fullsized":"2024-04-25T12:22:04.885925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:14.600341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.898196+0000","last_change":"2024-04-25T12:21:28.378352+0000","last_active":"2024-04-25T12:22:04.898196+0000","last_peered":"2024-04-25T12:22:04.898196+0000","last_clean":"2024-04-25T12:22:04.898196+0000","last_became_active":"2024-04-25T12:21:28.377742+0000","last_became_peered":"2024-04-25T12:21:28.377742+0000","last_unstale":"2024-04-25T12:22:04.898196+0000","last_undegraded":"2024-04-25T12:22:04.898196+0000","last_fullsized":"2024-04-25T12:22:04.898196+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:20.075296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.920494+0000","last_change":"2024-04-25T12:21:24.126158+0000","last_active":"2024-04-25T12:22:04.920494+0000","last_peered":"2024-04-25T12:22:04.920494+0000","last_clean":"2024-04-25T12:22:04.920494+0000","last_became_active":"2024-04-25T12:21:24.125448+0000","last_became_peered":"2024-04-25T12:21:24.125448+0000","last_unstale":"2024-04-25T12:22:04.920494+0000","last_undegraded":"2024-04-25T12:22:04.920494+0000","last_fullsized":"2024-04-25T12:22:04.920494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:42.769206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:08.908401+0000","last_change":"2024-04-25T12:21:23.117159+0000","last_active":"2024-04-25T12:22:08.908401+0000","last_peered":"2024-04-25T12:22:08.908401+0000","last_clean":"2024-04-25T12:22:08.908401+0000","last_became_active":"2024-04-25T12:21:23.115911+0000","last_became_peered":"2024-04-25T12:21:23.115911+0000","last_unstale":"2024-04-25T12:22:08.908401+0000","last_undegraded":"2024-04-25T12:22:08.908401+0000","last_fullsized":"2024-04-25T12:22:08.908401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:46:10.238958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.900044+0000","last_change":"2024-04-25T12:22:04.900044+0000","last_active":"2024-04-25T12:22:04.900044+0000","last_peered":"2024-04-25T12:22:04.900044+0000","last_clean":"2024-04-25T12:22:04.900044+0000","last_became_active":"2024-04-25T12:22:04.899300+0000","last_became_peered":"2024-04-25T12:22:04.899300+0000","last_unstale":"2024-04-25T12:22:04.900044+0000","last_undegraded":"2024-04-25T12:22:04.900044+0000","last_fullsized":"2024-04-25T12:22:04.900044+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:00:51.607957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,0],"acting":[6,5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.886379+0000","last_change":"2024-04-25T12:21:24.137477+0000","last_active":"2024-04-25T12:22:04.886379+0000","last_peered":"2024-04-25T12:22:04.886379+0000","last_clean":"2024-04-25T12:22:04.886379+0000","last_became_active":"2024-04-25T12:21:24.137078+0000","last_became_peered":"2024-04-25T12:21:24.137078+0000","last_unstale":"2024-04-25T12:22:04.886379+0000","last_undegraded":"2024-04-25T12:22:04.886379+0000","last_fullsized":"2024-04-25T12:22:04.886379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:53.321239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.886985+0000","last_change":"2024-04-25T12:21:23.130046+0000","last_active":"2024-04-25T12:22:04.886985+0000","last_peered":"2024-04-25T12:22:04.886985+0000","last_clean":"2024-04-25T12:22:04.886985+0000","last_became_active":"2024-04-25T12:21:23.129779+0000","last_became_peered":"2024-04-25T12:21:23.129779+0000","last_unstale":"2024-04-25T12:22:04.886985+0000","last_undegraded":"2024-04-25T12:22:04.886985+0000","last_fullsized":"2024-04-25T12:22:04.886985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:24:43.733780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:08.910854+0000","last_change":"2024-04-25T12:21:23.138152+0000","last_active":"2024-04-25T12:22:08.910854+0000","last_peered":"2024-04-25T12:22:08.910854+0000","last_clean":"2024-04-25T12:22:08.910854+0000","last_became_active":"2024-04-25T12:21:23.137393+0000","last_became_peered":"2024-04-25T12:21:23.137393+0000","last_unstale":"2024-04-25T12:22:08.910854+0000","last_undegraded":"2024-04-25T12:22:08.910854+0000","last_fullsized":"2024-04-25T12:22:08.910854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:10:42.713304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.897354+0000","last_change":"2024-04-25T12:21:24.122299+0000","last_active":"2024-04-25T12:22:04.897354+0000","last_peered":"2024-04-25T12:22:04.897354+0000","last_clean":"2024-04-25T12:22:04.897354+0000","last_became_active":"2024-04-25T12:21:24.121480+0000","last_became_peered":"2024-04-25T12:21:24.121480+0000","last_unstale":"2024-04-25T12:22:04.897354+0000","last_undegraded":"2024-04-25T12:22:04.897354+0000","last_fullsized":"2024-04-25T12:22:04.897354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:05:46.050357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.900613+0000","last_change":"2024-04-25T12:22:04.900613+0000","last_active":"2024-04-25T12:22:04.900613+0000","last_peered":"2024-04-25T12:22:04.900613+0000","last_clean":"2024-04-25T12:22:04.900613+0000","last_became_active":"2024-04-25T12:22:04.900006+0000","last_became_peered":"2024-04-25T12:22:04.900006+0000","last_unstale":"2024-04-25T12:22:04.900613+0000","last_undegraded":"2024-04-25T12:22:04.900613+0000","last_fullsized":"2024-04-25T12:22:04.900613+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:06:18.454386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,5],"acting":[2,0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:23.483056+0000","last_change":"2024-04-25T12:21:23.113080+0000","last_active":"2024-04-25T12:22:23.483056+0000","last_peered":"2024-04-25T12:22:23.483056+0000","last_clean":"2024-04-25T12:22:23.483056+0000","last_became_active":"2024-04-25T12:21:23.112721+0000","last_became_peered":"2024-04-25T12:21:23.112721+0000","last_unstale":"2024-04-25T12:22:23.483056+0000","last_undegraded":"2024-04-25T12:22:23.483056+0000","last_fullsized":"2024-04-25T12:22:23.483056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:25.396377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.888327+0000","last_change":"2024-04-25T12:21:24.134267+0000","last_active":"2024-04-25T12:22:04.888327+0000","last_peered":"2024-04-25T12:22:04.888327+0000","last_clean":"2024-04-25T12:22:04.888327+0000","last_became_active":"2024-04-25T12:21:24.133493+0000","last_became_peered":"2024-04-25T12:21:24.133493+0000","last_unstale":"2024-04-25T12:22:04.888327+0000","last_undegraded":"2024-04-25T12:22:04.888327+0000","last_fullsized":"2024-04-25T12:22:04.888327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:24:25.810067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.896184+0000","last_change":"2024-04-25T12:22:04.896184+0000","last_active":"2024-04-25T12:22:04.896184+0000","last_peered":"2024-04-25T12:22:04.896184+0000","last_clean":"2024-04-25T12:22:04.896184+0000","last_became_active":"2024-04-25T12:22:04.895198+0000","last_became_peered":"2024-04-25T12:22:04.895198+0000","last_unstale":"2024-04-25T12:22:04.896184+0000","last_undegraded":"2024-04-25T12:22:04.896184+0000","last_fullsized":"2024-04-25T12:22:04.896184+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:00.687023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,2],"acting":[3,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.892094+0000","last_change":"2024-04-25T12:21:24.126582+0000","last_active":"2024-04-25T12:22:04.892094+0000","last_peered":"2024-04-25T12:22:04.892094+0000","last_clean":"2024-04-25T12:22:04.892094+0000","last_became_active":"2024-04-25T12:21:24.125831+0000","last_became_peered":"2024-04-25T12:21:24.125831+0000","last_unstale":"2024-04-25T12:22:04.892094+0000","last_undegraded":"2024-04-25T12:22:04.892094+0000","last_fullsized":"2024-04-25T12:22:04.892094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:53.129274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.891228+0000","last_change":"2024-04-25T12:21:24.117441+0000","last_active":"2024-04-25T12:22:04.891228+0000","last_peered":"2024-04-25T12:22:04.891228+0000","last_clean":"2024-04-25T12:22:04.891228+0000","last_became_active":"2024-04-25T12:21:24.116498+0000","last_became_peered":"2024-04-25T12:21:24.116498+0000","last_unstale":"2024-04-25T12:22:04.891228+0000","last_undegraded":"2024-04-25T12:22:04.891228+0000","last_fullsized":"2024-04-25T12:22:04.891228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:06:45.632199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.886040+0000","last_change":"2024-04-25T12:21:24.117995+0000","last_active":"2024-04-25T12:22:04.886040+0000","last_peered":"2024-04-25T12:22:04.886040+0000","last_clean":"2024-04-25T12:22:04.886040+0000","last_became_active":"2024-04-25T12:21:24.114742+0000","last_became_peered":"2024-04-25T12:21:24.114742+0000","last_unstale":"2024-04-25T12:22:04.886040+0000","last_undegraded":"2024-04-25T12:22:04.886040+0000","last_fullsized":"2024-04-25T12:22:04.886040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:59.864082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.897343+0000","last_change":"2024-04-25T12:21:24.134863+0000","last_active":"2024-04-25T12:22:04.897343+0000","last_peered":"2024-04-25T12:22:04.897343+0000","last_clean":"2024-04-25T12:22:04.897343+0000","last_became_active":"2024-04-25T12:21:24.126476+0000","last_became_peered":"2024-04-25T12:21:24.126476+0000","last_unstale":"2024-04-25T12:22:04.897343+0000","last_undegraded":"2024-04-25T12:22:04.897343+0000","last_fullsized":"2024-04-25T12:22:04.897343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:19:32.516429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.887326+0000","last_change":"2024-04-25T12:21:24.135699+0000","last_active":"2024-04-25T12:22:04.887326+0000","last_peered":"2024-04-25T12:22:04.887326+0000","last_clean":"2024-04-25T12:22:04.887326+0000","last_became_active":"2024-04-25T12:21:24.135257+0000","last_became_peered":"2024-04-25T12:21:24.135257+0000","last_unstale":"2024-04-25T12:22:04.887326+0000","last_undegraded":"2024-04-25T12:22:04.887326+0000","last_fullsized":"2024-04-25T12:22:04.887326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:55:21.195220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.921749+0000","last_change":"2024-04-25T12:21:24.132760+0000","last_active":"2024-04-25T12:22:04.921749+0000","last_peered":"2024-04-25T12:22:04.921749+0000","last_clean":"2024-04-25T12:22:04.921749+0000","last_became_active":"2024-04-25T12:21:24.132225+0000","last_became_peered":"2024-04-25T12:21:24.132225+0000","last_unstale":"2024-04-25T12:22:04.921749+0000","last_undegraded":"2024-04-25T12:22:04.921749+0000","last_fullsized":"2024-04-25T12:22:04.921749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:44:23.025905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.895018+0000","last_change":"2024-04-25T12:21:24.148515+0000","last_active":"2024-04-25T12:22:04.895018+0000","last_peered":"2024-04-25T12:22:04.895018+0000","last_clean":"2024-04-25T12:22:04.895018+0000","last_became_active":"2024-04-25T12:21:24.148025+0000","last_became_peered":"2024-04-25T12:21:24.148025+0000","last_unstale":"2024-04-25T12:22:04.895018+0000","last_undegraded":"2024-04-25T12:22:04.895018+0000","last_fullsized":"2024-04-25T12:22:04.895018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:49:29.665678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.888799+0000","last_change":"2024-04-25T12:21:24.135856+0000","last_active":"2024-04-25T12:22:04.888799+0000","last_peered":"2024-04-25T12:22:04.888799+0000","last_clean":"2024-04-25T12:22:04.888799+0000","last_became_active":"2024-04-25T12:21:24.135310+0000","last_became_peered":"2024-04-25T12:21:24.135310+0000","last_unstale":"2024-04-25T12:22:04.888799+0000","last_undegraded":"2024-04-25T12:22:04.888799+0000","last_fullsized":"2024-04-25T12:22:04.888799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:02.396753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.885451+0000","last_change":"2024-04-25T12:21:24.119002+0000","last_active":"2024-04-25T12:22:04.885451+0000","last_peered":"2024-04-25T12:22:04.885451+0000","last_clean":"2024-04-25T12:22:04.885451+0000","last_became_active":"2024-04-25T12:21:24.112992+0000","last_became_peered":"2024-04-25T12:21:24.112992+0000","last_unstale":"2024-04-25T12:22:04.885451+0000","last_undegraded":"2024-04-25T12:22:04.885451+0000","last_fullsized":"2024-04-25T12:22:04.885451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:44:34.461656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.886239+0000","last_change":"2024-04-25T12:21:24.118251+0000","last_active":"2024-04-25T12:22:04.886239+0000","last_peered":"2024-04-25T12:22:04.886239+0000","last_clean":"2024-04-25T12:22:04.886239+0000","last_became_active":"2024-04-25T12:21:24.117412+0000","last_became_peered":"2024-04-25T12:21:24.117412+0000","last_unstale":"2024-04-25T12:22:04.886239+0000","last_undegraded":"2024-04-25T12:22:04.886239+0000","last_fullsized":"2024-04-25T12:22:04.886239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:44:13.238510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.885958+0000","last_change":"2024-04-25T12:21:24.138641+0000","last_active":"2024-04-25T12:22:04.885958+0000","last_peered":"2024-04-25T12:22:04.885958+0000","last_clean":"2024-04-25T12:22:04.885958+0000","last_became_active":"2024-04-25T12:21:24.137937+0000","last_became_peered":"2024-04-25T12:21:24.137937+0000","last_unstale":"2024-04-25T12:22:04.885958+0000","last_undegraded":"2024-04-25T12:22:04.885958+0000","last_fullsized":"2024-04-25T12:22:04.885958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:55:49.291319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.896812+0000","last_change":"2024-04-25T12:21:24.137779+0000","last_active":"2024-04-25T12:22:04.896812+0000","last_peered":"2024-04-25T12:22:04.896812+0000","last_clean":"2024-04-25T12:22:04.896812+0000","last_became_active":"2024-04-25T12:21:24.137431+0000","last_became_peered":"2024-04-25T12:21:24.137431+0000","last_unstale":"2024-04-25T12:22:04.896812+0000","last_undegraded":"2024-04-25T12:22:04.896812+0000","last_fullsized":"2024-04-25T12:22:04.896812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:24:24.181972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.894528+0000","last_change":"2024-04-25T12:21:24.128960+0000","last_active":"2024-04-25T12:22:04.894528+0000","last_peered":"2024-04-25T12:22:04.894528+0000","last_clean":"2024-04-25T12:22:04.894528+0000","last_became_active":"2024-04-25T12:21:24.128125+0000","last_became_peered":"2024-04-25T12:21:24.128125+0000","last_unstale":"2024-04-25T12:22:04.894528+0000","last_undegraded":"2024-04-25T12:22:04.894528+0000","last_fullsized":"2024-04-25T12:22:04.894528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:01.701850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.921873+0000","last_change":"2024-04-25T12:21:24.149001+0000","last_active":"2024-04-25T12:22:04.921873+0000","last_peered":"2024-04-25T12:22:04.921873+0000","last_clean":"2024-04-25T12:22:04.921873+0000","last_became_active":"2024-04-25T12:21:24.147230+0000","last_became_peered":"2024-04-25T12:21:24.147230+0000","last_unstale":"2024-04-25T12:22:04.921873+0000","last_undegraded":"2024-04-25T12:22:04.921873+0000","last_fullsized":"2024-04-25T12:22:04.921873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:05:17.824845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.891883+0000","last_change":"2024-04-25T12:21:24.119941+0000","last_active":"2024-04-25T12:22:04.891883+0000","last_peered":"2024-04-25T12:22:04.891883+0000","last_clean":"2024-04-25T12:22:04.891883+0000","last_became_active":"2024-04-25T12:21:24.118761+0000","last_became_peered":"2024-04-25T12:21:24.118761+0000","last_unstale":"2024-04-25T12:22:04.891883+0000","last_undegraded":"2024-04-25T12:22:04.891883+0000","last_fullsized":"2024-04-25T12:22:04.891883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:49:41.353812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.887528+0000","last_change":"2024-04-25T12:21:24.144163+0000","last_active":"2024-04-25T12:22:04.887528+0000","last_peered":"2024-04-25T12:22:04.887528+0000","last_clean":"2024-04-25T12:22:04.887528+0000","last_became_active":"2024-04-25T12:21:24.143786+0000","last_became_peered":"2024-04-25T12:21:24.143786+0000","last_unstale":"2024-04-25T12:22:04.887528+0000","last_undegraded":"2024-04-25T12:22:04.887528+0000","last_fullsized":"2024-04-25T12:22:04.887528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:17.961437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.885408+0000","last_change":"2024-04-25T12:21:24.107551+0000","last_active":"2024-04-25T12:22:04.885408+0000","last_peered":"2024-04-25T12:22:04.885408+0000","last_clean":"2024-04-25T12:22:04.885408+0000","last_became_active":"2024-04-25T12:21:24.106818+0000","last_became_peered":"2024-04-25T12:21:24.106818+0000","last_unstale":"2024-04-25T12:22:04.885408+0000","last_undegraded":"2024-04-25T12:22:04.885408+0000","last_fullsized":"2024-04-25T12:22:04.885408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:09:24.627007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.920846+0000","last_change":"2024-04-25T12:21:24.114917+0000","last_active":"2024-04-25T12:22:04.920846+0000","last_peered":"2024-04-25T12:22:04.920846+0000","last_clean":"2024-04-25T12:22:04.920846+0000","last_became_active":"2024-04-25T12:21:24.114237+0000","last_became_peered":"2024-04-25T12:21:24.114237+0000","last_unstale":"2024-04-25T12:22:04.920846+0000","last_undegraded":"2024-04-25T12:22:04.920846+0000","last_fullsized":"2024-04-25T12:22:04.920846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:32:38.296553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.895600+0000","last_change":"2024-04-25T12:21:24.132860+0000","last_active":"2024-04-25T12:22:04.895600+0000","last_peered":"2024-04-25T12:22:04.895600+0000","last_clean":"2024-04-25T12:22:04.895600+0000","last_became_active":"2024-04-25T12:21:24.132094+0000","last_became_peered":"2024-04-25T12:21:24.132094+0000","last_unstale":"2024-04-25T12:22:04.895600+0000","last_undegraded":"2024-04-25T12:22:04.895600+0000","last_fullsized":"2024-04-25T12:22:04.895600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:27:24.026145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.901390+0000","last_change":"2024-04-25T12:22:04.897436+0000","last_active":"2024-04-25T12:22:04.901390+0000","last_peered":"2024-04-25T12:22:04.901390+0000","last_clean":"2024-04-25T12:22:04.901390+0000","last_became_active":"2024-04-25T12:22:04.896529+0000","last_became_peered":"2024-04-25T12:22:04.896529+0000","last_unstale":"2024-04-25T12:22:04.901390+0000","last_undegraded":"2024-04-25T12:22:04.901390+0000","last_fullsized":"2024-04-25T12:22:04.901390+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:02:55.727071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.889462+0000","last_change":"2024-04-25T12:21:24.124288+0000","last_active":"2024-04-25T12:22:04.889462+0000","last_peered":"2024-04-25T12:22:04.889462+0000","last_clean":"2024-04-25T12:22:04.889462+0000","last_became_active":"2024-04-25T12:21:24.116973+0000","last_became_peered":"2024-04-25T12:21:24.116973+0000","last_unstale":"2024-04-25T12:22:04.889462+0000","last_undegraded":"2024-04-25T12:22:04.889462+0000","last_fullsized":"2024-04-25T12:22:04.889462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:34:53.390321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.894234+0000","last_change":"2024-04-25T12:21:24.115615+0000","last_active":"2024-04-25T12:22:04.894234+0000","last_peered":"2024-04-25T12:22:04.894234+0000","last_clean":"2024-04-25T12:22:04.894234+0000","last_became_active":"2024-04-25T12:21:24.114829+0000","last_became_peered":"2024-04-25T12:21:24.114829+0000","last_unstale":"2024-04-25T12:22:04.894234+0000","last_undegraded":"2024-04-25T12:22:04.894234+0000","last_fullsized":"2024-04-25T12:22:04.894234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:17.961437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.895028+0000","last_change":"2024-04-25T12:21:24.117225+0000","last_active":"2024-04-25T12:22:04.895028+0000","last_peered":"2024-04-25T12:22:04.895028+0000","last_clean":"2024-04-25T12:22:04.895028+0000","last_became_active":"2024-04-25T12:21:24.116359+0000","last_became_peered":"2024-04-25T12:21:24.116359+0000","last_unstale":"2024-04-25T12:22:04.895028+0000","last_undegraded":"2024-04-25T12:22:04.895028+0000","last_fullsized":"2024-04-25T12:22:04.895028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:22:27.461512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.921638+0000","last_change":"2024-04-25T12:21:24.145198+0000","last_active":"2024-04-25T12:22:04.921638+0000","last_peered":"2024-04-25T12:22:04.921638+0000","last_clean":"2024-04-25T12:22:04.921638+0000","last_became_active":"2024-04-25T12:21:24.142353+0000","last_became_peered":"2024-04-25T12:21:24.142353+0000","last_unstale":"2024-04-25T12:22:04.921638+0000","last_undegraded":"2024-04-25T12:22:04.921638+0000","last_fullsized":"2024-04-25T12:22:04.921638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:44:24.335226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.885945+0000","last_change":"2024-04-25T12:21:24.128086+0000","last_active":"2024-04-25T12:22:04.885945+0000","last_peered":"2024-04-25T12:22:04.885945+0000","last_clean":"2024-04-25T12:22:04.885945+0000","last_became_active":"2024-04-25T12:21:24.127315+0000","last_became_peered":"2024-04-25T12:21:24.127315+0000","last_unstale":"2024-04-25T12:22:04.885945+0000","last_undegraded":"2024-04-25T12:22:04.885945+0000","last_fullsized":"2024-04-25T12:22:04.885945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:20.513145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.920184+0000","last_change":"2024-04-25T12:21:24.142394+0000","last_active":"2024-04-25T12:22:04.920184+0000","last_peered":"2024-04-25T12:22:04.920184+0000","last_clean":"2024-04-25T12:22:04.920184+0000","last_became_active":"2024-04-25T12:21:24.142029+0000","last_became_peered":"2024-04-25T12:21:24.142029+0000","last_unstale":"2024-04-25T12:22:04.920184+0000","last_undegraded":"2024-04-25T12:22:04.920184+0000","last_fullsized":"2024-04-25T12:22:04.920184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:02:56.129724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.885858+0000","last_change":"2024-04-25T12:21:24.113876+0000","last_active":"2024-04-25T12:22:04.885858+0000","last_peered":"2024-04-25T12:22:04.885858+0000","last_clean":"2024-04-25T12:22:04.885858+0000","last_became_active":"2024-04-25T12:21:24.112339+0000","last_became_peered":"2024-04-25T12:21:24.112339+0000","last_unstale":"2024-04-25T12:22:04.885858+0000","last_undegraded":"2024-04-25T12:22:04.885858+0000","last_fullsized":"2024-04-25T12:22:04.885858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:31:44.641068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.920602+0000","last_change":"2024-04-25T12:21:24.144879+0000","last_active":"2024-04-25T12:22:04.920602+0000","last_peered":"2024-04-25T12:22:04.920602+0000","last_clean":"2024-04-25T12:22:04.920602+0000","last_became_active":"2024-04-25T12:21:24.142422+0000","last_became_peered":"2024-04-25T12:21:24.142422+0000","last_unstale":"2024-04-25T12:22:04.920602+0000","last_undegraded":"2024-04-25T12:22:04.920602+0000","last_fullsized":"2024-04-25T12:22:04.920602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:03.206429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.886225+0000","last_change":"2024-04-25T12:21:24.132561+0000","last_active":"2024-04-25T12:22:04.886225+0000","last_peered":"2024-04-25T12:22:04.886225+0000","last_clean":"2024-04-25T12:22:04.886225+0000","last_became_active":"2024-04-25T12:21:24.131746+0000","last_became_peered":"2024-04-25T12:21:24.131746+0000","last_unstale":"2024-04-25T12:22:04.886225+0000","last_undegraded":"2024-04-25T12:22:04.886225+0000","last_fullsized":"2024-04-25T12:22:04.886225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:24.441417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.898100+0000","last_change":"2024-04-25T12:21:24.111956+0000","last_active":"2024-04-25T12:22:04.898100+0000","last_peered":"2024-04-25T12:22:04.898100+0000","last_clean":"2024-04-25T12:22:04.898100+0000","last_became_active":"2024-04-25T12:21:24.111154+0000","last_became_peered":"2024-04-25T12:21:24.111154+0000","last_unstale":"2024-04-25T12:22:04.898100+0000","last_undegraded":"2024-04-25T12:22:04.898100+0000","last_fullsized":"2024-04-25T12:22:04.898100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:39:56.070884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.922005+0000","last_change":"2024-04-25T12:21:24.134511+0000","last_active":"2024-04-25T12:22:04.922005+0000","last_peered":"2024-04-25T12:22:04.922005+0000","last_clean":"2024-04-25T12:22:04.922005+0000","last_became_active":"2024-04-25T12:21:24.133839+0000","last_became_peered":"2024-04-25T12:21:24.133839+0000","last_unstale":"2024-04-25T12:22:04.922005+0000","last_undegraded":"2024-04-25T12:22:04.922005+0000","last_fullsized":"2024-04-25T12:22:04.922005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:43.263673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.921347+0000","last_change":"2024-04-25T12:21:24.147519+0000","last_active":"2024-04-25T12:22:04.921347+0000","last_peered":"2024-04-25T12:22:04.921347+0000","last_clean":"2024-04-25T12:22:04.921347+0000","last_became_active":"2024-04-25T12:21:24.146805+0000","last_became_peered":"2024-04-25T12:21:24.146805+0000","last_unstale":"2024-04-25T12:22:04.921347+0000","last_undegraded":"2024-04-25T12:22:04.921347+0000","last_fullsized":"2024-04-25T12:22:04.921347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:23.200746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":12592,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":25184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":194,"ondisk_log_size":194,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":909312,"data_stored":707411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":120157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":327680,"data_stored":118875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":116273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":120191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":116405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":115893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":901120,"data_stored":705603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":5796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T12:22:36.843 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T12:22:37.002 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.997+0000 7f1b86161640 1 Processor -- start 2024-04-25T12:22:37.002 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.997+0000 7f1b86161640 1 -- start start 2024-04-25T12:22:37.003 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.997+0000 7f1b86161640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1b800cda50 0x7f1b800c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:37.003 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.997+0000 7f1b86161640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1b8015b0b0 0x7f1b8015b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:37.003 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.997+0000 7f1b86161640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b8015beb0 con 0x7f1b80155350 2024-04-25T12:22:37.004 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.997+0000 7f1b86161640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f1b800cca40 con 0x7f1b800cda50 2024-04-25T12:22:37.004 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:36.997+0000 7f1b86161640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f1b800ccc90 con 0x7f1b8015b0b0 2024-04-25T12:22:37.004 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:37.001+0000 7f1b76ffd640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1b800cda50 0x7f1b800c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:37.004 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:37.001+0000 7f1b76ffd640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1b800cda50 0x7f1b800c59c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37536/0 (socket says 172.21.15.86:37536) 2024-04-25T12:22:37.004 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:37.001+0000 7f1b76ffd640 1 -- 172.21.15.86:0/808144453 learned_addr learned my addr 172.21.15.86:0/808144453 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:37.004 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:37.001+0000 7f1b7ffff640 1 --2- 172.21.15.86:0/808144453 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1b8015b0b0 0x7f1b8015b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:37.004 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:37.001+0000 7f1b76ffd640 1 -- 172.21.15.86:0/808144453 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1b8015b0b0 msgr2=0x7f1b8015b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:37.004 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:37.001+0000 7f1b76ffd640 1 --2- 172.21.15.86:0/808144453 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1b8015b0b0 0x7f1b8015b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:37.004 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:37.001+0000 7f1b76ffd640 1 -- 172.21.15.86:0/808144453 >> v1:172.21.15.134:6789/0 conn(0x7f1b80155350 legacy=0x7f1b800cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:37.005 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:37.001+0000 7f1b76ffd640 1 -- 172.21.15.86:0/808144453 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b800ccf70 con 0x7f1b800cda50 2024-04-25T12:22:37.005 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:37.001+0000 7f1b76ffd640 1 --2- 172.21.15.86:0/808144453 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b800cda50 0x7f1b800c59c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1b68009870 tx=0x7f1b6801ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=557c0a232f0c770c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:37.006 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:37.001+0000 7f1b7effd640 1 -- 172.21.15.86:0/808144453 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b680b5070 con 0x7f1b800cda50 2024-04-25T12:22:37.006 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:37.001+0000 7f1b7effd640 1 -- 172.21.15.86:0/808144453 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b680a8a50 con 0x7f1b800cda50 2024-04-25T12:22:37.006 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:37.001+0000 7f1b7effd640 1 -- 172.21.15.86:0/808144453 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b680a8e20 con 0x7f1b800cda50 2024-04-25T12:22:37.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:37.001+0000 7f1b86161640 1 -- 172.21.15.86:0/808144453 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b800cda50 msgr2=0x7f1b800c59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:37.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:37.001+0000 7f1b86161640 1 --2- 172.21.15.86:0/808144453 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b800cda50 0x7f1b800c59c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1b68009870 tx=0x7f1b6801ed50 comp rx=0 tx=0).stop 2024-04-25T12:22:37.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:37.001+0000 7f1b86161640 1 -- 172.21.15.86:0/808144453 shutdown_connections 2024-04-25T12:22:37.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:37.001+0000 7f1b86161640 1 --2- 172.21.15.86:0/808144453 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1b8015b0b0 0x7f1b8015b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:37.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:37.001+0000 7f1b86161640 1 --2- 172.21.15.86:0/808144453 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b800cda50 0x7f1b800c59c0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:37.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:37.001+0000 7f1b86161640 1 -- 172.21.15.86:0/808144453 >> 172.21.15.86:0/808144453 conn(0x7f1b8006cc30 msgr2=0x7f1b8006d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:37.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:37.001+0000 7f1b86161640 1 -- 172.21.15.86:0/808144453 shutdown_connections 2024-04-25T12:22:37.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:37.001+0000 7f1b86161640 1 -- 172.21.15.86:0/808144453 wait complete. 2024-04-25T12:22:37.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:37.005+0000 7f1b86161640 1 Processor -- start 2024-04-25T12:22:37.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:37.005+0000 7f1b86161640 1 -- start start 2024-04-25T12:22:37.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:37.005+0000 7f1b86161640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1b800cda50 0x7f1b80142d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:37.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:37.005+0000 7f1b86161640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b80155350 0x7f1b80149ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:37.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:37.005+0000 7f1b86161640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b8015b0b0 0x7f1b8014a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:37.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:37.005+0000 7f1b86161640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1b80155730 con 0x7f1b80155350 2024-04-25T12:22:37.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:37.005+0000 7f1b86161640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1b800cd530 con 0x7f1b8015b0b0 2024-04-25T12:22:37.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:37.005+0000 7f1b86161640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f1b8015e860 con 0x7f1b800cda50 2024-04-25T12:22:37.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:37.005+0000 7f1b76ffd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b80155350 0x7f1b80149ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:37.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:37.005+0000 7f1b76ffd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b80155350 0x7f1b80149ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37542/0 (socket says 172.21.15.86:37542) 2024-04-25T12:22:37.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:37.005+0000 7f1b76ffd640 1 -- 172.21.15.86:0/2648149415 learned_addr learned my addr 172.21.15.86:0/2648149415 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:37.011 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:37.005+0000 7f1b7f7fe640 1 --2- 172.21.15.86:0/2648149415 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1b800cda50 0x7f1b80142d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:37.011 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:37.005+0000 7f1b76ffd640 1 -- 172.21.15.86:0/2648149415 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1b800cda50 msgr2=0x7f1b80142d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:37.011 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:37.005+0000 7f1b76ffd640 1 --2- 172.21.15.86:0/2648149415 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1b800cda50 0x7f1b80142d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:37.011 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:37.005+0000 7f1b7ffff640 1 --2- 172.21.15.86:0/2648149415 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b8015b0b0 0x7f1b8014a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:37.011 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:37.005+0000 7f1b76ffd640 1 -- 172.21.15.86:0/2648149415 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b8015b0b0 msgr2=0x7f1b8014a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:37.011 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:37.005+0000 7f1b76ffd640 1 --2- 172.21.15.86:0/2648149415 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b8015b0b0 0x7f1b8014a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:37.011 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:37.005+0000 7f1b76ffd640 1 -- 172.21.15.86:0/2648149415 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b801f5680 con 0x7f1b80155350 2024-04-25T12:22:37.011 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:37.005+0000 7f1b7f7fe640 1 --2- 172.21.15.86:0/2648149415 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1b800cda50 0x7f1b80142d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:22:37.011 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:37.005+0000 7f1b76ffd640 1 --2- 172.21.15.86:0/2648149415 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b80155350 0x7f1b80149ff0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1b6801d400 tx=0x7f1b6801baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:37.011 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:37.005+0000 7f1b7cff9640 1 -- 172.21.15.86:0/2648149415 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b680c0070 con 0x7f1b80155350 2024-04-25T12:22:37.012 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:37.005+0000 7f1b7cff9640 1 -- 172.21.15.86:0/2648149415 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b680ae550 con 0x7f1b80155350 2024-04-25T12:22:37.012 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:37.005+0000 7f1b86161640 1 -- 172.21.15.86:0/2648149415 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b801f1680 con 0x7f1b80155350 2024-04-25T12:22:37.012 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:37.005+0000 7f1b7cff9640 1 -- 172.21.15.86:0/2648149415 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b680b5070 con 0x7f1b80155350 2024-04-25T12:22:37.012 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:37.005+0000 7f1b86161640 1 -- 172.21.15.86:0/2648149415 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b801f1c40 con 0x7f1b80155350 2024-04-25T12:22:37.013 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:37.005+0000 7f1b86161640 1 -- 172.21.15.86:0/2648149415 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b80075df0 con 0x7f1b80155350 2024-04-25T12:22:37.013 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:37.005+0000 7f1b7cff9640 1 -- 172.21.15.86:0/2648149415 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1b680c3070 con 0x7f1b80155350 2024-04-25T12:22:37.013 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:37.009+0000 7f1b7cff9640 1 --2- 172.21.15.86:0/2648149415 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f1b60068380 0x7f1b6006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:37.013 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:37.009+0000 7f1b7cff9640 1 -- 172.21.15.86:0/2648149415 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f1b681246e0 con 0x7f1b80155350 2024-04-25T12:22:37.013 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:37.009+0000 7f1b7f7fe640 1 --2- 172.21.15.86:0/2648149415 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f1b60068380 0x7f1b6006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:37.013 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:37.009+0000 7f1b7f7fe640 1 --2- 172.21.15.86:0/2648149415 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f1b60068380 0x7f1b6006a840 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1b700016f0 tx=0x7f1b70009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:37.015 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:37.013+0000 7f1b7cff9640 1 -- 172.21.15.86:0/2648149415 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1b680188b0 con 0x7f1b80155350 2024-04-25T12:22:37.167 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:37.165+0000 7f1b86161640 1 -- 172.21.15.86:0/2648149415 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1b800cc610 con 0x7f1b80155350 2024-04-25T12:22:37.169 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:37.165+0000 7f1b7cff9640 1 -- 172.21.15.86:0/2648149415 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18905 (secure 0 0 0) 0x7f1b680f48a0 con 0x7f1b80155350 2024-04-25T12:22:37.169 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:22:37.170 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":26,"fsid":"f2ef5c0c-9576-4650-b4f7-6cb14247f62a","created":"2024-04-25T12:20:59.241733+0000","modified":"2024-04-25T12:22:04.877793+0000","last_up_change":"2024-04-25T12:21:10.939617+0000","last_in_change":"2024-04-25T12:21:01.534145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T12:21:11.839922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T12:21:21.854040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T12:21:22.406060+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T12:21:26.152386+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1f713f00-ef9f-4a6f-a620-38a8a1f8a822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6801","nonce":2812764579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6803","nonce":2812764579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6807","nonce":2812764579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6805","nonce":2812764579}]},"public_addr":"172.21.15.86:6801/2812764579","cluster_addr":"172.21.15.86:6803/2812764579","heartbeat_back_addr":"172.21.15.86:6807/2812764579","heartbeat_front_addr":"172.21.15.86:6805/2812764579","state":["exists","up"]},{"osd":1,"uuid":"baf6606d-a556-4fbe-a930-855e04ff1534","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6809","nonce":467966038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6811","nonce":467966038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6815","nonce":467966038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6813","nonce":467966038}]},"public_addr":"172.21.15.86:6809/467966038","cluster_addr":"172.21.15.86:6811/467966038","heartbeat_back_addr":"172.21.15.86:6815/467966038","heartbeat_front_addr":"172.21.15.86:6813/467966038","state":["exists","up"]},{"osd":2,"uuid":"c983d68e-6d60-434f-aed6-108420c5dd09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6817","nonce":3279762843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6820","nonce":3279762843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6825","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6827","nonce":3279762843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6824","nonce":3279762843}]},"public_addr":"172.21.15.86:6817/3279762843","cluster_addr":"172.21.15.86:6820/3279762843","heartbeat_back_addr":"172.21.15.86:6827/3279762843","heartbeat_front_addr":"172.21.15.86:6824/3279762843","state":["exists","up"]},{"osd":3,"uuid":"e77657bb-45aa-43bf-ab41-c7377eb495ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6821","nonce":2861354413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6826","nonce":2861354413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6831","nonce":2861354413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6829","nonce":2861354413}]},"public_addr":"172.21.15.86:6821/2861354413","cluster_addr":"172.21.15.86:6826/2861354413","heartbeat_back_addr":"172.21.15.86:6831/2861354413","heartbeat_front_addr":"172.21.15.86:6829/2861354413","state":["exists","up"]},{"osd":4,"uuid":"252bd300-d75a-4b00-be4b-27e6b51de4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6802","nonce":1872913602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6805","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6808","nonce":1872913602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6815","nonce":1872913602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6813","nonce":1872913602}]},"public_addr":"172.21.15.134:6802/1872913602","cluster_addr":"172.21.15.134:6808/1872913602","heartbeat_back_addr":"172.21.15.134:6815/1872913602","heartbeat_front_addr":"172.21.15.134:6813/1872913602","state":["exists","up"]},{"osd":5,"uuid":"4135da3f-7427-4409-a48e-78bd8a7b46ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6801","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6803","nonce":2261413981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6806","nonce":2261413981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6812","nonce":2261413981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6809","nonce":2261413981}]},"public_addr":"172.21.15.134:6803/2261413981","cluster_addr":"172.21.15.134:6806/2261413981","heartbeat_back_addr":"172.21.15.134:6812/2261413981","heartbeat_front_addr":"172.21.15.134:6809/2261413981","state":["exists","up"]},{"osd":6,"uuid":"b6e7a5f1-fa7e-497d-abac-a19994d26820","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6825","nonce":2841082767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6827","nonce":2841082767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6831","nonce":2841082767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6829","nonce":2841082767}]},"public_addr":"172.21.15.134:6825/2841082767","cluster_addr":"172.21.15.134:6827/2841082767","heartbeat_back_addr":"172.21.15.134:6831/2841082767","heartbeat_front_addr":"172.21.15.134:6829/2841082767","state":["exists","up"]},{"osd":7,"uuid":"c5597e50-1962-4103-9124-dd7bceb8ac97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6817","nonce":1277404274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6819","nonce":1277404274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6823","nonce":1277404274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6821","nonce":1277404274}]},"public_addr":"172.21.15.134:6817/1277404274","cluster_addr":"172.21.15.134:6819/1277404274","heartbeat_back_addr":"172.21.15.134:6823/1277404274","heartbeat_front_addr":"172.21.15.134:6821/1277404274","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.018125+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.157958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.113619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.136904+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.844514+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.872629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.775339+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.822867+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":7,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.33","mappings":[{"from":3,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T12:22:37.172 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:37.169+0000 7f1b86161640 1 -- 172.21.15.86:0/2648149415 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f1b60068380 msgr2=0x7f1b6006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:37.172 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:37.169+0000 7f1b86161640 1 --2- 172.21.15.86:0/2648149415 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f1b60068380 0x7f1b6006a840 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1b700016f0 tx=0x7f1b70009040 comp rx=0 tx=0).stop 2024-04-25T12:22:37.172 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:37.169+0000 7f1b86161640 1 -- 172.21.15.86:0/2648149415 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b80155350 msgr2=0x7f1b80149ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:37.172 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:37.169+0000 7f1b86161640 1 --2- 172.21.15.86:0/2648149415 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b80155350 0x7f1b80149ff0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1b6801d400 tx=0x7f1b6801baf0 comp rx=0 tx=0).stop 2024-04-25T12:22:37.172 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:37.169+0000 7f1b86161640 1 -- 172.21.15.86:0/2648149415 shutdown_connections 2024-04-25T12:22:37.172 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:37.169+0000 7f1b86161640 1 --2- 172.21.15.86:0/2648149415 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b8015b0b0 0x7f1b8014a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:37.172 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:37.169+0000 7f1b86161640 1 --2- 172.21.15.86:0/2648149415 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f1b60068380 0x7f1b6006a840 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:37.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:37.169+0000 7f1b86161640 1 --2- 172.21.15.86:0/2648149415 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b80155350 0x7f1b80149ff0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:37.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:37.169+0000 7f1b86161640 1 --2- 172.21.15.86:0/2648149415 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1b800cda50 0x7f1b80142d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:37.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:37.169+0000 7f1b86161640 1 -- 172.21.15.86:0/2648149415 >> 172.21.15.86:0/2648149415 conn(0x7f1b8006cc30 msgr2=0x7f1b800cba90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:37.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:37.169+0000 7f1b86161640 1 -- 172.21.15.86:0/2648149415 shutdown_connections 2024-04-25T12:22:37.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:37.169+0000 7f1b86161640 1 -- 172.21.15.86:0/2648149415 wait complete. 2024-04-25T12:22:38.188 INFO:tasks.ceph:Scrubbing osd.0 2024-04-25T12:22:38.189 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-25T12:22:38.324 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.321+0000 7f924c427640 1 Processor -- start 2024-04-25T12:22:38.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.321+0000 7f924c427640 1 -- start start 2024-04-25T12:22:38.326 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.321+0000 7f924c427640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f92440c6380 0x7f9244152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:38.326 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.321+0000 7f924c427640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f92440c73a0 0x7f9244153230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:38.327 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.321+0000 7f924c427640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f924406ce60 con 0x7f92440c5fa0 2024-04-25T12:22:38.327 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.321+0000 7f924c427640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f9244153770 con 0x7f92440c6380 2024-04-25T12:22:38.327 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.321+0000 7f924c427640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f92440c8890 con 0x7f92440c73a0 2024-04-25T12:22:38.327 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.321+0000 7f92499c2640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f92440c6380 0x7f9244152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:38.327 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.321+0000 7f924a1c3640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f92440c5fa0 0x7f924415ce00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:42098/0 (socket says 172.21.15.86:42098) 2024-04-25T12:22:38.327 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.321+0000 7f924a1c3640 1 -- 172.21.15.86:0/994463719 learned_addr learned my addr 172.21.15.86:0/994463719 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-04-25T12:22:38.327 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.321+0000 7f924a9c4640 1 --2- 172.21.15.86:0/994463719 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f92440c73a0 0x7f9244153230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:38.327 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.321+0000 7f92499c2640 1 -- 172.21.15.86:0/994463719 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f92440c73a0 msgr2=0x7f9244153230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:38.327 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.321+0000 7f92499c2640 1 --2- 172.21.15.86:0/994463719 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f92440c73a0 0x7f9244153230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:38.328 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.321+0000 7f92499c2640 1 -- 172.21.15.86:0/994463719 >> v1:172.21.15.86:6789/0 conn(0x7f92440c5fa0 legacy=0x7f924415ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:38.328 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.321+0000 7f92491c1640 1 -- 172.21.15.86:0/994463719 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1259921490 0 0) 0x7f924406ce60 con 0x7f92440c5fa0 2024-04-25T12:22:38.328 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.321+0000 7f92499c2640 1 -- 172.21.15.86:0/994463719 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92440c8ae0 con 0x7f92440c6380 2024-04-25T12:22:38.329 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.325+0000 7f92499c2640 1 --2- 172.21.15.86:0/994463719 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f92440c6380 0x7f9244152cf0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f92340097c0 tx=0x7f923401c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=815ab9ded158e60b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:38.329 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.325+0000 7f92491c1640 1 -- 172.21.15.86:0/994463719 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92340b0070 con 0x7f92440c6380 2024-04-25T12:22:38.329 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.325+0000 7f92491c1640 1 -- 172.21.15.86:0/994463719 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92340ab600 con 0x7f92440c6380 2024-04-25T12:22:38.330 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.325+0000 7f92491c1640 1 -- 172.21.15.86:0/994463719 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92340ab9d0 con 0x7f92440c6380 2024-04-25T12:22:38.330 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.325+0000 7f924c427640 1 -- 172.21.15.86:0/994463719 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f92440c6380 msgr2=0x7f9244152cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:38.330 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.325+0000 7f924c427640 1 --2- 172.21.15.86:0/994463719 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f92440c6380 0x7f9244152cf0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f92340097c0 tx=0x7f923401c380 comp rx=0 tx=0).stop 2024-04-25T12:22:38.330 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.325+0000 7f924c427640 1 -- 172.21.15.86:0/994463719 shutdown_connections 2024-04-25T12:22:38.330 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.325+0000 7f924c427640 1 --2- 172.21.15.86:0/994463719 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f92440c73a0 0x7f9244153230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:38.330 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.325+0000 7f924c427640 1 --2- 172.21.15.86:0/994463719 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f92440c6380 0x7f9244152cf0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:38.330 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.325+0000 7f924c427640 1 -- 172.21.15.86:0/994463719 >> 172.21.15.86:0/994463719 conn(0x7f92440c9130 msgr2=0x7f92440c9540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:38.330 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.325+0000 7f924c427640 1 -- 172.21.15.86:0/994463719 shutdown_connections 2024-04-25T12:22:38.331 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.325+0000 7f924c427640 1 -- 172.21.15.86:0/994463719 wait complete. 2024-04-25T12:22:38.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.325+0000 7f924c427640 1 Processor -- start 2024-04-25T12:22:38.333 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.325+0000 7f924c427640 1 -- start start 2024-04-25T12:22:38.333 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.329+0000 7f924c427640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92440c5fa0 0x7f92441f5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:38.333 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.329+0000 7f924c427640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f92440c6380 0x7f92441eaec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:38.333 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.329+0000 7f924c427640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f92440c73a0 0x7f9244148e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:38.333 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.329+0000 7f924c427640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f924406ca90 con 0x7f92440c73a0 2024-04-25T12:22:38.333 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.329+0000 7f924c427640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9244159010 con 0x7f92440c5fa0 2024-04-25T12:22:38.333 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.329+0000 7f924c427640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f924406cc10 con 0x7f92440c6380 2024-04-25T12:22:38.333 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.329+0000 7f924a9c4640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f92440c73a0 0x7f9244148e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:38.333 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.329+0000 7f924a9c4640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f92440c73a0 0x7f9244148e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37574/0 (socket says 172.21.15.86:37574) 2024-04-25T12:22:38.334 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.329+0000 7f924a9c4640 1 -- 172.21.15.86:0/2636662126 learned_addr learned my addr 172.21.15.86:0/2636662126 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:38.334 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.329+0000 7f92499c2640 1 --2- 172.21.15.86:0/2636662126 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f92440c6380 0x7f92441eaec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:38.334 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.329+0000 7f924a9c4640 1 -- 172.21.15.86:0/2636662126 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f92440c6380 msgr2=0x7f92441eaec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:38.334 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.329+0000 7f924a9c4640 1 --2- 172.21.15.86:0/2636662126 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f92440c6380 0x7f92441eaec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:38.334 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.329+0000 7f924a9c4640 1 -- 172.21.15.86:0/2636662126 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92440c5fa0 msgr2=0x7f92441f5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:38.334 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.329+0000 7f924a9c4640 1 --2- 172.21.15.86:0/2636662126 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92440c5fa0 0x7f92441f5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:38.334 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.329+0000 7f924a9c4640 1 -- 172.21.15.86:0/2636662126 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92441f5c70 con 0x7f92440c73a0 2024-04-25T12:22:38.334 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.329+0000 7f924a9c4640 1 --2- 172.21.15.86:0/2636662126 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f92440c73a0 0x7f9244148e00 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f923c00d800 tx=0x7f923c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:38.335 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.329+0000 7f923affd640 1 -- 172.21.15.86:0/2636662126 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f923c00b6c0 con 0x7f92440c73a0 2024-04-25T12:22:38.335 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.329+0000 7f923affd640 1 -- 172.21.15.86:0/2636662126 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f923c019070 con 0x7f92440c73a0 2024-04-25T12:22:38.335 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.329+0000 7f924c427640 1 -- 172.21.15.86:0/2636662126 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9244074070 con 0x7f92440c73a0 2024-04-25T12:22:38.335 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.329+0000 7f923affd640 1 -- 172.21.15.86:0/2636662126 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f923c00baa0 con 0x7f92440c73a0 2024-04-25T12:22:38.335 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.329+0000 7f924c427640 1 -- 172.21.15.86:0/2636662126 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f924415c150 con 0x7f92440c73a0 2024-04-25T12:22:38.335 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.329+0000 7f924c427640 1 -- 172.21.15.86:0/2636662126 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9244075e60 con 0x7f92440c73a0 2024-04-25T12:22:38.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.329+0000 7f923affd640 1 -- 172.21.15.86:0/2636662126 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f923c00bc40 con 0x7f92440c73a0 2024-04-25T12:22:38.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.329+0000 7f923affd640 1 --2- 172.21.15.86:0/2636662126 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f9228068380 0x7f922806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:38.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.329+0000 7f923affd640 1 -- 172.21.15.86:0/2636662126 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f923c087c60 con 0x7f92440c73a0 2024-04-25T12:22:38.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.329+0000 7f924a1c3640 1 --2- 172.21.15.86:0/2636662126 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f9228068380 0x7f922806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:38.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.329+0000 7f923affd640 1 --2- 172.21.15.86:0/2636662126 >> [v2:172.21.15.86:6800/2812764579,v1:172.21.15.86:6801/2812764579] conn(0x7f9228071d90 0x7f9228074230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:38.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.329+0000 7f923affd640 1 -- 172.21.15.86:0/2636662126 --> [v2:172.21.15.86:6800/2812764579,v1:172.21.15.86:6801/2812764579] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f923c001d40 con 0x7f9228071d90 2024-04-25T12:22:38.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.329+0000 7f923affd640 1 -- 172.21.15.86:0/2636662126 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f923c0880f0 con 0x7f92440c73a0 2024-04-25T12:22:38.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.329+0000 7f92499c2640 1 --2- 172.21.15.86:0/2636662126 >> [v2:172.21.15.86:6800/2812764579,v1:172.21.15.86:6801/2812764579] conn(0x7f9228071d90 0x7f9228074230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:38.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.329+0000 7f924a1c3640 1 --2- 172.21.15.86:0/2636662126 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f9228068380 0x7f922806a840 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9240001ca0 tx=0x7f9240007cf0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:38.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.329+0000 7f92499c2640 1 --2- 172.21.15.86:0/2636662126 >> [v2:172.21.15.86:6800/2812764579,v1:172.21.15.86:6801/2812764579] conn(0x7f9228071d90 0x7f9228074230 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:38.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.333+0000 7f923affd640 1 -- 172.21.15.86:0/2636662126 <== osd.0 v2:172.21.15.86:6800/2812764579 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f923c001d40 con 0x7f9228071d90 2024-04-25T12:22:38.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.345+0000 7f924c427640 1 -- 172.21.15.86:0/2636662126 --> [v2:172.21.15.86:6800/2812764579,v1:172.21.15.86:6801/2812764579] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f924415cea0 con 0x7f9228071d90 2024-04-25T12:22:38.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.345+0000 7f923affd640 1 -- 172.21.15.86:0/2636662126 <== osd.0 v2:172.21.15.86:6800/2812764579 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f924415cea0 con 0x7f9228071d90 2024-04-25T12:22:38.349 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-25T12:22:38.349 INFO:teuthology.orchestra.run.smithi086.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T12:22:38.350 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-25T12:22:38.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.345+0000 7f924c427640 1 -- 172.21.15.86:0/2636662126 >> [v2:172.21.15.86:6800/2812764579,v1:172.21.15.86:6801/2812764579] conn(0x7f9228071d90 msgr2=0x7f9228074230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:38.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.345+0000 7f924c427640 1 --2- 172.21.15.86:0/2636662126 >> [v2:172.21.15.86:6800/2812764579,v1:172.21.15.86:6801/2812764579] conn(0x7f9228071d90 0x7f9228074230 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:38.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.345+0000 7f924c427640 1 -- 172.21.15.86:0/2636662126 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f9228068380 msgr2=0x7f922806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:38.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.345+0000 7f924c427640 1 --2- 172.21.15.86:0/2636662126 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f9228068380 0x7f922806a840 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9240001ca0 tx=0x7f9240007cf0 comp rx=0 tx=0).stop 2024-04-25T12:22:38.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.345+0000 7f924c427640 1 -- 172.21.15.86:0/2636662126 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f92440c73a0 msgr2=0x7f9244148e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:38.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.345+0000 7f924c427640 1 --2- 172.21.15.86:0/2636662126 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f92440c73a0 0x7f9244148e00 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f923c00d800 tx=0x7f923c00dcc0 comp rx=0 tx=0).stop 2024-04-25T12:22:38.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.345+0000 7f924a9c4640 1 -- 172.21.15.86:0/2636662126 reap_dead start 2024-04-25T12:22:38.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.345+0000 7f924c427640 1 -- 172.21.15.86:0/2636662126 shutdown_connections 2024-04-25T12:22:38.352 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.345+0000 7f924c427640 1 -- 172.21.15.86:0/2636662126 >> 172.21.15.86:0/2636662126 conn(0x7f92440c9130 msgr2=0x7f924406e630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:38.352 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.345+0000 7f924c427640 1 -- 172.21.15.86:0/2636662126 shutdown_connections 2024-04-25T12:22:38.352 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.345+0000 7f924c427640 1 -- 172.21.15.86:0/2636662126 wait complete. 2024-04-25T12:22:38.365 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-25T12:22:38.480 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.477+0000 7f78fb7e9640 1 Processor -- start 2024-04-25T12:22:38.480 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.477+0000 7f78fb7e9640 1 -- start start 2024-04-25T12:22:38.481 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.477+0000 7f78fb7e9640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f78f406da80 0x7f78f406de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:38.481 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.477+0000 7f78fb7e9640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f78f406e8e0 0x7f78f4165980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:38.481 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.477+0000 7f78fb7e9640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78f40c2740 con 0x7f78f40c33b0 2024-04-25T12:22:38.482 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.477+0000 7f78fb7e9640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f78f415bb70 con 0x7f78f406e8e0 2024-04-25T12:22:38.482 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.477+0000 7f78fb7e9640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f78f4067c00 con 0x7f78f406da80 2024-04-25T12:22:38.482 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.477+0000 7f78f9d86640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f78f406e8e0 0x7f78f4165980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:38.482 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.477+0000 7f78f8d84640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f78f40c33b0 0x7f78f40c7970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:42100/0 (socket says 172.21.15.86:42100) 2024-04-25T12:22:38.482 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.477+0000 7f78f8d84640 1 -- 172.21.15.86:0/2433835131 learned_addr learned my addr 172.21.15.86:0/2433835131 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-04-25T12:22:38.482 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.477+0000 7f78f9585640 1 --2- 172.21.15.86:0/2433835131 >> v2:172.21.15.134:3300/0 conn(0x7f78f406da80 0x7f78f406de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:38.482 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.477+0000 7f78f9d86640 1 -- 172.21.15.86:0/2433835131 >> v2:172.21.15.134:3300/0 conn(0x7f78f406da80 msgr2=0x7f78f406de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:38.482 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.477+0000 7f78f9d86640 1 --2- 172.21.15.86:0/2433835131 >> v2:172.21.15.134:3300/0 conn(0x7f78f406da80 0x7f78f406de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:38.483 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.477+0000 7f78f9d86640 1 -- 172.21.15.86:0/2433835131 >> v1:172.21.15.86:6789/0 conn(0x7f78f40c33b0 legacy=0x7f78f40c7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:38.483 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.477+0000 7f78f9d86640 1 -- 172.21.15.86:0/2433835131 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78f40676a0 con 0x7f78f406e8e0 2024-04-25T12:22:38.483 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.477+0000 7f78f3fff640 1 -- 172.21.15.86:0/2433835131 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1875582024 0 0) 0x7f78e8001120 con 0x7f78f40c33b0 2024-04-25T12:22:38.483 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.481+0000 7f78f9d86640 1 --2- 172.21.15.86:0/2433835131 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78f406e8e0 0x7f78f4165980 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f78f406cc20 tx=0x7f78ec01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=723e4483e3111796 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:38.484 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.481+0000 7f78f3fff640 1 -- 172.21.15.86:0/2433835131 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78ec0b5070 con 0x7f78f406e8e0 2024-04-25T12:22:38.484 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.481+0000 7f78f3fff640 1 -- 172.21.15.86:0/2433835131 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78ec0a8970 con 0x7f78f406e8e0 2024-04-25T12:22:38.484 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.481+0000 7f78f3fff640 1 -- 172.21.15.86:0/2433835131 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78ec0a8d40 con 0x7f78f406e8e0 2024-04-25T12:22:38.485 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.481+0000 7f78fb7e9640 1 -- 172.21.15.86:0/2433835131 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78f406e8e0 msgr2=0x7f78f4165980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:38.485 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.481+0000 7f78fb7e9640 1 --2- 172.21.15.86:0/2433835131 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78f406e8e0 0x7f78f4165980 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f78f406cc20 tx=0x7f78ec01ec70 comp rx=0 tx=0).stop 2024-04-25T12:22:38.485 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.481+0000 7f78fb7e9640 1 -- 172.21.15.86:0/2433835131 shutdown_connections 2024-04-25T12:22:38.485 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.481+0000 7f78fb7e9640 1 --2- 172.21.15.86:0/2433835131 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78f406e8e0 0x7f78f4165980 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:38.485 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.481+0000 7f78fb7e9640 1 --2- 172.21.15.86:0/2433835131 >> v2:172.21.15.134:3300/0 conn(0x7f78f406da80 0x7f78f406de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:38.485 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.481+0000 7f78fb7e9640 1 -- 172.21.15.86:0/2433835131 >> 172.21.15.86:0/2433835131 conn(0x7f78f40c9a70 msgr2=0x7f78f40c9e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:38.486 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.481+0000 7f78fb7e9640 1 -- 172.21.15.86:0/2433835131 shutdown_connections 2024-04-25T12:22:38.486 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.481+0000 7f78fb7e9640 1 -- 172.21.15.86:0/2433835131 wait complete. 2024-04-25T12:22:38.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.481+0000 7f78fb7e9640 1 Processor -- start 2024-04-25T12:22:38.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.481+0000 7f78fb7e9640 1 -- start start 2024-04-25T12:22:38.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.481+0000 7f78fb7e9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78f406da80 0x7f78f40b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:38.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.481+0000 7f78fb7e9640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f78f406e8e0 0x7f78f40b2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:38.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.481+0000 7f78fb7e9640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78f40c33b0 0x7f78f4150200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:38.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.481+0000 7f78fb7e9640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f78f415c000 con 0x7f78f40c33b0 2024-04-25T12:22:38.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.481+0000 7f78fb7e9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f78f415b280 con 0x7f78f406da80 2024-04-25T12:22:38.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.481+0000 7f78fb7e9640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f78f415b520 con 0x7f78f406e8e0 2024-04-25T12:22:38.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.481+0000 7f78f9d86640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78f40c33b0 0x7f78f4150200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:38.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.481+0000 7f78f9d86640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78f40c33b0 0x7f78f4150200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37590/0 (socket says 172.21.15.86:37590) 2024-04-25T12:22:38.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.481+0000 7f78f9d86640 1 -- 172.21.15.86:0/3378291006 learned_addr learned my addr 172.21.15.86:0/3378291006 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:38.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.481+0000 7f78f8d84640 1 --2- 172.21.15.86:0/3378291006 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f78f406e8e0 0x7f78f40b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:38.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.481+0000 7f78f9585640 1 --2- 172.21.15.86:0/3378291006 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78f406da80 0x7f78f40b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:38.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.481+0000 7f78f9d86640 1 -- 172.21.15.86:0/3378291006 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f78f406e8e0 msgr2=0x7f78f40b2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:38.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.481+0000 7f78f9d86640 1 --2- 172.21.15.86:0/3378291006 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f78f406e8e0 0x7f78f40b2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:38.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.481+0000 7f78f9d86640 1 -- 172.21.15.86:0/3378291006 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78f406da80 msgr2=0x7f78f40b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:38.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.481+0000 7f78f9d86640 1 --2- 172.21.15.86:0/3378291006 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78f406da80 0x7f78f40b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:38.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.481+0000 7f78f9d86640 1 -- 172.21.15.86:0/3378291006 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78f415cb40 con 0x7f78f40c33b0 2024-04-25T12:22:38.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.481+0000 7f78f9585640 1 --2- 172.21.15.86:0/3378291006 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78f406da80 0x7f78f40b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:22:38.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.485+0000 7f78f9d86640 1 --2- 172.21.15.86:0/3378291006 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78f40c33b0 0x7f78f4150200 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f78ec0b3040 tx=0x7f78ec01d4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:38.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.485+0000 7f78f1ffb640 1 -- 172.21.15.86:0/3378291006 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78ec0c1070 con 0x7f78f40c33b0 2024-04-25T12:22:38.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.485+0000 7f78f1ffb640 1 -- 172.21.15.86:0/3378291006 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78ec0b6040 con 0x7f78f40c33b0 2024-04-25T12:22:38.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.485+0000 7f78fb7e9640 1 -- 172.21.15.86:0/3378291006 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78f4152370 con 0x7f78f40c33b0 2024-04-25T12:22:38.491 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.485+0000 7f78f1ffb640 1 -- 172.21.15.86:0/3378291006 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78ec0b5050 con 0x7f78f40c33b0 2024-04-25T12:22:38.491 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.485+0000 7f78fb7e9640 1 -- 172.21.15.86:0/3378291006 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78f414fa00 con 0x7f78f40c33b0 2024-04-25T12:22:38.491 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.485+0000 7f78fb7e9640 1 -- 172.21.15.86:0/3378291006 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78f4075df0 con 0x7f78f40c33b0 2024-04-25T12:22:38.492 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.485+0000 7f78f1ffb640 1 -- 172.21.15.86:0/3378291006 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f78ec0c4070 con 0x7f78f40c33b0 2024-04-25T12:22:38.492 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.485+0000 7f78f1ffb640 1 --2- 172.21.15.86:0/3378291006 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f78e0068380 0x7f78e006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:38.492 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.485+0000 7f78f1ffb640 1 -- 172.21.15.86:0/3378291006 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f78ec124170 con 0x7f78f40c33b0 2024-04-25T12:22:38.492 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.485+0000 7f78f9585640 1 --2- 172.21.15.86:0/3378291006 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f78e0068380 0x7f78e006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:38.492 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.485+0000 7f78f9585640 1 --2- 172.21.15.86:0/3378291006 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f78e0068380 0x7f78e006a840 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f78e4009f50 tx=0x7f78e400b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:38.493 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.489+0000 7f78f1ffb640 1 -- 172.21.15.86:0/3378291006 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f78ec0187d0 con 0x7f78f40c33b0 2024-04-25T12:22:38.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.637+0000 7f78fb7e9640 1 -- 172.21.15.86:0/3378291006 --> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f78f406e6c0 con 0x7f78e0068380 2024-04-25T12:22:38.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.637+0000 7f78f1ffb640 1 -- 172.21.15.86:0/3378291006 <== mgr.4107 v2:172.21.15.86:6832/3708662606 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f78f406e6c0 con 0x7f78e0068380 2024-04-25T12:22:38.642 INFO:teuthology.orchestra.run.smithi086.stderr:instructed osd(s) 0 to deep-scrub 2024-04-25T12:22:38.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.641+0000 7f78fb7e9640 1 -- 172.21.15.86:0/3378291006 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f78e0068380 msgr2=0x7f78e006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:38.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.641+0000 7f78fb7e9640 1 --2- 172.21.15.86:0/3378291006 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f78e0068380 0x7f78e006a840 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f78e4009f50 tx=0x7f78e400b040 comp rx=0 tx=0).stop 2024-04-25T12:22:38.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.641+0000 7f78fb7e9640 1 -- 172.21.15.86:0/3378291006 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78f40c33b0 msgr2=0x7f78f4150200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:38.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.641+0000 7f78fb7e9640 1 --2- 172.21.15.86:0/3378291006 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78f40c33b0 0x7f78f4150200 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f78ec0b3040 tx=0x7f78ec01d4b0 comp rx=0 tx=0).stop 2024-04-25T12:22:38.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.641+0000 7f78fb7e9640 1 -- 172.21.15.86:0/3378291006 shutdown_connections 2024-04-25T12:22:38.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.641+0000 7f78fb7e9640 1 --2- 172.21.15.86:0/3378291006 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f78e0068380 0x7f78e006a840 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:38.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.641+0000 7f78fb7e9640 1 --2- 172.21.15.86:0/3378291006 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78f40c33b0 0x7f78f4150200 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:38.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.641+0000 7f78fb7e9640 1 --2- 172.21.15.86:0/3378291006 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f78f406e8e0 0x7f78f40b2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:38.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.641+0000 7f78fb7e9640 1 --2- 172.21.15.86:0/3378291006 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78f406da80 0x7f78f40b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:38.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.641+0000 7f78fb7e9640 1 -- 172.21.15.86:0/3378291006 >> 172.21.15.86:0/3378291006 conn(0x7f78f40c9a70 msgr2=0x7f78f40c2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:38.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.641+0000 7f78fb7e9640 1 -- 172.21.15.86:0/3378291006 shutdown_connections 2024-04-25T12:22:38.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.641+0000 7f78fb7e9640 1 -- 172.21.15.86:0/3378291006 wait complete. 2024-04-25T12:22:38.660 INFO:tasks.ceph:Scrubbing osd.1 2024-04-25T12:22:38.660 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-25T12:22:38.772 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.769+0000 7f5dcd87c640 1 Processor -- start 2024-04-25T12:22:38.772 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.769+0000 7f5dcd87c640 1 -- start start 2024-04-25T12:22:38.773 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.769+0000 7f5dcd87c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f5dc8155350 0x7f5dc80cc370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:38.773 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.769+0000 7f5dcd87c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5dc80cc950 0x7f5dc80cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:38.774 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.769+0000 7f5dcd87c640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5dc80cceb0 0x7f5dc80cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:38.774 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.769+0000 7f5dcd87c640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f5dc8155730 con 0x7f5dc80cceb0 2024-04-25T12:22:38.774 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.769+0000 7f5dcd87c640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f5dc815e670 con 0x7f5dc8155350 2024-04-25T12:22:38.774 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.769+0000 7f5dcd87c640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f5dc815e950 con 0x7f5dc80cc950 2024-04-25T12:22:38.774 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.769+0000 7f5dc77fe640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5dc80cceb0 0x7f5dc80cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:38.774 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.769+0000 7f5dc77fe640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5dc80cceb0 0x7f5dc80cbae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37606/0 (socket says 172.21.15.86:37606) 2024-04-25T12:22:38.774 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.769+0000 7f5dc77fe640 1 -- 172.21.15.86:0/2483563357 learned_addr learned my addr 172.21.15.86:0/2483563357 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:38.774 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.769+0000 7f5dc67fc640 1 --2- 172.21.15.86:0/2483563357 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5dc80cc950 0x7f5dc80cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:38.775 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.769+0000 7f5dc6ffd640 1 --2- 172.21.15.86:0/2483563357 >> v2:172.21.15.134:3300/0 conn(0x7f5dc8155350 0x7f5dc80cc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:38.775 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.769+0000 7f5dc77fe640 1 -- 172.21.15.86:0/2483563357 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5dc80cc950 msgr2=0x7f5dc80cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:38.775 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.769+0000 7f5dc77fe640 1 --2- 172.21.15.86:0/2483563357 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5dc80cc950 0x7f5dc80cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:38.775 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.769+0000 7f5dc77fe640 1 -- 172.21.15.86:0/2483563357 >> v2:172.21.15.134:3300/0 conn(0x7f5dc8155350 msgr2=0x7f5dc80cc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:38.775 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.769+0000 7f5dc77fe640 1 --2- 172.21.15.86:0/2483563357 >> v2:172.21.15.134:3300/0 conn(0x7f5dc8155350 0x7f5dc80cc370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:38.775 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.769+0000 7f5dc77fe640 1 -- 172.21.15.86:0/2483563357 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dc815ec30 con 0x7f5dc80cceb0 2024-04-25T12:22:38.776 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.773+0000 7f5dc77fe640 1 --2- 172.21.15.86:0/2483563357 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5dc80cceb0 0x7f5dc80cbae0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f5dc806e520 tx=0x7f5dc001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23d193bb192e0d18 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:38.776 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.773+0000 7f5dc5ffb640 1 -- 172.21.15.86:0/2483563357 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc00ab5f0 con 0x7f5dc80cceb0 2024-04-25T12:22:38.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.773+0000 7f5dc5ffb640 1 -- 172.21.15.86:0/2483563357 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dc00b0070 con 0x7f5dc80cceb0 2024-04-25T12:22:38.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.773+0000 7f5dc5ffb640 1 -- 172.21.15.86:0/2483563357 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc00ab9b0 con 0x7f5dc80cceb0 2024-04-25T12:22:38.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.773+0000 7f5dcd87c640 1 -- 172.21.15.86:0/2483563357 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5dc80cceb0 msgr2=0x7f5dc80cbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:38.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.773+0000 7f5dcd87c640 1 --2- 172.21.15.86:0/2483563357 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5dc80cceb0 0x7f5dc80cbae0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f5dc806e520 tx=0x7f5dc001c520 comp rx=0 tx=0).stop 2024-04-25T12:22:38.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.773+0000 7f5dcd87c640 1 -- 172.21.15.86:0/2483563357 shutdown_connections 2024-04-25T12:22:38.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.773+0000 7f5dcd87c640 1 --2- 172.21.15.86:0/2483563357 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5dc80cceb0 0x7f5dc80cbae0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:38.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.773+0000 7f5dcd87c640 1 --2- 172.21.15.86:0/2483563357 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5dc80cc950 0x7f5dc80cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:38.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.773+0000 7f5dcd87c640 1 --2- 172.21.15.86:0/2483563357 >> v2:172.21.15.134:3300/0 conn(0x7f5dc8155350 0x7f5dc80cc370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:38.778 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.773+0000 7f5dcd87c640 1 -- 172.21.15.86:0/2483563357 >> 172.21.15.86:0/2483563357 conn(0x7f5dc806bf00 msgr2=0x7f5dc8073100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:38.778 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.773+0000 7f5dcd87c640 1 -- 172.21.15.86:0/2483563357 shutdown_connections 2024-04-25T12:22:38.778 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.773+0000 7f5dcd87c640 1 -- 172.21.15.86:0/2483563357 wait complete. 2024-04-25T12:22:38.782 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.773+0000 7f5dcd87c640 1 Processor -- start 2024-04-25T12:22:38.782 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.773+0000 7f5dcd87c640 1 -- start start 2024-04-25T12:22:38.782 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.773+0000 7f5dcd87c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5dc80cc950 0x7f5dc80c6b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:38.782 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.773+0000 7f5dcd87c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5dc80cceb0 0x7f5dc8149190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:38.783 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.773+0000 7f5dcd87c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5dc8155350 0x7f5dc81496d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:38.783 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.773+0000 7f5dcd87c640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f5dc815b390 con 0x7f5dc80cceb0 2024-04-25T12:22:38.783 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.773+0000 7f5dcd87c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5dc815b210 con 0x7f5dc8155350 2024-04-25T12:22:38.783 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.773+0000 7f5dcd87c640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f5dc815b510 con 0x7f5dc80cc950 2024-04-25T12:22:38.783 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.773+0000 7f5dc67fc640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5dc80cceb0 0x7f5dc8149190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:38.783 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.773+0000 7f5dc67fc640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5dc80cceb0 0x7f5dc8149190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37614/0 (socket says 172.21.15.86:37614) 2024-04-25T12:22:38.784 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.773+0000 7f5dc67fc640 1 -- 172.21.15.86:0/2627840304 learned_addr learned my addr 172.21.15.86:0/2627840304 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:38.784 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.773+0000 7f5dc6ffd640 1 --2- 172.21.15.86:0/2627840304 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5dc80cc950 0x7f5dc80c6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:38.784 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.773+0000 7f5dc77fe640 1 --2- 172.21.15.86:0/2627840304 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5dc8155350 0x7f5dc81496d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:38.784 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.773+0000 7f5dc67fc640 1 -- 172.21.15.86:0/2627840304 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5dc80cc950 msgr2=0x7f5dc80c6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:38.785 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.773+0000 7f5dc67fc640 1 --2- 172.21.15.86:0/2627840304 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5dc80cc950 0x7f5dc80c6b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:38.785 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.773+0000 7f5dc67fc640 1 -- 172.21.15.86:0/2627840304 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5dc8155350 msgr2=0x7f5dc81496d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:38.785 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.773+0000 7f5dc67fc640 1 --2- 172.21.15.86:0/2627840304 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5dc8155350 0x7f5dc81496d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:38.785 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.773+0000 7f5dc67fc640 1 -- 172.21.15.86:0/2627840304 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dc8147b60 con 0x7f5dc80cceb0 2024-04-25T12:22:38.786 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.773+0000 7f5dc67fc640 1 --2- 172.21.15.86:0/2627840304 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5dc80cceb0 0x7f5dc8149190 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f5db000d830 tx=0x7f5db000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:38.786 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.773+0000 7f5dbffff640 1 -- 172.21.15.86:0/2627840304 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db0018020 con 0x7f5dc80cceb0 2024-04-25T12:22:38.786 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.773+0000 7f5dbffff640 1 -- 172.21.15.86:0/2627840304 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5db00096c0 con 0x7f5dc80cceb0 2024-04-25T12:22:38.786 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.773+0000 7f5dcd87c640 1 -- 172.21.15.86:0/2627840304 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dc8147e40 con 0x7f5dc80cceb0 2024-04-25T12:22:38.787 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.773+0000 7f5dbffff640 1 -- 172.21.15.86:0/2627840304 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db0009ab0 con 0x7f5dc80cceb0 2024-04-25T12:22:38.787 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.773+0000 7f5dcd87c640 1 -- 172.21.15.86:0/2627840304 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dc8148400 con 0x7f5dc80cceb0 2024-04-25T12:22:38.787 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.777+0000 7f5dcd87c640 1 -- 172.21.15.86:0/2627840304 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5dc8075e60 con 0x7f5dc80cceb0 2024-04-25T12:22:38.787 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.777+0000 7f5dbffff640 1 -- 172.21.15.86:0/2627840304 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5db001b020 con 0x7f5dc80cceb0 2024-04-25T12:22:38.787 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.777+0000 7f5dbffff640 1 --2- 172.21.15.86:0/2627840304 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f5da8068380 0x7f5da806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:38.788 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.777+0000 7f5dbffff640 1 -- 172.21.15.86:0/2627840304 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f5db0087af0 con 0x7f5dc80cceb0 2024-04-25T12:22:38.788 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.777+0000 7f5dc6ffd640 1 --2- 172.21.15.86:0/2627840304 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f5da8068380 0x7f5da806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:38.788 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.777+0000 7f5dbffff640 1 --2- 172.21.15.86:0/2627840304 >> [v2:172.21.15.86:6808/467966038,v1:172.21.15.86:6809/467966038] conn(0x7f5da8071d90 0x7f5da8074230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:38.788 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.777+0000 7f5dbffff640 1 -- 172.21.15.86:0/2627840304 --> [v2:172.21.15.86:6808/467966038,v1:172.21.15.86:6809/467966038] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5db000af30 con 0x7f5da8071d90 2024-04-25T12:22:38.788 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.777+0000 7f5dbffff640 1 -- 172.21.15.86:0/2627840304 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f5db0087f80 con 0x7f5dc80cceb0 2024-04-25T12:22:38.789 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.777+0000 7f5dc77fe640 1 --2- 172.21.15.86:0/2627840304 >> [v2:172.21.15.86:6808/467966038,v1:172.21.15.86:6809/467966038] conn(0x7f5da8071d90 0x7f5da8074230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:38.789 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.777+0000 7f5dc6ffd640 1 --2- 172.21.15.86:0/2627840304 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f5da8068380 0x7f5da806a840 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5db80070b0 tx=0x7f5db8007040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:38.789 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.777+0000 7f5dc77fe640 1 --2- 172.21.15.86:0/2627840304 >> [v2:172.21.15.86:6808/467966038,v1:172.21.15.86:6809/467966038] conn(0x7f5da8071d90 0x7f5da8074230 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:38.789 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.777+0000 7f5dbffff640 1 -- 172.21.15.86:0/2627840304 <== osd.1 v2:172.21.15.86:6808/467966038 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5db000af30 con 0x7f5da8071d90 2024-04-25T12:22:38.794 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.789+0000 7f5dcd87c640 1 -- 172.21.15.86:0/2627840304 --> [v2:172.21.15.86:6808/467966038,v1:172.21.15.86:6809/467966038] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f5dc8069180 con 0x7f5da8071d90 2024-04-25T12:22:38.794 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.789+0000 7f5dbffff640 1 -- 172.21.15.86:0/2627840304 <== osd.1 v2:172.21.15.86:6808/467966038 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f5dc8069180 con 0x7f5da8071d90 2024-04-25T12:22:38.795 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-25T12:22:38.795 INFO:teuthology.orchestra.run.smithi086.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T12:22:38.795 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-25T12:22:38.796 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.789+0000 7f5dcd87c640 1 -- 172.21.15.86:0/2627840304 >> [v2:172.21.15.86:6808/467966038,v1:172.21.15.86:6809/467966038] conn(0x7f5da8071d90 msgr2=0x7f5da8074230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:38.796 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.789+0000 7f5dcd87c640 1 --2- 172.21.15.86:0/2627840304 >> [v2:172.21.15.86:6808/467966038,v1:172.21.15.86:6809/467966038] conn(0x7f5da8071d90 0x7f5da8074230 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:38.796 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.789+0000 7f5dcd87c640 1 -- 172.21.15.86:0/2627840304 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f5da8068380 msgr2=0x7f5da806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:38.796 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.789+0000 7f5dcd87c640 1 --2- 172.21.15.86:0/2627840304 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f5da8068380 0x7f5da806a840 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5db80070b0 tx=0x7f5db8007040 comp rx=0 tx=0).stop 2024-04-25T12:22:38.796 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.789+0000 7f5dcd87c640 1 -- 172.21.15.86:0/2627840304 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5dc80cceb0 msgr2=0x7f5dc8149190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:38.797 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.789+0000 7f5dcd87c640 1 --2- 172.21.15.86:0/2627840304 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5dc80cceb0 0x7f5dc8149190 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f5db000d830 tx=0x7f5db000dcf0 comp rx=0 tx=0).stop 2024-04-25T12:22:38.797 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.789+0000 7f5dc77fe640 1 -- 172.21.15.86:0/2627840304 reap_dead start 2024-04-25T12:22:38.797 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.789+0000 7f5dcd87c640 1 -- 172.21.15.86:0/2627840304 shutdown_connections 2024-04-25T12:22:38.797 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.789+0000 7f5dcd87c640 1 -- 172.21.15.86:0/2627840304 >> 172.21.15.86:0/2627840304 conn(0x7f5dc806bf00 msgr2=0x7f5dc81599f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:38.797 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.789+0000 7f5dcd87c640 1 -- 172.21.15.86:0/2627840304 shutdown_connections 2024-04-25T12:22:38.797 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.789+0000 7f5dcd87c640 1 -- 172.21.15.86:0/2627840304 wait complete. 2024-04-25T12:22:38.809 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-25T12:22:38.915 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.909+0000 7f42e89ac640 1 Processor -- start 2024-04-25T12:22:38.915 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.909+0000 7f42e89ac640 1 -- start start 2024-04-25T12:22:38.916 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.913+0000 7f42e89ac640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f42e4155350 0x7f42e40c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:38.917 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.913+0000 7f42e89ac640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f42e415b0b0 0x7f42e415b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:38.917 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.913+0000 7f42e89ac640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42e415beb0 con 0x7f42e40cda50 2024-04-25T12:22:38.917 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.913+0000 7f42e89ac640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f42e40cca40 con 0x7f42e4155350 2024-04-25T12:22:38.917 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.913+0000 7f42e89ac640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f42e40ccc90 con 0x7f42e415b0b0 2024-04-25T12:22:38.917 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.913+0000 7f42e259c640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f42e4155350 0x7f42e40c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:38.917 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.913+0000 7f42e259c640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f42e4155350 0x7f42e40c59c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37626/0 (socket says 172.21.15.86:37626) 2024-04-25T12:22:38.917 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.913+0000 7f42e259c640 1 -- 172.21.15.86:0/382846148 learned_addr learned my addr 172.21.15.86:0/382846148 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:38.918 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.913+0000 7f42e2d9d640 1 --2- 172.21.15.86:0/382846148 >> v2:172.21.15.134:3300/0 conn(0x7f42e415b0b0 0x7f42e415b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:38.918 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.913+0000 7f42e259c640 1 -- 172.21.15.86:0/382846148 >> v2:172.21.15.134:3300/0 conn(0x7f42e415b0b0 msgr2=0x7f42e415b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:38.918 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.913+0000 7f42e259c640 1 --2- 172.21.15.86:0/382846148 >> v2:172.21.15.134:3300/0 conn(0x7f42e415b0b0 0x7f42e415b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:38.918 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.913+0000 7f42e259c640 1 -- 172.21.15.86:0/382846148 >> v1:172.21.15.134:6789/0 conn(0x7f42e40cda50 legacy=0x7f42e40cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:38.918 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.913+0000 7f42e259c640 1 -- 172.21.15.86:0/382846148 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42e40ccf70 con 0x7f42e4155350 2024-04-25T12:22:38.918 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.913+0000 7f42e2d9d640 1 --2- 172.21.15.86:0/382846148 >> v2:172.21.15.134:3300/0 conn(0x7f42e415b0b0 0x7f42e415b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:22:38.920 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.913+0000 7f42e259c640 1 --2- 172.21.15.86:0/382846148 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42e4155350 0x7f42e40c59c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f42e40b44e0 tx=0x7f42d401ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dd6a0f5d46e1ba server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:38.920 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.913+0000 7f42e1d9b640 1 -- 172.21.15.86:0/382846148 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42d40b5070 con 0x7f42e4155350 2024-04-25T12:22:38.920 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.913+0000 7f42e1d9b640 1 -- 172.21.15.86:0/382846148 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42d40a89d0 con 0x7f42e4155350 2024-04-25T12:22:38.920 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.913+0000 7f42e1d9b640 1 -- 172.21.15.86:0/382846148 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42d40a8da0 con 0x7f42e4155350 2024-04-25T12:22:38.920 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.917+0000 7f42e89ac640 1 -- 172.21.15.86:0/382846148 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42e4155350 msgr2=0x7f42e40c59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:38.920 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.917+0000 7f42e89ac640 1 --2- 172.21.15.86:0/382846148 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42e4155350 0x7f42e40c59c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f42e40b44e0 tx=0x7f42d401ecd0 comp rx=0 tx=0).stop 2024-04-25T12:22:38.920 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.917+0000 7f42e89ac640 1 -- 172.21.15.86:0/382846148 shutdown_connections 2024-04-25T12:22:38.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.917+0000 7f42e89ac640 1 --2- 172.21.15.86:0/382846148 >> v2:172.21.15.134:3300/0 conn(0x7f42e415b0b0 0x7f42e415b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:38.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.917+0000 7f42e89ac640 1 --2- 172.21.15.86:0/382846148 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42e4155350 0x7f42e40c59c0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:38.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.917+0000 7f42e89ac640 1 -- 172.21.15.86:0/382846148 >> 172.21.15.86:0/382846148 conn(0x7f42e406cc30 msgr2=0x7f42e406d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:38.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.917+0000 7f42e89ac640 1 -- 172.21.15.86:0/382846148 shutdown_connections 2024-04-25T12:22:38.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.917+0000 7f42e89ac640 1 -- 172.21.15.86:0/382846148 wait complete. 2024-04-25T12:22:38.923 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.917+0000 7f42e89ac640 1 Processor -- start 2024-04-25T12:22:38.923 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.917+0000 7f42e89ac640 1 -- start start 2024-04-25T12:22:38.924 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.917+0000 7f42e89ac640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42e40cda50 0x7f42e415a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:38.924 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.917+0000 7f42e89ac640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42e4155350 0x7f42e41543d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:38.924 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.917+0000 7f42e89ac640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f42e415b0b0 0x7f42e415d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:38.924 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.917+0000 7f42e89ac640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f42e4155730 con 0x7f42e40cda50 2024-04-25T12:22:38.924 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.917+0000 7f42e89ac640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f42e40cd530 con 0x7f42e4155350 2024-04-25T12:22:38.924 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.917+0000 7f42e89ac640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f42e415e860 con 0x7f42e415b0b0 2024-04-25T12:22:38.924 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.917+0000 7f42e259c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42e40cda50 0x7f42e415a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:38.924 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.917+0000 7f42e259c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42e40cda50 0x7f42e415a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37636/0 (socket says 172.21.15.86:37636) 2024-04-25T12:22:38.925 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.917+0000 7f42e259c640 1 -- 172.21.15.86:0/1024425827 learned_addr learned my addr 172.21.15.86:0/1024425827 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:38.925 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.917+0000 7f42e259c640 1 -- 172.21.15.86:0/1024425827 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f42e415b0b0 msgr2=0x7f42e415d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:38.925 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.917+0000 7f42e259c640 1 --2- 172.21.15.86:0/1024425827 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f42e415b0b0 0x7f42e415d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:38.925 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.917+0000 7f42e259c640 1 -- 172.21.15.86:0/1024425827 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42e4155350 msgr2=0x7f42e41543d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:38.925 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.917+0000 7f42e259c640 1 --2- 172.21.15.86:0/1024425827 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42e4155350 0x7f42e41543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:38.925 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.917+0000 7f42e259c640 1 -- 172.21.15.86:0/1024425827 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42e4151070 con 0x7f42e40cda50 2024-04-25T12:22:38.925 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.917+0000 7f42e259c640 1 --2- 172.21.15.86:0/1024425827 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42e40cda50 0x7f42e415a880 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f42d40b3040 tx=0x7f42d401ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:38.925 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.917+0000 7f42daffd640 1 -- 172.21.15.86:0/1024425827 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42d40bd020 con 0x7f42e40cda50 2024-04-25T12:22:38.925 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.917+0000 7f42daffd640 1 -- 172.21.15.86:0/1024425827 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42d40b0840 con 0x7f42e40cda50 2024-04-25T12:22:38.926 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.917+0000 7f42daffd640 1 -- 172.21.15.86:0/1024425827 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42d40b5040 con 0x7f42e40cda50 2024-04-25T12:22:38.926 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.917+0000 7f42e89ac640 1 -- 172.21.15.86:0/1024425827 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42e4151350 con 0x7f42e40cda50 2024-04-25T12:22:38.926 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.917+0000 7f42e89ac640 1 -- 172.21.15.86:0/1024425827 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42e4159060 con 0x7f42e40cda50 2024-04-25T12:22:38.926 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.921+0000 7f42e89ac640 1 -- 172.21.15.86:0/1024425827 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42e4075df0 con 0x7f42e40cda50 2024-04-25T12:22:38.926 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.921+0000 7f42daffd640 1 -- 172.21.15.86:0/1024425827 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f42d40c0020 con 0x7f42e40cda50 2024-04-25T12:22:38.927 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.921+0000 7f42daffd640 1 --2- 172.21.15.86:0/1024425827 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f42c4068380 0x7f42c406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:38.927 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.921+0000 7f42daffd640 1 -- 172.21.15.86:0/1024425827 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f42d41242d0 con 0x7f42e40cda50 2024-04-25T12:22:38.927 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.921+0000 7f42dbfff640 1 --2- 172.21.15.86:0/1024425827 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f42c4068380 0x7f42c406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:38.927 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.921+0000 7f42dbfff640 1 --2- 172.21.15.86:0/1024425827 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f42c4068380 0x7f42c406a840 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f42e415e7b0 tx=0x7f42cc0079c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:38.928 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:38.925+0000 7f42daffd640 1 -- 172.21.15.86:0/1024425827 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f42d40c7030 con 0x7f42e40cda50 2024-04-25T12:22:39.090 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.085+0000 7f42e89ac640 1 -- 172.21.15.86:0/1024425827 --> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f42e40cc610 con 0x7f42c4068380 2024-04-25T12:22:39.091 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.089+0000 7f42daffd640 1 -- 172.21.15.86:0/1024425827 <== mgr.4107 v2:172.21.15.86:6832/3708662606 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f42e40cc610 con 0x7f42c4068380 2024-04-25T12:22:39.092 INFO:teuthology.orchestra.run.smithi086.stderr:instructed osd(s) 1 to deep-scrub 2024-04-25T12:22:39.093 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.089+0000 7f42e89ac640 1 -- 172.21.15.86:0/1024425827 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f42c4068380 msgr2=0x7f42c406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:39.093 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.089+0000 7f42e89ac640 1 --2- 172.21.15.86:0/1024425827 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f42c4068380 0x7f42c406a840 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f42e415e7b0 tx=0x7f42cc0079c0 comp rx=0 tx=0).stop 2024-04-25T12:22:39.094 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.089+0000 7f42e89ac640 1 -- 172.21.15.86:0/1024425827 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42e40cda50 msgr2=0x7f42e415a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:39.094 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.089+0000 7f42e89ac640 1 --2- 172.21.15.86:0/1024425827 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42e40cda50 0x7f42e415a880 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f42d40b3040 tx=0x7f42d401ba70 comp rx=0 tx=0).stop 2024-04-25T12:22:39.094 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.089+0000 7f42e89ac640 1 -- 172.21.15.86:0/1024425827 shutdown_connections 2024-04-25T12:22:39.094 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.089+0000 7f42e89ac640 1 --2- 172.21.15.86:0/1024425827 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f42e415b0b0 0x7f42e415d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:39.094 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.089+0000 7f42e89ac640 1 --2- 172.21.15.86:0/1024425827 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42e4155350 0x7f42e41543d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:39.094 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.089+0000 7f42e89ac640 1 --2- 172.21.15.86:0/1024425827 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f42c4068380 0x7f42c406a840 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:39.094 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.089+0000 7f42e89ac640 1 --2- 172.21.15.86:0/1024425827 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42e40cda50 0x7f42e415a880 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:39.094 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.089+0000 7f42e89ac640 1 -- 172.21.15.86:0/1024425827 >> 172.21.15.86:0/1024425827 conn(0x7f42e406cc30 msgr2=0x7f42e40cb540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:39.095 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.089+0000 7f42e89ac640 1 -- 172.21.15.86:0/1024425827 shutdown_connections 2024-04-25T12:22:39.095 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.089+0000 7f42e89ac640 1 -- 172.21.15.86:0/1024425827 wait complete. 2024-04-25T12:22:39.109 INFO:tasks.ceph:Scrubbing osd.2 2024-04-25T12:22:39.110 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-25T12:22:39.237 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.233+0000 7fa5cd1db640 1 Processor -- start 2024-04-25T12:22:39.237 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.233+0000 7fa5cd1db640 1 -- start start 2024-04-25T12:22:39.239 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.233+0000 7fa5cd1db640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa5c8152220 0x7fa5c8071960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:39.239 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.233+0000 7fa5cd1db640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5c80c2a10 0x7fa5c80b28c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:39.239 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.233+0000 7fa5cd1db640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa5c80c2e50 0x7fa5c80b2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:39.239 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.233+0000 7fa5cd1db640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7fa5c80cdf10 con 0x7fa5c8152220 2024-04-25T12:22:39.239 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.233+0000 7fa5cd1db640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fa5c8073f20 con 0x7fa5c80c2e50 2024-04-25T12:22:39.240 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.233+0000 7fa5cd1db640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fa5c80733a0 con 0x7fa5c80c2a10 2024-04-25T12:22:39.240 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.233+0000 7fa5c6d9d640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa5c8152220 0x7fa5c8071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:39.240 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.233+0000 7fa5c6d9d640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa5c8152220 0x7fa5c8071960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37638/0 (socket says 172.21.15.86:37638) 2024-04-25T12:22:39.240 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.233+0000 7fa5c6d9d640 1 -- 172.21.15.86:0/3270783639 learned_addr learned my addr 172.21.15.86:0/3270783639 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:39.240 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.233+0000 7fa5c659c640 1 --2- 172.21.15.86:0/3270783639 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5c80c2a10 0x7fa5c80b28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:39.240 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.233+0000 7fa5c759e640 1 --2- 172.21.15.86:0/3270783639 >> v2:172.21.15.134:3300/0 conn(0x7fa5c80c2e50 0x7fa5c80b2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:39.240 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.233+0000 7fa5c6d9d640 1 -- 172.21.15.86:0/3270783639 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5c80c2a10 msgr2=0x7fa5c80b28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:39.240 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.233+0000 7fa5c6d9d640 1 --2- 172.21.15.86:0/3270783639 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5c80c2a10 0x7fa5c80b28c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:39.240 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.233+0000 7fa5c6d9d640 1 -- 172.21.15.86:0/3270783639 >> v2:172.21.15.134:3300/0 conn(0x7fa5c80c2e50 msgr2=0x7fa5c80b2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:39.241 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.233+0000 7fa5c6d9d640 1 --2- 172.21.15.86:0/3270783639 >> v2:172.21.15.134:3300/0 conn(0x7fa5c80c2e50 0x7fa5c80b2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:39.241 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.233+0000 7fa5c6d9d640 1 -- 172.21.15.86:0/3270783639 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5c8073680 con 0x7fa5c8152220 2024-04-25T12:22:39.241 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.233+0000 7fa5c759e640 1 --2- 172.21.15.86:0/3270783639 >> v2:172.21.15.134:3300/0 conn(0x7fa5c80c2e50 0x7fa5c80b2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:22:39.242 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.237+0000 7fa5c6d9d640 1 --2- 172.21.15.86:0/3270783639 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5c8152220 0x7fa5c8071960 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa5c8071180 tx=0x7fa5b801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3005a86cc70b95c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:39.242 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.237+0000 7fa5c5d9b640 1 -- 172.21.15.86:0/3270783639 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b80b5070 con 0x7fa5c8152220 2024-04-25T12:22:39.242 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.237+0000 7fa5c5d9b640 1 -- 172.21.15.86:0/3270783639 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5b80a89d0 con 0x7fa5c8152220 2024-04-25T12:22:39.242 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.237+0000 7fa5c5d9b640 1 -- 172.21.15.86:0/3270783639 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b80a8da0 con 0x7fa5c8152220 2024-04-25T12:22:39.243 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.237+0000 7fa5cd1db640 1 -- 172.21.15.86:0/3270783639 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5c8152220 msgr2=0x7fa5c8071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:39.243 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.237+0000 7fa5cd1db640 1 --2- 172.21.15.86:0/3270783639 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5c8152220 0x7fa5c8071960 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa5c8071180 tx=0x7fa5b801ed10 comp rx=0 tx=0).stop 2024-04-25T12:22:39.243 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.237+0000 7fa5cd1db640 1 -- 172.21.15.86:0/3270783639 shutdown_connections 2024-04-25T12:22:39.243 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.237+0000 7fa5cd1db640 1 --2- 172.21.15.86:0/3270783639 >> v2:172.21.15.134:3300/0 conn(0x7fa5c80c2e50 0x7fa5c80b2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:39.243 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.237+0000 7fa5cd1db640 1 --2- 172.21.15.86:0/3270783639 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5c80c2a10 0x7fa5c80b28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:39.243 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.237+0000 7fa5cd1db640 1 --2- 172.21.15.86:0/3270783639 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5c8152220 0x7fa5c8071960 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:39.243 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.237+0000 7fa5cd1db640 1 -- 172.21.15.86:0/3270783639 >> 172.21.15.86:0/3270783639 conn(0x7fa5c80ccfe0 msgr2=0x7fa5c80cd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:39.244 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.237+0000 7fa5cd1db640 1 -- 172.21.15.86:0/3270783639 shutdown_connections 2024-04-25T12:22:39.244 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.237+0000 7fa5cd1db640 1 -- 172.21.15.86:0/3270783639 wait complete. 2024-04-25T12:22:39.247 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.237+0000 7fa5cd1db640 1 Processor -- start 2024-04-25T12:22:39.247 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.237+0000 7fa5cd1db640 1 -- start start 2024-04-25T12:22:39.247 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.241+0000 7fa5cd1db640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5c80c2a10 0x7fa5c8158060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:39.247 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.241+0000 7fa5cd1db640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5c80c2e50 0x7fa5c80c8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:39.247 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.241+0000 7fa5cd1db640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5c8152220 0x7fa5c80c8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:39.248 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.241+0000 7fa5cd1db640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa5c815b600 con 0x7fa5c80c2e50 2024-04-25T12:22:39.248 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.241+0000 7fa5cd1db640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa5c8073c40 con 0x7fa5c8152220 2024-04-25T12:22:39.248 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.241+0000 7fa5cd1db640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fa5c8152600 con 0x7fa5c80c2a10 2024-04-25T12:22:39.248 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.241+0000 7fa5c659c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5c80c2e50 0x7fa5c80c8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:39.248 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.241+0000 7fa5c659c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5c80c2e50 0x7fa5c80c8860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37644/0 (socket says 172.21.15.86:37644) 2024-04-25T12:22:39.248 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.241+0000 7fa5c659c640 1 -- 172.21.15.86:0/2707577219 learned_addr learned my addr 172.21.15.86:0/2707577219 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:39.248 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.241+0000 7fa5c759e640 1 --2- 172.21.15.86:0/2707577219 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5c8152220 0x7fa5c80c8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:39.248 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.241+0000 7fa5c6d9d640 1 --2- 172.21.15.86:0/2707577219 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5c80c2a10 0x7fa5c8158060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:39.249 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.241+0000 7fa5c659c640 1 -- 172.21.15.86:0/2707577219 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5c80c2a10 msgr2=0x7fa5c8158060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:39.249 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.241+0000 7fa5c659c640 1 --2- 172.21.15.86:0/2707577219 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5c80c2a10 0x7fa5c8158060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:39.249 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.241+0000 7fa5c659c640 1 -- 172.21.15.86:0/2707577219 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5c8152220 msgr2=0x7fa5c80c8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:39.249 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.241+0000 7fa5c659c640 1 --2- 172.21.15.86:0/2707577219 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5c8152220 0x7fa5c80c8da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:39.249 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.241+0000 7fa5c659c640 1 -- 172.21.15.86:0/2707577219 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5c81eeb90 con 0x7fa5c80c2e50 2024-04-25T12:22:39.249 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.241+0000 7fa5c6d9d640 1 --2- 172.21.15.86:0/2707577219 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5c80c2a10 0x7fa5c8158060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:22:39.249 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.241+0000 7fa5c659c640 1 --2- 172.21.15.86:0/2707577219 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5c80c2e50 0x7fa5c80c8860 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc00d800 tx=0x7fa5bc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:39.249 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.241+0000 7fa5af7fe640 1 -- 172.21.15.86:0/2707577219 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5bc018020 con 0x7fa5c80c2e50 2024-04-25T12:22:39.249 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.241+0000 7fa5af7fe640 1 -- 172.21.15.86:0/2707577219 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5bc0096c0 con 0x7fa5c80c2e50 2024-04-25T12:22:39.250 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.241+0000 7fa5cd1db640 1 -- 172.21.15.86:0/2707577219 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5c81eee70 con 0x7fa5c80c2e50 2024-04-25T12:22:39.250 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.241+0000 7fa5af7fe640 1 -- 172.21.15.86:0/2707577219 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5bc009ab0 con 0x7fa5c80c2e50 2024-04-25T12:22:39.250 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.241+0000 7fa5cd1db640 1 -- 172.21.15.86:0/2707577219 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5c81ef430 con 0x7fa5c80c2e50 2024-04-25T12:22:39.250 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.241+0000 7fa5cd1db640 1 -- 172.21.15.86:0/2707577219 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa5c8075df0 con 0x7fa5c80c2e50 2024-04-25T12:22:39.250 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.241+0000 7fa5af7fe640 1 -- 172.21.15.86:0/2707577219 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa5bc01b020 con 0x7fa5c80c2e50 2024-04-25T12:22:39.250 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.241+0000 7fa5af7fe640 1 --2- 172.21.15.86:0/2707577219 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fa5b40683b0 0x7fa5b406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:39.250 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.241+0000 7fa5af7fe640 1 -- 172.21.15.86:0/2707577219 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fa5bc0879a0 con 0x7fa5c80c2e50 2024-04-25T12:22:39.251 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.241+0000 7fa5c6d9d640 1 --2- 172.21.15.86:0/2707577219 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fa5b40683b0 0x7fa5b406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:39.251 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.241+0000 7fa5af7fe640 1 --2- 172.21.15.86:0/2707577219 >> [v2:172.21.15.86:6816/3279762843,v1:172.21.15.86:6817/3279762843] conn(0x7fa5b4071dd0 0x7fa5b4074270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:39.251 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.241+0000 7fa5af7fe640 1 -- 172.21.15.86:0/2707577219 --> [v2:172.21.15.86:6816/3279762843,v1:172.21.15.86:6817/3279762843] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa5bc00cfb0 con 0x7fa5b4071dd0 2024-04-25T12:22:39.251 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.241+0000 7fa5af7fe640 1 -- 172.21.15.86:0/2707577219 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa5bc087e30 con 0x7fa5c80c2e50 2024-04-25T12:22:39.251 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.241+0000 7fa5c759e640 1 --2- 172.21.15.86:0/2707577219 >> [v2:172.21.15.86:6816/3279762843,v1:172.21.15.86:6817/3279762843] conn(0x7fa5b4071dd0 0x7fa5b4074270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:39.251 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.241+0000 7fa5c6d9d640 1 --2- 172.21.15.86:0/2707577219 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fa5b40683b0 0x7fa5b406a870 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa5b80b2000 tx=0x7fa5b8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:39.251 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.245+0000 7fa5c759e640 1 --2- 172.21.15.86:0/2707577219 >> [v2:172.21.15.86:6816/3279762843,v1:172.21.15.86:6817/3279762843] conn(0x7fa5b4071dd0 0x7fa5b4074270 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:39.252 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.245+0000 7fa5af7fe640 1 -- 172.21.15.86:0/2707577219 <== osd.2 v2:172.21.15.86:6816/3279762843 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa5bc00cfb0 con 0x7fa5b4071dd0 2024-04-25T12:22:39.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.257+0000 7fa5cd1db640 1 -- 172.21.15.86:0/2707577219 --> [v2:172.21.15.86:6816/3279762843,v1:172.21.15.86:6817/3279762843] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa5c814fd30 con 0x7fa5b4071dd0 2024-04-25T12:22:39.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.257+0000 7fa5af7fe640 1 -- 172.21.15.86:0/2707577219 <== osd.2 v2:172.21.15.86:6816/3279762843 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa5c814fd30 con 0x7fa5b4071dd0 2024-04-25T12:22:39.262 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-25T12:22:39.262 INFO:teuthology.orchestra.run.smithi086.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T12:22:39.262 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-25T12:22:39.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.257+0000 7fa5cd1db640 1 -- 172.21.15.86:0/2707577219 >> [v2:172.21.15.86:6816/3279762843,v1:172.21.15.86:6817/3279762843] conn(0x7fa5b4071dd0 msgr2=0x7fa5b4074270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:39.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.257+0000 7fa5cd1db640 1 --2- 172.21.15.86:0/2707577219 >> [v2:172.21.15.86:6816/3279762843,v1:172.21.15.86:6817/3279762843] conn(0x7fa5b4071dd0 0x7fa5b4074270 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:39.264 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.257+0000 7fa5cd1db640 1 -- 172.21.15.86:0/2707577219 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fa5b40683b0 msgr2=0x7fa5b406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:39.264 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.257+0000 7fa5cd1db640 1 --2- 172.21.15.86:0/2707577219 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fa5b40683b0 0x7fa5b406a870 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa5b80b2000 tx=0x7fa5b8008040 comp rx=0 tx=0).stop 2024-04-25T12:22:39.264 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.257+0000 7fa5cd1db640 1 -- 172.21.15.86:0/2707577219 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5c80c2e50 msgr2=0x7fa5c80c8860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:39.264 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.257+0000 7fa5cd1db640 1 --2- 172.21.15.86:0/2707577219 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5c80c2e50 0x7fa5c80c8860 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc00d800 tx=0x7fa5bc00dcc0 comp rx=0 tx=0).stop 2024-04-25T12:22:39.264 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.257+0000 7fa5c759e640 1 -- 172.21.15.86:0/2707577219 reap_dead start 2024-04-25T12:22:39.264 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.257+0000 7fa5cd1db640 1 -- 172.21.15.86:0/2707577219 shutdown_connections 2024-04-25T12:22:39.265 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.257+0000 7fa5cd1db640 1 -- 172.21.15.86:0/2707577219 >> 172.21.15.86:0/2707577219 conn(0x7fa5c80ccfe0 msgr2=0x7fa5c81474e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:39.265 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.257+0000 7fa5cd1db640 1 -- 172.21.15.86:0/2707577219 shutdown_connections 2024-04-25T12:22:39.265 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.257+0000 7fa5cd1db640 1 -- 172.21.15.86:0/2707577219 wait complete. 2024-04-25T12:22:39.276 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-25T12:22:39.383 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.381+0000 7fe8b295a640 1 Processor -- start 2024-04-25T12:22:39.383 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.381+0000 7fe8b295a640 1 -- start start 2024-04-25T12:22:39.385 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.381+0000 7fe8b295a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe8ac0cda50 0x7fe8ac0c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:39.385 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.381+0000 7fe8b295a640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe8ac15b0b0 0x7fe8ac15b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:39.385 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.381+0000 7fe8b295a640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8ac15beb0 con 0x7fe8ac155350 2024-04-25T12:22:39.385 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.381+0000 7fe8b295a640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7fe8ac0cca40 con 0x7fe8ac15b0b0 2024-04-25T12:22:39.385 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.381+0000 7fe8b295a640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fe8ac0ccc90 con 0x7fe8ac0cda50 2024-04-25T12:22:39.385 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.381+0000 7fe8b0ef7640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe8ac15b0b0 0x7fe8ac15b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:39.385 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.381+0000 7fe8b0ef7640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe8ac15b0b0 0x7fe8ac15b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37656/0 (socket says 172.21.15.86:37656) 2024-04-25T12:22:39.385 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.381+0000 7fe8b0ef7640 1 -- 172.21.15.86:0/1199454302 learned_addr learned my addr 172.21.15.86:0/1199454302 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:39.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.381+0000 7fe8abfff640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fe8ac155350 0x7fe8ac0cb7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:42102/0 (socket says 172.21.15.86:42102) 2024-04-25T12:22:39.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.381+0000 7fe8b0ef7640 1 -- 172.21.15.86:0/1199454302 >> v2:172.21.15.134:3300/0 conn(0x7fe8ac0cda50 msgr2=0x7fe8ac0c59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:39.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.381+0000 7fe8b0ef7640 1 --2- 172.21.15.86:0/1199454302 >> v2:172.21.15.134:3300/0 conn(0x7fe8ac0cda50 0x7fe8ac0c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:39.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.381+0000 7fe8b0ef7640 1 -- 172.21.15.86:0/1199454302 >> v1:172.21.15.86:6789/0 conn(0x7fe8ac155350 legacy=0x7fe8ac0cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:39.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.381+0000 7fe8b0ef7640 1 -- 172.21.15.86:0/1199454302 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8ac0ccf70 con 0x7fe8ac15b0b0 2024-04-25T12:22:39.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.381+0000 7fe8aaffd640 1 -- 172.21.15.86:0/1199454302 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3605342122 0 0) 0x7fe8ac15beb0 con 0x7fe8ac155350 2024-04-25T12:22:39.388 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.381+0000 7fe8b0ef7640 1 --2- 172.21.15.86:0/1199454302 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8ac15b0b0 0x7fe8ac15b500 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac0ce540 tx=0x7fe8a401f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83bd2d9463043b74 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:39.388 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.381+0000 7fe8aaffd640 1 -- 172.21.15.86:0/1199454302 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8a40b4070 con 0x7fe8ac15b0b0 2024-04-25T12:22:39.388 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.381+0000 7fe8aaffd640 1 -- 172.21.15.86:0/1199454302 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8a40af400 con 0x7fe8ac15b0b0 2024-04-25T12:22:39.388 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.381+0000 7fe8aaffd640 1 -- 172.21.15.86:0/1199454302 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8a40af7d0 con 0x7fe8ac15b0b0 2024-04-25T12:22:39.388 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.385+0000 7fe8b295a640 1 -- 172.21.15.86:0/1199454302 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8ac15b0b0 msgr2=0x7fe8ac15b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:39.388 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.385+0000 7fe8b295a640 1 --2- 172.21.15.86:0/1199454302 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8ac15b0b0 0x7fe8ac15b500 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac0ce540 tx=0x7fe8a401f1e0 comp rx=0 tx=0).stop 2024-04-25T12:22:39.388 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.385+0000 7fe8b295a640 1 -- 172.21.15.86:0/1199454302 shutdown_connections 2024-04-25T12:22:39.388 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.385+0000 7fe8b295a640 1 --2- 172.21.15.86:0/1199454302 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8ac15b0b0 0x7fe8ac15b500 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:39.388 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.385+0000 7fe8b295a640 1 --2- 172.21.15.86:0/1199454302 >> v2:172.21.15.134:3300/0 conn(0x7fe8ac0cda50 0x7fe8ac0c59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:39.389 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.385+0000 7fe8b295a640 1 -- 172.21.15.86:0/1199454302 >> 172.21.15.86:0/1199454302 conn(0x7fe8ac06cc30 msgr2=0x7fe8ac06d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:39.389 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.385+0000 7fe8b295a640 1 -- 172.21.15.86:0/1199454302 shutdown_connections 2024-04-25T12:22:39.389 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.385+0000 7fe8b295a640 1 -- 172.21.15.86:0/1199454302 wait complete. 2024-04-25T12:22:39.391 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.385+0000 7fe8b295a640 1 Processor -- start 2024-04-25T12:22:39.391 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.385+0000 7fe8b295a640 1 -- start start 2024-04-25T12:22:39.391 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.385+0000 7fe8b295a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8ac0cda50 0x7fe8ac1f2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:39.391 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.385+0000 7fe8b295a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe8ac155350 0x7fe8ac1f4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:39.391 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.385+0000 7fe8b295a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8ac15b0b0 0x7fe8ac0c67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:39.391 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.385+0000 7fe8b295a640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe8ac155730 con 0x7fe8ac15b0b0 2024-04-25T12:22:39.391 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.385+0000 7fe8b295a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe8ac0cd530 con 0x7fe8ac0cda50 2024-04-25T12:22:39.391 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.385+0000 7fe8b295a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fe8ac15e860 con 0x7fe8ac155350 2024-04-25T12:22:39.392 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.385+0000 7fe8b0ef7640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8ac15b0b0 0x7fe8ac0c67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:39.392 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.385+0000 7fe8b0ef7640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8ac15b0b0 0x7fe8ac0c67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37658/0 (socket says 172.21.15.86:37658) 2024-04-25T12:22:39.392 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.385+0000 7fe8b0ef7640 1 -- 172.21.15.86:0/1690706915 learned_addr learned my addr 172.21.15.86:0/1690706915 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:39.392 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.385+0000 7fe8ab7fe640 1 --2- 172.21.15.86:0/1690706915 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe8ac155350 0x7fe8ac1f4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:39.392 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.385+0000 7fe8abfff640 1 --2- 172.21.15.86:0/1690706915 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8ac0cda50 0x7fe8ac1f2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:39.392 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.385+0000 7fe8b0ef7640 1 -- 172.21.15.86:0/1690706915 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe8ac155350 msgr2=0x7fe8ac1f4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:39.392 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.385+0000 7fe8b0ef7640 1 --2- 172.21.15.86:0/1690706915 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe8ac155350 0x7fe8ac1f4e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:39.392 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.385+0000 7fe8b0ef7640 1 -- 172.21.15.86:0/1690706915 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8ac0cda50 msgr2=0x7fe8ac1f2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:39.392 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.385+0000 7fe8b0ef7640 1 --2- 172.21.15.86:0/1690706915 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8ac0cda50 0x7fe8ac1f2190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:39.393 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.385+0000 7fe8b0ef7640 1 -- 172.21.15.86:0/1690706915 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8ac15a7f0 con 0x7fe8ac15b0b0 2024-04-25T12:22:39.393 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.385+0000 7fe8b0ef7640 1 --2- 172.21.15.86:0/1690706915 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8ac15b0b0 0x7fe8ac0c67a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe8a40b2040 tx=0x7fe8a401bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:39.393 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.385+0000 7fe8a8ff9640 1 -- 172.21.15.86:0/1690706915 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8a40be070 con 0x7fe8ac15b0b0 2024-04-25T12:22:39.393 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.385+0000 7fe8a8ff9640 1 -- 172.21.15.86:0/1690706915 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8a40090d0 con 0x7fe8ac15b0b0 2024-04-25T12:22:39.393 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.385+0000 7fe8b295a640 1 -- 172.21.15.86:0/1690706915 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8ac15aad0 con 0x7fe8ac15b0b0 2024-04-25T12:22:39.393 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.385+0000 7fe8a8ff9640 1 -- 172.21.15.86:0/1690706915 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8a40b4040 con 0x7fe8ac15b0b0 2024-04-25T12:22:39.393 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.385+0000 7fe8b295a640 1 -- 172.21.15.86:0/1690706915 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8ac1f4330 con 0x7fe8ac15b0b0 2024-04-25T12:22:39.393 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.385+0000 7fe8b295a640 1 -- 172.21.15.86:0/1690706915 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8ac075df0 con 0x7fe8ac15b0b0 2024-04-25T12:22:39.394 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.389+0000 7fe8a8ff9640 1 -- 172.21.15.86:0/1690706915 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe8a40b7070 con 0x7fe8ac15b0b0 2024-04-25T12:22:39.394 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.389+0000 7fe8a8ff9640 1 --2- 172.21.15.86:0/1690706915 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fe8980683b0 0x7fe89806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:39.394 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.389+0000 7fe8abfff640 1 --2- 172.21.15.86:0/1690706915 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fe8980683b0 0x7fe89806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:39.394 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.389+0000 7fe8a8ff9640 1 -- 172.21.15.86:0/1690706915 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fe8a4124a80 con 0x7fe8ac15b0b0 2024-04-25T12:22:39.395 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.389+0000 7fe8abfff640 1 --2- 172.21.15.86:0/1690706915 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fe8980683b0 0x7fe89806a870 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe89c000f70 tx=0x7fe89c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:39.396 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.393+0000 7fe8a8ff9640 1 -- 172.21.15.86:0/1690706915 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe8a4018d40 con 0x7fe8ac15b0b0 2024-04-25T12:22:39.543 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.541+0000 7fe8b295a640 1 -- 172.21.15.86:0/1690706915 --> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fe8ac0cc610 con 0x7fe8980683b0 2024-04-25T12:22:39.544 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.541+0000 7fe8a8ff9640 1 -- 172.21.15.86:0/1690706915 <== mgr.4107 v2:172.21.15.86:6832/3708662606 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe8ac0cc610 con 0x7fe8980683b0 2024-04-25T12:22:39.545 INFO:teuthology.orchestra.run.smithi086.stderr:instructed osd(s) 2 to deep-scrub 2024-04-25T12:22:39.547 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.541+0000 7fe8b295a640 1 -- 172.21.15.86:0/1690706915 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fe8980683b0 msgr2=0x7fe89806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:39.547 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.541+0000 7fe8b295a640 1 --2- 172.21.15.86:0/1690706915 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fe8980683b0 0x7fe89806a870 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe89c000f70 tx=0x7fe89c009040 comp rx=0 tx=0).stop 2024-04-25T12:22:39.548 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.541+0000 7fe8b295a640 1 -- 172.21.15.86:0/1690706915 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8ac15b0b0 msgr2=0x7fe8ac0c67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:39.548 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.541+0000 7fe8b295a640 1 --2- 172.21.15.86:0/1690706915 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8ac15b0b0 0x7fe8ac0c67a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe8a40b2040 tx=0x7fe8a401bf80 comp rx=0 tx=0).stop 2024-04-25T12:22:39.548 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.541+0000 7fe8b295a640 1 -- 172.21.15.86:0/1690706915 shutdown_connections 2024-04-25T12:22:39.548 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.541+0000 7fe8b295a640 1 --2- 172.21.15.86:0/1690706915 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fe8980683b0 0x7fe89806a870 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:39.548 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.541+0000 7fe8b295a640 1 --2- 172.21.15.86:0/1690706915 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8ac15b0b0 0x7fe8ac0c67a0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:39.548 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.541+0000 7fe8b295a640 1 --2- 172.21.15.86:0/1690706915 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe8ac155350 0x7fe8ac1f4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:39.548 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.541+0000 7fe8b295a640 1 --2- 172.21.15.86:0/1690706915 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8ac0cda50 0x7fe8ac1f2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:39.548 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.541+0000 7fe8b295a640 1 -- 172.21.15.86:0/1690706915 >> 172.21.15.86:0/1690706915 conn(0x7fe8ac06cc30 msgr2=0x7fe8ac0cb540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:39.548 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.541+0000 7fe8b295a640 1 -- 172.21.15.86:0/1690706915 shutdown_connections 2024-04-25T12:22:39.549 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.541+0000 7fe8b295a640 1 -- 172.21.15.86:0/1690706915 wait complete. 2024-04-25T12:22:39.562 INFO:tasks.ceph:Scrubbing osd.3 2024-04-25T12:22:39.562 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-25T12:22:39.676 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.673+0000 7fd36e191640 1 Processor -- start 2024-04-25T12:22:39.676 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.673+0000 7fd36e191640 1 -- start start 2024-04-25T12:22:39.678 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.673+0000 7fd36e191640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd3680c6fa0 0x7fd36806d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:39.679 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.673+0000 7fd36e191640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd3680c7380 0x7fd36806d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:39.679 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.673+0000 7fd36e191640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd368072f00 con 0x7fd3681529b0 2024-04-25T12:22:39.679 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.673+0000 7fd36e191640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7fd368158e70 con 0x7fd3680c7380 2024-04-25T12:22:39.679 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.673+0000 7fd36e191640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fd368159150 con 0x7fd3680c6fa0 2024-04-25T12:22:39.680 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.673+0000 7fd366ffd640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd3680c7380 0x7fd36806d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:39.680 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.673+0000 7fd367fff640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fd3681529b0 0x7fd368152e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:42104/0 (socket says 172.21.15.86:42104) 2024-04-25T12:22:39.680 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.673+0000 7fd367fff640 1 -- 172.21.15.86:0/2289424332 learned_addr learned my addr 172.21.15.86:0/2289424332 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-04-25T12:22:39.680 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.673+0000 7fd3677fe640 1 --2- 172.21.15.86:0/2289424332 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd3680c6fa0 0x7fd36806d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:39.681 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.673+0000 7fd3667fc640 1 -- 172.21.15.86:0/2289424332 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1484143970 0 0) 0x7fd368072f00 con 0x7fd3681529b0 2024-04-25T12:22:39.681 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.673+0000 7fd3667fc640 1 -- 172.21.15.86:0/2289424332 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd350003530 con 0x7fd3681529b0 2024-04-25T12:22:39.681 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.673+0000 7fd366ffd640 1 -- 172.21.15.86:0/2289424332 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd3680c6fa0 msgr2=0x7fd36806d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:39.681 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.673+0000 7fd366ffd640 1 --2- 172.21.15.86:0/2289424332 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd3680c6fa0 0x7fd36806d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:39.681 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.673+0000 7fd366ffd640 1 -- 172.21.15.86:0/2289424332 >> v1:172.21.15.86:6789/0 conn(0x7fd3681529b0 legacy=0x7fd368152e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:39.682 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.673+0000 7fd366ffd640 1 -- 172.21.15.86:0/2289424332 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd368159430 con 0x7fd3680c7380 2024-04-25T12:22:39.687 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.677+0000 7fd366ffd640 1 --2- 172.21.15.86:0/2289424332 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3680c7380 0x7fd36806d860 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd35c0097c0 tx=0x7fd35c01ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf1a28a7a06089c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:39.687 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.677+0000 7fd3667fc640 1 -- 172.21.15.86:0/2289424332 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd35c0b5070 con 0x7fd3680c7380 2024-04-25T12:22:39.687 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.677+0000 7fd3667fc640 1 -- 172.21.15.86:0/2289424332 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd35c0a8990 con 0x7fd3680c7380 2024-04-25T12:22:39.687 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.677+0000 7fd3667fc640 1 -- 172.21.15.86:0/2289424332 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd35c0a8d60 con 0x7fd3680c7380 2024-04-25T12:22:39.687 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.677+0000 7fd36e191640 1 -- 172.21.15.86:0/2289424332 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3680c7380 msgr2=0x7fd36806d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:39.688 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.677+0000 7fd36e191640 1 --2- 172.21.15.86:0/2289424332 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3680c7380 0x7fd36806d860 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd35c0097c0 tx=0x7fd35c01ec90 comp rx=0 tx=0).stop 2024-04-25T12:22:39.688 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.677+0000 7fd36e191640 1 -- 172.21.15.86:0/2289424332 shutdown_connections 2024-04-25T12:22:39.688 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.677+0000 7fd36e191640 1 --2- 172.21.15.86:0/2289424332 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3680c7380 0x7fd36806d860 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:39.688 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.677+0000 7fd36e191640 1 --2- 172.21.15.86:0/2289424332 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd3680c6fa0 0x7fd36806d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:39.688 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.677+0000 7fd36e191640 1 -- 172.21.15.86:0/2289424332 >> 172.21.15.86:0/2289424332 conn(0x7fd36806fdc0 msgr2=0x7fd3680701d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:39.688 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.677+0000 7fd36e191640 1 -- 172.21.15.86:0/2289424332 shutdown_connections 2024-04-25T12:22:39.688 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.677+0000 7fd36e191640 1 -- 172.21.15.86:0/2289424332 wait complete. 2024-04-25T12:22:39.688 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.677+0000 7fd36e191640 1 Processor -- start 2024-04-25T12:22:39.688 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.677+0000 7fd36e191640 1 -- start start 2024-04-25T12:22:39.689 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.681+0000 7fd36e191640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd3680c6fa0 0x7fd36814e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:39.689 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.681+0000 7fd36e191640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3681529b0 0x7fd3681f1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:39.689 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.681+0000 7fd36e191640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3681520b0 0x7fd3681f2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:39.689 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.681+0000 7fd36e191640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd3680c87d0 con 0x7fd3681529b0 2024-04-25T12:22:39.689 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.681+0000 7fd36e191640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd3681599f0 con 0x7fd3681520b0 2024-04-25T12:22:39.689 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.681+0000 7fd36e191640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fd3680c8950 con 0x7fd3680c6fa0 2024-04-25T12:22:39.689 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.681+0000 7fd366ffd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3681529b0 0x7fd3681f1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:39.689 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.681+0000 7fd366ffd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3681529b0 0x7fd3681f1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37676/0 (socket says 172.21.15.86:37676) 2024-04-25T12:22:39.689 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.681+0000 7fd366ffd640 1 -- 172.21.15.86:0/3099966122 learned_addr learned my addr 172.21.15.86:0/3099966122 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:39.690 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.681+0000 7fd366ffd640 1 -- 172.21.15.86:0/3099966122 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd3680c6fa0 msgr2=0x7fd36814e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:39.690 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.681+0000 7fd366ffd640 1 --2- 172.21.15.86:0/3099966122 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd3680c6fa0 0x7fd36814e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:39.690 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.681+0000 7fd366ffd640 1 -- 172.21.15.86:0/3099966122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3681520b0 msgr2=0x7fd3681f2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:39.690 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.681+0000 7fd366ffd640 1 --2- 172.21.15.86:0/3099966122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3681520b0 0x7fd3681f2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:39.690 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.681+0000 7fd366ffd640 1 -- 172.21.15.86:0/3099966122 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd368151610 con 0x7fd3681529b0 2024-04-25T12:22:39.690 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.681+0000 7fd366ffd640 1 --2- 172.21.15.86:0/3099966122 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3681529b0 0x7fd3681f1ac0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd35c01c8c0 tx=0x7fd35c01ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:39.690 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.681+0000 7fd34ffff640 1 -- 172.21.15.86:0/3099966122 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd35c0bf070 con 0x7fd3681529b0 2024-04-25T12:22:39.690 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.681+0000 7fd34ffff640 1 -- 172.21.15.86:0/3099966122 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd35c0b07a0 con 0x7fd3681529b0 2024-04-25T12:22:39.691 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.681+0000 7fd36e191640 1 -- 172.21.15.86:0/3099966122 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd368151050 con 0x7fd3681529b0 2024-04-25T12:22:39.691 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.681+0000 7fd34ffff640 1 -- 172.21.15.86:0/3099966122 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd35c0b5040 con 0x7fd3681529b0 2024-04-25T12:22:39.691 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.681+0000 7fd36e191640 1 -- 172.21.15.86:0/3099966122 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3681518d0 con 0x7fd3681529b0 2024-04-25T12:22:39.691 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.681+0000 7fd36e191640 1 -- 172.21.15.86:0/3099966122 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd368150e00 con 0x7fd3681529b0 2024-04-25T12:22:39.691 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.681+0000 7fd34ffff640 1 -- 172.21.15.86:0/3099966122 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd35c0c2070 con 0x7fd3681529b0 2024-04-25T12:22:39.691 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.681+0000 7fd34ffff640 1 --2- 172.21.15.86:0/3099966122 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fd3540683b0 0x7fd35406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:39.691 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.681+0000 7fd3677fe640 1 --2- 172.21.15.86:0/3099966122 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fd3540683b0 0x7fd35406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:39.691 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.681+0000 7fd34ffff640 1 -- 172.21.15.86:0/3099966122 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fd35c1237c0 con 0x7fd3681529b0 2024-04-25T12:22:39.691 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.681+0000 7fd34ffff640 1 --2- 172.21.15.86:0/3099966122 >> [v2:172.21.15.86:6818/2861354413,v1:172.21.15.86:6821/2861354413] conn(0x7fd354071dc0 0x7fd354074260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:39.691 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.681+0000 7fd34ffff640 1 -- 172.21.15.86:0/3099966122 --> [v2:172.21.15.86:6818/2861354413,v1:172.21.15.86:6821/2861354413] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd35c0c1e50 con 0x7fd354071dc0 2024-04-25T12:22:39.692 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.681+0000 7fd34ffff640 1 -- 172.21.15.86:0/3099966122 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd35c123c50 con 0x7fd3681529b0 2024-04-25T12:22:39.692 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.681+0000 7fd367fff640 1 --2- 172.21.15.86:0/3099966122 >> [v2:172.21.15.86:6818/2861354413,v1:172.21.15.86:6821/2861354413] conn(0x7fd354071dc0 0x7fd354074260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:39.692 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.681+0000 7fd3677fe640 1 --2- 172.21.15.86:0/3099966122 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fd3540683b0 0x7fd35406a870 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd3580098f0 tx=0x7fd358008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:39.692 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.681+0000 7fd367fff640 1 --2- 172.21.15.86:0/3099966122 >> [v2:172.21.15.86:6818/2861354413,v1:172.21.15.86:6821/2861354413] conn(0x7fd354071dc0 0x7fd354074260 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:39.692 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.685+0000 7fd34ffff640 1 -- 172.21.15.86:0/3099966122 <== osd.3 v2:172.21.15.86:6818/2861354413 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd35c0c1e50 con 0x7fd354071dc0 2024-04-25T12:22:39.700 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.697+0000 7fd36e191640 1 -- 172.21.15.86:0/3099966122 --> [v2:172.21.15.86:6818/2861354413,v1:172.21.15.86:6821/2861354413] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd3681450c0 con 0x7fd354071dc0 2024-04-25T12:22:39.700 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.697+0000 7fd34ffff640 1 -- 172.21.15.86:0/3099966122 <== osd.3 v2:172.21.15.86:6818/2861354413 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd360001bb0 con 0x7fd354071dc0 2024-04-25T12:22:39.700 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-25T12:22:39.701 INFO:teuthology.orchestra.run.smithi086.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T12:22:39.701 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-25T12:22:39.702 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.697+0000 7fd36e191640 1 -- 172.21.15.86:0/3099966122 >> [v2:172.21.15.86:6818/2861354413,v1:172.21.15.86:6821/2861354413] conn(0x7fd354071dc0 msgr2=0x7fd354074260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:39.702 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.697+0000 7fd36e191640 1 --2- 172.21.15.86:0/3099966122 >> [v2:172.21.15.86:6818/2861354413,v1:172.21.15.86:6821/2861354413] conn(0x7fd354071dc0 0x7fd354074260 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:39.702 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.697+0000 7fd36e191640 1 -- 172.21.15.86:0/3099966122 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fd3540683b0 msgr2=0x7fd35406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:39.702 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.697+0000 7fd36e191640 1 --2- 172.21.15.86:0/3099966122 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fd3540683b0 0x7fd35406a870 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd3580098f0 tx=0x7fd358008040 comp rx=0 tx=0).stop 2024-04-25T12:22:39.702 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.697+0000 7fd36e191640 1 -- 172.21.15.86:0/3099966122 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3681529b0 msgr2=0x7fd3681f1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:39.702 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.697+0000 7fd36e191640 1 --2- 172.21.15.86:0/3099966122 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3681529b0 0x7fd3681f1ac0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd35c01c8c0 tx=0x7fd35c01ba30 comp rx=0 tx=0).stop 2024-04-25T12:22:39.702 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.697+0000 7fd367fff640 1 -- 172.21.15.86:0/3099966122 reap_dead start 2024-04-25T12:22:39.702 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.697+0000 7fd36e191640 1 -- 172.21.15.86:0/3099966122 shutdown_connections 2024-04-25T12:22:39.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.697+0000 7fd36e191640 1 -- 172.21.15.86:0/3099966122 >> 172.21.15.86:0/3099966122 conn(0x7fd36806fdc0 msgr2=0x7fd368073630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:39.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.697+0000 7fd36e191640 1 -- 172.21.15.86:0/3099966122 shutdown_connections 2024-04-25T12:22:39.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.697+0000 7fd36e191640 1 -- 172.21.15.86:0/3099966122 wait complete. 2024-04-25T12:22:39.715 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-25T12:22:39.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.825+0000 7f1f320b2640 1 Processor -- start 2024-04-25T12:22:39.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.825+0000 7f1f320b2640 1 -- start start 2024-04-25T12:22:39.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.825+0000 7f1f320b2640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1f2c14f8a0 0x7f1f2c071890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:39.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.825+0000 7f1f320b2640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1f2c0676a0 0x7f1f2c071dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:39.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.825+0000 7f1f320b2640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f2c0c8cc0 con 0x7f1f2c06caa0 2024-04-25T12:22:39.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.825+0000 7f1f320b2640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f1f2c06ecd0 con 0x7f1f2c0676a0 2024-04-25T12:22:39.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.825+0000 7f1f320b2640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f1f2c06e9f0 con 0x7f1f2c14f8a0 2024-04-25T12:22:39.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.825+0000 7f1f2affd640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1f2c0676a0 0x7f1f2c071dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:39.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.825+0000 7f1f2bfff640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f1f2c06caa0 0x7f1f2c073870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:42106/0 (socket says 172.21.15.86:42106) 2024-04-25T12:22:39.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.825+0000 7f1f2affd640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1f2c0676a0 0x7f1f2c071dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37682/0 (socket says 172.21.15.86:37682) 2024-04-25T12:22:39.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.825+0000 7f1f2bfff640 1 -- 172.21.15.86:0/2243996592 learned_addr learned my addr 172.21.15.86:0/2243996592 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-04-25T12:22:39.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.825+0000 7f1f2b7fe640 1 --2- 172.21.15.86:0/2243996592 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1f2c14f8a0 0x7f1f2c071890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:39.831 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.825+0000 7f1f2affd640 1 -- 172.21.15.86:0/2243996592 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1f2c14f8a0 msgr2=0x7f1f2c071890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:39.831 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.825+0000 7f1f2affd640 1 --2- 172.21.15.86:0/2243996592 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1f2c14f8a0 0x7f1f2c071890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:39.831 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.825+0000 7f1f2affd640 1 -- 172.21.15.86:0/2243996592 >> v1:172.21.15.86:6789/0 conn(0x7f1f2c06caa0 legacy=0x7f1f2c073870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:39.831 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.825+0000 7f1f2affd640 1 -- 172.21.15.86:0/2243996592 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f2c0c8f60 con 0x7f1f2c0676a0 2024-04-25T12:22:39.831 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.825+0000 7f1f2a7fc640 1 -- 172.21.15.86:0/2243996592 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2779261291 0 0) 0x7f1f2c0c8cc0 con 0x7f1f2c06caa0 2024-04-25T12:22:39.831 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.825+0000 7f1f2b7fe640 1 --2- 172.21.15.86:0/2243996592 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1f2c14f8a0 0x7f1f2c071890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:22:39.832 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.829+0000 7f1f2affd640 1 --2- 172.21.15.86:0/2243996592 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1f2c0676a0 0x7f1f2c071dd0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f1f200097c0 tx=0x7f1f2001ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b74d9189ade97fc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:39.833 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.829+0000 7f1f2a7fc640 1 -- 172.21.15.86:0/2243996592 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f200b5070 con 0x7f1f2c0676a0 2024-04-25T12:22:39.833 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.829+0000 7f1f2a7fc640 1 -- 172.21.15.86:0/2243996592 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f200a8990 con 0x7f1f2c0676a0 2024-04-25T12:22:39.833 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.829+0000 7f1f2a7fc640 1 -- 172.21.15.86:0/2243996592 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f200a8d60 con 0x7f1f2c0676a0 2024-04-25T12:22:39.833 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.829+0000 7f1f320b2640 1 -- 172.21.15.86:0/2243996592 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1f2c0676a0 msgr2=0x7f1f2c071dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:39.833 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.829+0000 7f1f320b2640 1 --2- 172.21.15.86:0/2243996592 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1f2c0676a0 0x7f1f2c071dd0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f1f200097c0 tx=0x7f1f2001ec90 comp rx=0 tx=0).stop 2024-04-25T12:22:39.833 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.829+0000 7f1f320b2640 1 -- 172.21.15.86:0/2243996592 shutdown_connections 2024-04-25T12:22:39.833 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.829+0000 7f1f320b2640 1 --2- 172.21.15.86:0/2243996592 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1f2c0676a0 0x7f1f2c071dd0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:39.833 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.829+0000 7f1f320b2640 1 --2- 172.21.15.86:0/2243996592 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1f2c14f8a0 0x7f1f2c071890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:39.834 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.829+0000 7f1f320b2640 1 -- 172.21.15.86:0/2243996592 >> 172.21.15.86:0/2243996592 conn(0x7f1f2c06f2a0 msgr2=0x7f1f2c06f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:39.834 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.829+0000 7f1f320b2640 1 -- 172.21.15.86:0/2243996592 shutdown_connections 2024-04-25T12:22:39.834 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.829+0000 7f1f320b2640 1 -- 172.21.15.86:0/2243996592 wait complete. 2024-04-25T12:22:39.836 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.829+0000 7f1f320b2640 1 Processor -- start 2024-04-25T12:22:39.836 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.829+0000 7f1f320b2640 1 -- start start 2024-04-25T12:22:39.836 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.829+0000 7f1f320b2640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1f2c0676a0 0x7f1f2c155f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:39.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.829+0000 7f1f320b2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f2c06caa0 0x7f1f2c154b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:39.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.829+0000 7f1f320b2640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1f2c14f8a0 0x7f1f2c155080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:39.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.829+0000 7f1f320b2640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1f2c14fc80 con 0x7f1f2c0676a0 2024-04-25T12:22:39.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.829+0000 7f1f320b2640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1f2c0c9520 con 0x7f1f2c06caa0 2024-04-25T12:22:39.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.829+0000 7f1f320b2640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f1f2c14fe00 con 0x7f1f2c14f8a0 2024-04-25T12:22:39.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.829+0000 7f1f2b7fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1f2c0676a0 0x7f1f2c155f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:39.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.829+0000 7f1f2b7fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1f2c0676a0 0x7f1f2c155f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37692/0 (socket says 172.21.15.86:37692) 2024-04-25T12:22:39.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.829+0000 7f1f2b7fe640 1 -- 172.21.15.86:0/3186567062 learned_addr learned my addr 172.21.15.86:0/3186567062 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:39.838 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.833+0000 7f1f2bfff640 1 --2- 172.21.15.86:0/3186567062 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1f2c14f8a0 0x7f1f2c155080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:39.838 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.833+0000 7f1f2b7fe640 1 -- 172.21.15.86:0/3186567062 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1f2c14f8a0 msgr2=0x7f1f2c155080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:39.838 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.833+0000 7f1f2affd640 1 --2- 172.21.15.86:0/3186567062 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f2c06caa0 0x7f1f2c154b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:39.838 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.833+0000 7f1f2b7fe640 1 --2- 172.21.15.86:0/3186567062 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1f2c14f8a0 0x7f1f2c155080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:39.838 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.833+0000 7f1f2b7fe640 1 -- 172.21.15.86:0/3186567062 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f2c06caa0 msgr2=0x7f1f2c154b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:39.838 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.833+0000 7f1f2b7fe640 1 --2- 172.21.15.86:0/3186567062 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f2c06caa0 0x7f1f2c154b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:39.838 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.833+0000 7f1f2b7fe640 1 -- 172.21.15.86:0/3186567062 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f2c069440 con 0x7f1f2c0676a0 2024-04-25T12:22:39.838 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.833+0000 7f1f2b7fe640 1 --2- 172.21.15.86:0/3186567062 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1f2c0676a0 0x7f1f2c155f70 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c00c7f0 tx=0x7f1f1c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:39.839 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.833+0000 7f1f13fff640 1 -- 172.21.15.86:0/3186567062 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f1c015070 con 0x7f1f2c0676a0 2024-04-25T12:22:39.839 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.833+0000 7f1f13fff640 1 -- 172.21.15.86:0/3186567062 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f1c007820 con 0x7f1f2c0676a0 2024-04-25T12:22:39.839 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.833+0000 7f1f13fff640 1 -- 172.21.15.86:0/3186567062 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f1c007c10 con 0x7f1f2c0676a0 2024-04-25T12:22:39.839 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.833+0000 7f1f320b2640 1 -- 172.21.15.86:0/3186567062 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f2c1541f0 con 0x7f1f2c0676a0 2024-04-25T12:22:39.839 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.833+0000 7f1f320b2640 1 -- 172.21.15.86:0/3186567062 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f2c153f10 con 0x7f1f2c0676a0 2024-04-25T12:22:39.839 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.833+0000 7f1f320b2640 1 -- 172.21.15.86:0/3186567062 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f2c075df0 con 0x7f1f2c0676a0 2024-04-25T12:22:39.840 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.833+0000 7f1f13fff640 1 -- 172.21.15.86:0/3186567062 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1f1c018070 con 0x7f1f2c0676a0 2024-04-25T12:22:39.840 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.833+0000 7f1f13fff640 1 --2- 172.21.15.86:0/3186567062 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f1f18068380 0x7f1f1806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:39.840 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.833+0000 7f1f2affd640 1 --2- 172.21.15.86:0/3186567062 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f1f18068380 0x7f1f1806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:39.840 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.833+0000 7f1f13fff640 1 -- 172.21.15.86:0/3186567062 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f1f1c086e80 con 0x7f1f2c0676a0 2024-04-25T12:22:39.840 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.833+0000 7f1f2affd640 1 --2- 172.21.15.86:0/3186567062 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f1f18068380 0x7f1f1806a840 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1f200b2000 tx=0x7f1f200aa070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:39.842 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.837+0000 7f1f13fff640 1 -- 172.21.15.86:0/3186567062 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1f1c0570d0 con 0x7f1f2c0676a0 2024-04-25T12:22:40.002 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:39.997+0000 7f1f320b2640 1 -- 172.21.15.86:0/3186567062 --> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f1f2c153b60 con 0x7f1f18068380 2024-04-25T12:22:40.003 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.001+0000 7f1f13fff640 1 -- 172.21.15.86:0/3186567062 <== mgr.4107 v2:172.21.15.86:6832/3708662606 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f1f2c153b60 con 0x7f1f18068380 2024-04-25T12:22:40.003 INFO:teuthology.orchestra.run.smithi086.stderr:instructed osd(s) 3 to deep-scrub 2024-04-25T12:22:40.006 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.001+0000 7f1f320b2640 1 -- 172.21.15.86:0/3186567062 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f1f18068380 msgr2=0x7f1f1806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:40.006 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.001+0000 7f1f320b2640 1 --2- 172.21.15.86:0/3186567062 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f1f18068380 0x7f1f1806a840 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1f200b2000 tx=0x7f1f200aa070 comp rx=0 tx=0).stop 2024-04-25T12:22:40.006 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.001+0000 7f1f320b2640 1 -- 172.21.15.86:0/3186567062 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1f2c0676a0 msgr2=0x7f1f2c155f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:40.006 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.001+0000 7f1f320b2640 1 --2- 172.21.15.86:0/3186567062 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1f2c0676a0 0x7f1f2c155f70 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c00c7f0 tx=0x7f1f1c00ccb0 comp rx=0 tx=0).stop 2024-04-25T12:22:40.006 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.001+0000 7f1f320b2640 1 -- 172.21.15.86:0/3186567062 shutdown_connections 2024-04-25T12:22:40.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.001+0000 7f1f320b2640 1 --2- 172.21.15.86:0/3186567062 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1f2c14f8a0 0x7f1f2c155080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:40.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.001+0000 7f1f320b2640 1 --2- 172.21.15.86:0/3186567062 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f2c06caa0 0x7f1f2c154b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:40.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.001+0000 7f1f320b2640 1 --2- 172.21.15.86:0/3186567062 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f1f18068380 0x7f1f1806a840 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:40.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.001+0000 7f1f320b2640 1 --2- 172.21.15.86:0/3186567062 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1f2c0676a0 0x7f1f2c155f70 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:40.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.001+0000 7f1f320b2640 1 -- 172.21.15.86:0/3186567062 >> 172.21.15.86:0/3186567062 conn(0x7f1f2c06f2a0 msgr2=0x7f1f2c14e4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:40.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.001+0000 7f1f320b2640 1 -- 172.21.15.86:0/3186567062 shutdown_connections 2024-04-25T12:22:40.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.001+0000 7f1f320b2640 1 -- 172.21.15.86:0/3186567062 wait complete. 2024-04-25T12:22:40.023 INFO:tasks.ceph:Scrubbing osd.4 2024-04-25T12:22:40.023 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-25T12:22:40.143 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.141+0000 7f3ea5aa2640 1 Processor -- start 2024-04-25T12:22:40.144 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.141+0000 7f3ea5aa2640 1 -- start start 2024-04-25T12:22:40.145 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.141+0000 7f3ea5aa2640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3ea00c5fa0 0x7f3ea015ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:40.145 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.141+0000 7f3ea5aa2640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3ea015d340 0x7f3ea0152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:40.145 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.141+0000 7f3ea5aa2640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3ea00c6380 0x7f3ea0153230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:40.145 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.141+0000 7f3ea5aa2640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f3ea0153770 con 0x7f3ea00c5fa0 2024-04-25T12:22:40.145 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.141+0000 7f3ea5aa2640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f3ea00c8890 con 0x7f3ea015d340 2024-04-25T12:22:40.145 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.141+0000 7f3ea5aa2640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f3ea015c970 con 0x7f3ea00c6380 2024-04-25T12:22:40.146 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.141+0000 7f3e9f7fe640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3ea00c5fa0 0x7f3ea015ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:40.146 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.141+0000 7f3e9f7fe640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3ea00c5fa0 0x7f3ea015ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37694/0 (socket says 172.21.15.86:37694) 2024-04-25T12:22:40.146 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.141+0000 7f3e9f7fe640 1 -- 172.21.15.86:0/2837602343 learned_addr learned my addr 172.21.15.86:0/2837602343 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:40.146 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.141+0000 7f3e9effd640 1 --2- 172.21.15.86:0/2837602343 >> v2:172.21.15.134:3300/0 conn(0x7f3ea015d340 0x7f3ea0152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:40.146 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.141+0000 7f3e9ffff640 1 --2- 172.21.15.86:0/2837602343 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3ea00c6380 0x7f3ea0153230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:40.146 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.141+0000 7f3e9f7fe640 1 -- 172.21.15.86:0/2837602343 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3ea00c6380 msgr2=0x7f3ea0153230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:40.147 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.141+0000 7f3e9f7fe640 1 --2- 172.21.15.86:0/2837602343 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3ea00c6380 0x7f3ea0153230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:40.147 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.141+0000 7f3e9f7fe640 1 -- 172.21.15.86:0/2837602343 >> v2:172.21.15.134:3300/0 conn(0x7f3ea015d340 msgr2=0x7f3ea0152cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:40.147 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.141+0000 7f3e9f7fe640 1 --2- 172.21.15.86:0/2837602343 >> v2:172.21.15.134:3300/0 conn(0x7f3ea015d340 0x7f3ea0152cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:40.147 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.141+0000 7f3e9f7fe640 1 -- 172.21.15.86:0/2837602343 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ea006ce60 con 0x7f3ea00c5fa0 2024-04-25T12:22:40.147 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.141+0000 7f3e9effd640 1 --2- 172.21.15.86:0/2837602343 >> v2:172.21.15.134:3300/0 conn(0x7f3ea015d340 0x7f3ea0152cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:22:40.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.145+0000 7f3e9f7fe640 1 --2- 172.21.15.86:0/2837602343 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ea00c5fa0 0x7f3ea015ce00 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3ea006f8c0 tx=0x7f3e9001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1433bb594fd34abf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:40.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.145+0000 7f3e9e7fc640 1 -- 172.21.15.86:0/2837602343 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e900b2070 con 0x7f3ea00c5fa0 2024-04-25T12:22:40.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.145+0000 7f3e9e7fc640 1 -- 172.21.15.86:0/2837602343 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e900ad640 con 0x7f3ea00c5fa0 2024-04-25T12:22:40.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.145+0000 7f3e9e7fc640 1 -- 172.21.15.86:0/2837602343 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e900ada10 con 0x7f3ea00c5fa0 2024-04-25T12:22:40.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.145+0000 7f3ea5aa2640 1 -- 172.21.15.86:0/2837602343 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ea00c5fa0 msgr2=0x7f3ea015ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:40.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.145+0000 7f3ea5aa2640 1 --2- 172.21.15.86:0/2837602343 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ea00c5fa0 0x7f3ea015ce00 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3ea006f8c0 tx=0x7f3e9001c3d0 comp rx=0 tx=0).stop 2024-04-25T12:22:40.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.145+0000 7f3ea5aa2640 1 -- 172.21.15.86:0/2837602343 shutdown_connections 2024-04-25T12:22:40.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.145+0000 7f3ea5aa2640 1 --2- 172.21.15.86:0/2837602343 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3ea00c6380 0x7f3ea0153230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:40.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.145+0000 7f3ea5aa2640 1 --2- 172.21.15.86:0/2837602343 >> v2:172.21.15.134:3300/0 conn(0x7f3ea015d340 0x7f3ea0152cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:40.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.145+0000 7f3ea5aa2640 1 --2- 172.21.15.86:0/2837602343 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ea00c5fa0 0x7f3ea015ce00 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:40.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.145+0000 7f3ea5aa2640 1 -- 172.21.15.86:0/2837602343 >> 172.21.15.86:0/2837602343 conn(0x7f3ea00c9130 msgr2=0x7f3ea00c9540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:40.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.145+0000 7f3ea5aa2640 1 -- 172.21.15.86:0/2837602343 shutdown_connections 2024-04-25T12:22:40.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.145+0000 7f3ea5aa2640 1 -- 172.21.15.86:0/2837602343 wait complete. 2024-04-25T12:22:40.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.145+0000 7f3ea5aa2640 1 Processor -- start 2024-04-25T12:22:40.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.145+0000 7f3ea5aa2640 1 -- start start 2024-04-25T12:22:40.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.145+0000 7f3ea5aa2640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ea00c5fa0 0x7f3ea0157bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:40.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.145+0000 7f3ea5aa2640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3ea00c6380 0x7f3ea015aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:40.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.145+0000 7f3ea5aa2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ea015d340 0x7f3ea0151a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:40.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.145+0000 7f3ea5aa2640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea006ca90 con 0x7f3ea00c5fa0 2024-04-25T12:22:40.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.145+0000 7f3ea5aa2640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea0159010 con 0x7f3ea015d340 2024-04-25T12:22:40.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.145+0000 7f3ea5aa2640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f3ea006cc10 con 0x7f3ea00c6380 2024-04-25T12:22:40.153 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.145+0000 7f3e9f7fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ea00c5fa0 0x7f3ea0157bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:40.153 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.145+0000 7f3e9f7fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ea00c5fa0 0x7f3ea0157bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37704/0 (socket says 172.21.15.86:37704) 2024-04-25T12:22:40.153 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.145+0000 7f3e9f7fe640 1 -- 172.21.15.86:0/2432423697 learned_addr learned my addr 172.21.15.86:0/2432423697 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:40.153 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.145+0000 7f3e9effd640 1 --2- 172.21.15.86:0/2432423697 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3ea00c6380 0x7f3ea015aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:40.153 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.145+0000 7f3e9ffff640 1 --2- 172.21.15.86:0/2432423697 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ea015d340 0x7f3ea0151a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:40.153 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.145+0000 7f3e9f7fe640 1 -- 172.21.15.86:0/2432423697 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3ea00c6380 msgr2=0x7f3ea015aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:40.153 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.145+0000 7f3e9f7fe640 1 --2- 172.21.15.86:0/2432423697 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3ea00c6380 0x7f3ea015aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:40.153 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.145+0000 7f3e9f7fe640 1 -- 172.21.15.86:0/2432423697 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ea015d340 msgr2=0x7f3ea0151a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:40.153 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.145+0000 7f3e9f7fe640 1 --2- 172.21.15.86:0/2432423697 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ea015d340 0x7f3ea0151a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:40.153 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.145+0000 7f3e9f7fe640 1 -- 172.21.15.86:0/2432423697 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ea015be30 con 0x7f3ea00c5fa0 2024-04-25T12:22:40.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.145+0000 7f3e9ffff640 1 --2- 172.21.15.86:0/2432423697 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ea015d340 0x7f3ea0151a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:22:40.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.145+0000 7f3e9f7fe640 1 --2- 172.21.15.86:0/2432423697 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ea00c5fa0 0x7f3ea0157bf0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f3e9001cc70 tx=0x7f3e90019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:40.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.145+0000 7f3e87fff640 1 -- 172.21.15.86:0/2432423697 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e900b2040 con 0x7f3ea00c5fa0 2024-04-25T12:22:40.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.145+0000 7f3e87fff640 1 -- 172.21.15.86:0/2432423697 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e900bb070 con 0x7f3ea00c5fa0 2024-04-25T12:22:40.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.145+0000 7f3ea5aa2640 1 -- 172.21.15.86:0/2432423697 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ea0153430 con 0x7f3ea00c5fa0 2024-04-25T12:22:40.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.145+0000 7f3e87fff640 1 -- 172.21.15.86:0/2432423697 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e900b68a0 con 0x7f3ea00c5fa0 2024-04-25T12:22:40.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.145+0000 7f3ea5aa2640 1 -- 172.21.15.86:0/2432423697 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ea0157110 con 0x7f3ea00c5fa0 2024-04-25T12:22:40.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.149+0000 7f3ea5aa2640 1 -- 172.21.15.86:0/2432423697 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3ea0075e60 con 0x7f3ea00c5fa0 2024-04-25T12:22:40.156 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.149+0000 7f3e87fff640 1 -- 172.21.15.86:0/2432423697 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3e900ad500 con 0x7f3ea00c5fa0 2024-04-25T12:22:40.156 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.149+0000 7f3e87fff640 1 --2- 172.21.15.86:0/2432423697 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f3e8c0683b0 0x7f3e8c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:40.156 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.149+0000 7f3e87fff640 1 -- 172.21.15.86:0/2432423697 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f3e90121840 con 0x7f3ea00c5fa0 2024-04-25T12:22:40.156 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.149+0000 7f3e9effd640 1 --2- 172.21.15.86:0/2432423697 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f3e8c0683b0 0x7f3e8c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:40.156 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.149+0000 7f3e87fff640 1 --2- 172.21.15.86:0/2432423697 >> [v2:172.21.15.134:6800/1872913602,v1:172.21.15.134:6802/1872913602] conn(0x7f3e8c071dd0 0x7f3e8c074270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:40.156 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.149+0000 7f3e87fff640 1 -- 172.21.15.86:0/2432423697 --> [v2:172.21.15.134:6800/1872913602,v1:172.21.15.134:6802/1872913602] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3e8c074940 con 0x7f3e8c071dd0 2024-04-25T12:22:40.156 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.149+0000 7f3e87fff640 1 -- 172.21.15.86:0/2432423697 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f3e90121cd0 con 0x7f3ea00c5fa0 2024-04-25T12:22:40.157 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.149+0000 7f3e9effd640 1 --2- 172.21.15.86:0/2432423697 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f3e8c0683b0 0x7f3e8c06a870 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3ea015c520 tx=0x7f3e94008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:40.157 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.149+0000 7f3e9ffff640 1 --2- 172.21.15.86:0/2432423697 >> [v2:172.21.15.134:6800/1872913602,v1:172.21.15.134:6802/1872913602] conn(0x7f3e8c071dd0 0x7f3e8c074270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:40.157 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.149+0000 7f3e9ffff640 1 --2- 172.21.15.86:0/2432423697 >> [v2:172.21.15.134:6800/1872913602,v1:172.21.15.134:6802/1872913602] conn(0x7f3e8c071dd0 0x7f3e8c074270 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:40.157 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.153+0000 7f3e87fff640 1 -- 172.21.15.86:0/2432423697 <== osd.4 v2:172.21.15.134:6800/1872913602 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3e8c074940 con 0x7f3e8c071dd0 2024-04-25T12:22:40.168 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.165+0000 7f3ea5aa2640 1 -- 172.21.15.86:0/2432423697 --> [v2:172.21.15.134:6800/1872913602,v1:172.21.15.134:6802/1872913602] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f3ea00c1340 con 0x7f3e8c071dd0 2024-04-25T12:22:40.169 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.165+0000 7f3e87fff640 1 -- 172.21.15.86:0/2432423697 <== osd.4 v2:172.21.15.134:6800/1872913602 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f3ea00c1340 con 0x7f3e8c071dd0 2024-04-25T12:22:40.169 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-25T12:22:40.169 INFO:teuthology.orchestra.run.smithi086.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T12:22:40.169 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-25T12:22:40.170 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.165+0000 7f3ea5aa2640 1 -- 172.21.15.86:0/2432423697 >> [v2:172.21.15.134:6800/1872913602,v1:172.21.15.134:6802/1872913602] conn(0x7f3e8c071dd0 msgr2=0x7f3e8c074270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:40.170 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.165+0000 7f3ea5aa2640 1 --2- 172.21.15.86:0/2432423697 >> [v2:172.21.15.134:6800/1872913602,v1:172.21.15.134:6802/1872913602] conn(0x7f3e8c071dd0 0x7f3e8c074270 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:40.170 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.165+0000 7f3ea5aa2640 1 -- 172.21.15.86:0/2432423697 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f3e8c0683b0 msgr2=0x7f3e8c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:40.171 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.165+0000 7f3ea5aa2640 1 --2- 172.21.15.86:0/2432423697 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f3e8c0683b0 0x7f3e8c06a870 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3ea015c520 tx=0x7f3e94008040 comp rx=0 tx=0).stop 2024-04-25T12:22:40.171 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.165+0000 7f3ea5aa2640 1 -- 172.21.15.86:0/2432423697 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ea00c5fa0 msgr2=0x7f3ea0157bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:40.171 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.165+0000 7f3ea5aa2640 1 --2- 172.21.15.86:0/2432423697 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ea00c5fa0 0x7f3ea0157bf0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f3e9001cc70 tx=0x7f3e90019170 comp rx=0 tx=0).stop 2024-04-25T12:22:40.171 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.165+0000 7f3e9ffff640 1 -- 172.21.15.86:0/2432423697 reap_dead start 2024-04-25T12:22:40.171 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.165+0000 7f3ea5aa2640 1 -- 172.21.15.86:0/2432423697 shutdown_connections 2024-04-25T12:22:40.171 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.165+0000 7f3ea5aa2640 1 -- 172.21.15.86:0/2432423697 >> 172.21.15.86:0/2432423697 conn(0x7f3ea00c9130 msgr2=0x7f3ea00c9510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:40.171 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.165+0000 7f3ea5aa2640 1 -- 172.21.15.86:0/2432423697 shutdown_connections 2024-04-25T12:22:40.171 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.165+0000 7f3ea5aa2640 1 -- 172.21.15.86:0/2432423697 wait complete. 2024-04-25T12:22:40.185 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-25T12:22:40.295 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.293+0000 7fcb05d0d640 1 Processor -- start 2024-04-25T12:22:40.295 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.293+0000 7fcb05d0d640 1 -- start start 2024-04-25T12:22:40.298 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.293+0000 7fcb05d0d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcb00074190 0x7fcb00072370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:40.299 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.293+0000 7fcb05d0d640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb001580e0 con 0x7fcb000c6ba0 2024-04-25T12:22:40.299 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.293+0000 7fcb05d0d640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb00071980 con 0x7fcb00151a60 2024-04-25T12:22:40.299 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.293+0000 7fcb05d0d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fcb000c0c40 con 0x7fcb00074190 2024-04-25T12:22:40.299 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.293+0000 7fcafeffd640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fcb000c6ba0 0x7fcb00071c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:42114/0 (socket says 172.21.15.86:42114) 2024-04-25T12:22:40.299 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.293+0000 7fcafeffd640 1 -- 172.21.15.86:0/3730335883 learned_addr learned my addr 172.21.15.86:0/3730335883 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-04-25T12:22:40.299 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.293+0000 7fcafffff640 1 --2- 172.21.15.86:0/3730335883 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcb00074190 0x7fcb00072370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:40.299 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.293+0000 7fcafe7fc640 1 -- 172.21.15.86:0/3730335883 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2144699113 0 0) 0x7fcb001580e0 con 0x7fcb000c6ba0 2024-04-25T12:22:40.299 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.293+0000 7fcafe7fc640 1 -- 172.21.15.86:0/3730335883 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcae8003530 con 0x7fcb000c6ba0 2024-04-25T12:22:40.300 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.293+0000 7fcafe7fc640 1 -- 172.21.15.86:0/3730335883 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2589214498 0 0) 0x7fcae8003530 con 0x7fcb000c6ba0 2024-04-25T12:22:40.300 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.293+0000 7fcafe7fc640 1 -- 172.21.15.86:0/3730335883 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcb00074190 msgr2=0x7fcb00072370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:40.300 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.293+0000 7fcafe7fc640 1 --2- 172.21.15.86:0/3730335883 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcb00074190 0x7fcb00072370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:40.300 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.293+0000 7fcafe7fc640 1 -- 172.21.15.86:0/3730335883 >> v1:172.21.15.134:6789/0 conn(0x7fcb00151a60 legacy=0x7fcb000c9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:40.300 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.293+0000 7fcafe7fc640 1 -- 172.21.15.86:0/3730335883 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb00158380 con 0x7fcb000c6ba0 2024-04-25T12:22:40.300 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.293+0000 7fcafe7fc640 1 -- 172.21.15.86:0/3730335883 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1387950573 0 0) 0x7fcaf4001680 con 0x7fcb000c6ba0 2024-04-25T12:22:40.300 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.293+0000 7fcafe7fc640 1 -- 172.21.15.86:0/3730335883 >> v1:172.21.15.86:6789/0 conn(0x7fcb000c6ba0 legacy=0x7fcb00071c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:40.300 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.293+0000 7fcafe7fc640 1 --2- 172.21.15.86:0/3730335883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcae80039f0 0x7fcae8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:40.300 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.293+0000 7fcafe7fc640 1 --2- 172.21.15.86:0/3730335883 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcb00074190 0x7fcae8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:40.301 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.293+0000 7fcafe7fc640 1 --2- 172.21.15.86:0/3730335883 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcae8004d50 0x7fcae80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:40.301 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.293+0000 7fcafe7fc640 1 -- 172.21.15.86:0/3730335883 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fcae800bb60 con 0x7fcae8004d50 2024-04-25T12:22:40.301 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.293+0000 7fcafe7fc640 1 -- 172.21.15.86:0/3730335883 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fcae800bce0 con 0x7fcae80039f0 2024-04-25T12:22:40.301 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.293+0000 7fcafe7fc640 1 -- 172.21.15.86:0/3730335883 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fcae800bee0 con 0x7fcb00074190 2024-04-25T12:22:40.301 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.293+0000 7fcafffff640 1 --2- 172.21.15.86:0/3730335883 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcae8004d50 0x7fcae80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:40.301 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.293+0000 7fcaff7fe640 1 --2- 172.21.15.86:0/3730335883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcae80039f0 0x7fcae8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:40.301 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.293+0000 7fcafeffd640 1 --2- 172.21.15.86:0/3730335883 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcb00074190 0x7fcae8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:40.301 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.293+0000 7fcafffff640 1 -- 172.21.15.86:0/3730335883 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcb00074190 msgr2=0x7fcae8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:40.302 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.293+0000 7fcafffff640 1 --2- 172.21.15.86:0/3730335883 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcb00074190 0x7fcae8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:40.302 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.293+0000 7fcafffff640 1 -- 172.21.15.86:0/3730335883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcae80039f0 msgr2=0x7fcae8003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:40.302 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.293+0000 7fcafffff640 1 --2- 172.21.15.86:0/3730335883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcae80039f0 0x7fcae8003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:40.302 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.293+0000 7fcafffff640 1 -- 172.21.15.86:0/3730335883 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcae8003530 con 0x7fcae8004d50 2024-04-25T12:22:40.302 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.293+0000 7fcafeffd640 1 --2- 172.21.15.86:0/3730335883 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcb00074190 0x7fcae8004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:22:40.305 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.297+0000 7fcafffff640 1 --2- 172.21.15.86:0/3730335883 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcae8004d50 0x7fcae80051d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fcaf800f270 tx=0x7fcaf801dd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f86be94f8798f06f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:40.306 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.297+0000 7fcafe7fc640 1 -- 172.21.15.86:0/3730335883 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf800ad00 con 0x7fcae8004d50 2024-04-25T12:22:40.306 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.297+0000 7fcafe7fc640 1 -- 172.21.15.86:0/3730335883 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcaf80a6b60 con 0x7fcae8004d50 2024-04-25T12:22:40.306 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.297+0000 7fcafe7fc640 1 -- 172.21.15.86:0/3730335883 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf8008440 con 0x7fcae8004d50 2024-04-25T12:22:40.306 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.297+0000 7fcb05d0d640 1 -- 172.21.15.86:0/3730335883 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcae8004d50 msgr2=0x7fcae80051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:40.306 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.297+0000 7fcb05d0d640 1 --2- 172.21.15.86:0/3730335883 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcae8004d50 0x7fcae80051d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fcaf800f270 tx=0x7fcaf801dd60 comp rx=0 tx=0).stop 2024-04-25T12:22:40.306 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.297+0000 7fcafffff640 1 -- 172.21.15.86:0/3730335883 reap_dead start 2024-04-25T12:22:40.306 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.297+0000 7fcb05d0d640 1 -- 172.21.15.86:0/3730335883 shutdown_connections 2024-04-25T12:22:40.307 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.297+0000 7fcb05d0d640 1 -- 172.21.15.86:0/3730335883 >> 172.21.15.86:0/3730335883 conn(0x7fcb0006f280 msgr2=0x7fcb0006f690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:40.307 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.297+0000 7fcb05d0d640 1 -- 172.21.15.86:0/3730335883 shutdown_connections 2024-04-25T12:22:40.307 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.297+0000 7fcb05d0d640 1 -- 172.21.15.86:0/3730335883 wait complete. 2024-04-25T12:22:40.307 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.297+0000 7fcb05d0d640 1 Processor -- start 2024-04-25T12:22:40.307 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.297+0000 7fcb05d0d640 1 -- start start 2024-04-25T12:22:40.307 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.297+0000 7fcb05d0d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcae8004d50 0x7fcb000c4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:40.307 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.297+0000 7fcb05d0d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcb000c5b00 0x7fcb001f1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:40.307 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.297+0000 7fcb05d0d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb000c5f60 0x7fcb001f1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:40.307 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.297+0000 7fcb05d0d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fcb000c9840 con 0x7fcb000c5f60 2024-04-25T12:22:40.308 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.297+0000 7fcb05d0d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fcb0006e720 con 0x7fcae8004d50 2024-04-25T12:22:40.308 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.297+0000 7fcb05d0d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fcb000c7320 con 0x7fcb000c5b00 2024-04-25T12:22:40.308 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.301+0000 7fcafffff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb000c5f60 0x7fcb001f1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:40.308 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.301+0000 7fcafffff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb000c5f60 0x7fcb001f1d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37724/0 (socket says 172.21.15.86:37724) 2024-04-25T12:22:40.308 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.301+0000 7fcafffff640 1 -- 172.21.15.86:0/1033195415 learned_addr learned my addr 172.21.15.86:0/1033195415 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:40.308 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.301+0000 7fcaff7fe640 1 --2- 172.21.15.86:0/1033195415 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcae8004d50 0x7fcb000c4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:40.308 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.301+0000 7fcafeffd640 1 --2- 172.21.15.86:0/1033195415 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcb000c5b00 0x7fcb001f1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:40.308 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.301+0000 7fcafffff640 1 -- 172.21.15.86:0/1033195415 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcb000c5b00 msgr2=0x7fcb001f1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:40.308 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.301+0000 7fcafffff640 1 --2- 172.21.15.86:0/1033195415 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcb000c5b00 0x7fcb001f1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:40.309 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.301+0000 7fcafffff640 1 -- 172.21.15.86:0/1033195415 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcae8004d50 msgr2=0x7fcb000c4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:40.309 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.301+0000 7fcafffff640 1 --2- 172.21.15.86:0/1033195415 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcae8004d50 0x7fcb000c4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:40.309 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.301+0000 7fcafffff640 1 -- 172.21.15.86:0/1033195415 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb0014efe0 con 0x7fcb000c5f60 2024-04-25T12:22:40.309 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.301+0000 7fcafeffd640 1 --2- 172.21.15.86:0/1033195415 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcb000c5b00 0x7fcb001f1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:22:40.309 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.301+0000 7fcafffff640 1 --2- 172.21.15.86:0/1033195415 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb000c5f60 0x7fcb001f1d90 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fcaf801db90 tx=0x7fcaf800a860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:40.309 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.301+0000 7fcae7fff640 1 -- 172.21.15.86:0/1033195415 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf800ad00 con 0x7fcb000c5f60 2024-04-25T12:22:40.309 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.301+0000 7fcae7fff640 1 -- 172.21.15.86:0/1033195415 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcaf80bb070 con 0x7fcb000c5f60 2024-04-25T12:22:40.309 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.301+0000 7fcb05d0d640 1 -- 172.21.15.86:0/1033195415 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb0014f2c0 con 0x7fcb000c5f60 2024-04-25T12:22:40.309 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.301+0000 7fcae7fff640 1 -- 172.21.15.86:0/1033195415 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf8008cf0 con 0x7fcb000c5f60 2024-04-25T12:22:40.310 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.301+0000 7fcb05d0d640 1 -- 172.21.15.86:0/1033195415 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb0014f880 con 0x7fcb000c5f60 2024-04-25T12:22:40.310 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.301+0000 7fcb05d0d640 1 -- 172.21.15.86:0/1033195415 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb00075df0 con 0x7fcb000c5f60 2024-04-25T12:22:40.310 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.301+0000 7fcae7fff640 1 -- 172.21.15.86:0/1033195415 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcaf80b5070 con 0x7fcb000c5f60 2024-04-25T12:22:40.310 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.301+0000 7fcae7fff640 1 --2- 172.21.15.86:0/1033195415 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fcaec0683b0 0x7fcaec06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:40.310 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.301+0000 7fcaff7fe640 1 --2- 172.21.15.86:0/1033195415 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fcaec0683b0 0x7fcaec06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:40.310 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.301+0000 7fcae7fff640 1 -- 172.21.15.86:0/1033195415 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fcaf8121560 con 0x7fcb000c5f60 2024-04-25T12:22:40.311 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.301+0000 7fcaff7fe640 1 --2- 172.21.15.86:0/1033195415 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fcaec0683b0 0x7fcaec06a870 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0005510 tx=0x7fcaf0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:40.311 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.305+0000 7fcae7fff640 1 -- 172.21.15.86:0/1033195415 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcaf80c5020 con 0x7fcb000c5f60 2024-04-25T12:22:40.464 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.461+0000 7fcb05d0d640 1 -- 172.21.15.86:0/1033195415 --> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fcb000c8f10 con 0x7fcaec0683b0 2024-04-25T12:22:40.465 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.461+0000 7fcae7fff640 1 -- 172.21.15.86:0/1033195415 <== mgr.4107 v2:172.21.15.86:6832/3708662606 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fcb000c8f10 con 0x7fcaec0683b0 2024-04-25T12:22:40.465 INFO:teuthology.orchestra.run.smithi086.stderr:instructed osd(s) 4 to deep-scrub 2024-04-25T12:22:40.467 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.461+0000 7fcb05d0d640 1 -- 172.21.15.86:0/1033195415 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fcaec0683b0 msgr2=0x7fcaec06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:40.467 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.461+0000 7fcb05d0d640 1 --2- 172.21.15.86:0/1033195415 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fcaec0683b0 0x7fcaec06a870 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0005510 tx=0x7fcaf0009040 comp rx=0 tx=0).stop 2024-04-25T12:22:40.467 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.461+0000 7fcb05d0d640 1 -- 172.21.15.86:0/1033195415 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb000c5f60 msgr2=0x7fcb001f1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:40.468 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.461+0000 7fcb05d0d640 1 --2- 172.21.15.86:0/1033195415 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb000c5f60 0x7fcb001f1d90 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fcaf801db90 tx=0x7fcaf800a860 comp rx=0 tx=0).stop 2024-04-25T12:22:40.468 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.461+0000 7fcb05d0d640 1 -- 172.21.15.86:0/1033195415 shutdown_connections 2024-04-25T12:22:40.468 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.461+0000 7fcb05d0d640 1 --2- 172.21.15.86:0/1033195415 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fcaec0683b0 0x7fcaec06a870 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:40.468 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.461+0000 7fcb05d0d640 1 --2- 172.21.15.86:0/1033195415 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb000c5f60 0x7fcb001f1d90 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:40.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.461+0000 7fcb05d0d640 1 --2- 172.21.15.86:0/1033195415 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcb000c5b00 0x7fcb001f1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:40.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.461+0000 7fcb05d0d640 1 --2- 172.21.15.86:0/1033195415 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcae8004d50 0x7fcb000c4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:40.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.461+0000 7fcb05d0d640 1 -- 172.21.15.86:0/1033195415 >> 172.21.15.86:0/1033195415 conn(0x7fcb0006f280 msgr2=0x7fcb001568c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:40.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.465+0000 7fcb05d0d640 1 -- 172.21.15.86:0/1033195415 shutdown_connections 2024-04-25T12:22:40.470 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.465+0000 7fcb05d0d640 1 -- 172.21.15.86:0/1033195415 wait complete. 2024-04-25T12:22:40.482 INFO:tasks.ceph:Scrubbing osd.5 2024-04-25T12:22:40.482 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-25T12:22:40.596 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.593+0000 7f49b3182640 1 Processor -- start 2024-04-25T12:22:40.596 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.593+0000 7f49b3182640 1 -- start start 2024-04-25T12:22:40.599 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.593+0000 7f49b3182640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f49ac0cc950 0x7f49ac0cc370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:40.599 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.593+0000 7f49b3182640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f49ac0cceb0 0x7f49ac06d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:40.599 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.593+0000 7f49b3182640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49ac155730 con 0x7f49ac155350 2024-04-25T12:22:40.599 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.593+0000 7f49b3182640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f49ac15e670 con 0x7f49ac0cc950 2024-04-25T12:22:40.599 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.593+0000 7f49b3182640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f49ac15e950 con 0x7f49ac0cceb0 2024-04-25T12:22:40.599 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.593+0000 7f49b0f1e640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f49ac155350 0x7f49ac0cb5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:42120/0 (socket says 172.21.15.86:42120) 2024-04-25T12:22:40.600 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.593+0000 7f49b0f1e640 1 -- 172.21.15.86:0/2966799130 learned_addr learned my addr 172.21.15.86:0/2966799130 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-04-25T12:22:40.600 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.593+0000 7f49ab7fe640 1 -- 172.21.15.86:0/2966799130 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1957055145 0 0) 0x7f49ac155730 con 0x7f49ac155350 2024-04-25T12:22:40.600 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.593+0000 7f49ab7fe640 1 -- 172.21.15.86:0/2966799130 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4994003530 con 0x7f49ac155350 2024-04-25T12:22:40.600 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.593+0000 7f49b171f640 1 --2- 172.21.15.86:0/2966799130 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f49ac0cceb0 0x7f49ac06d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:40.600 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.593+0000 7f49abfff640 1 --2- 172.21.15.86:0/2966799130 >> v2:172.21.15.134:3300/0 conn(0x7f49ac0cc950 0x7f49ac0cc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:40.600 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.593+0000 7f49ab7fe640 1 -- 172.21.15.86:0/2966799130 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 726354503 0 0) 0x7f4994003530 con 0x7f49ac155350 2024-04-25T12:22:40.600 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.593+0000 7f49ab7fe640 1 -- 172.21.15.86:0/2966799130 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f49ac0cceb0 msgr2=0x7f49ac06d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:40.600 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.593+0000 7f49ab7fe640 1 --2- 172.21.15.86:0/2966799130 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f49ac0cceb0 0x7f49ac06d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:40.601 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.593+0000 7f49ab7fe640 1 -- 172.21.15.86:0/2966799130 >> v2:172.21.15.134:3300/0 conn(0x7f49ac0cc950 msgr2=0x7f49ac0cc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:40.601 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.593+0000 7f49ab7fe640 1 --2- 172.21.15.86:0/2966799130 >> v2:172.21.15.134:3300/0 conn(0x7f49ac0cc950 0x7f49ac0cc370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:40.601 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.593+0000 7f49ab7fe640 1 -- 172.21.15.86:0/2966799130 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49ac15ec30 con 0x7f49ac155350 2024-04-25T12:22:40.601 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.593+0000 7f49ab7fe640 1 -- 172.21.15.86:0/2966799130 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1387950573 0 0) 0x7f499c001680 con 0x7f49ac155350 2024-04-25T12:22:40.601 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.593+0000 7f49ab7fe640 1 -- 172.21.15.86:0/2966799130 >> v1:172.21.15.86:6789/0 conn(0x7f49ac155350 legacy=0x7f49ac0cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:40.601 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.593+0000 7f49ab7fe640 1 --2- 172.21.15.86:0/2966799130 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49940039c0 0x7f4994003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:40.601 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.593+0000 7f49ab7fe640 1 --2- 172.21.15.86:0/2966799130 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4994004810 0x7f4994004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:40.601 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.593+0000 7f49ab7fe640 1 --2- 172.21.15.86:0/2966799130 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f49ac0cceb0 0x7f49940051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:40.601 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.593+0000 7f49ab7fe640 1 -- 172.21.15.86:0/2966799130 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f49ac15e670 con 0x7f49940039c0 2024-04-25T12:22:40.602 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.593+0000 7f49ab7fe640 1 -- 172.21.15.86:0/2966799130 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f49ac15e950 con 0x7f4994004810 2024-04-25T12:22:40.602 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.593+0000 7f49ab7fe640 1 -- 172.21.15.86:0/2966799130 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f499400ba80 con 0x7f49ac0cceb0 2024-04-25T12:22:40.602 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.593+0000 7f49b0f1e640 1 --2- 172.21.15.86:0/2966799130 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49940039c0 0x7f4994003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:40.602 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.593+0000 7f49abfff640 1 --2- 172.21.15.86:0/2966799130 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4994004810 0x7f4994004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:40.602 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.593+0000 7f49b171f640 1 --2- 172.21.15.86:0/2966799130 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f49ac0cceb0 0x7f49940051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:40.602 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.593+0000 7f49b0f1e640 1 -- 172.21.15.86:0/2966799130 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f49ac0cceb0 msgr2=0x7f49940051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:40.602 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.593+0000 7f49b0f1e640 1 --2- 172.21.15.86:0/2966799130 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f49ac0cceb0 0x7f49940051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:40.602 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.593+0000 7f49b0f1e640 1 -- 172.21.15.86:0/2966799130 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4994004810 msgr2=0x7f4994004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:40.602 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.593+0000 7f49b0f1e640 1 --2- 172.21.15.86:0/2966799130 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4994004810 0x7f4994004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:40.603 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.593+0000 7f49b0f1e640 1 -- 172.21.15.86:0/2966799130 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4994003530 con 0x7f49940039c0 2024-04-25T12:22:40.607 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.597+0000 7f49b0f1e640 1 --2- 172.21.15.86:0/2966799130 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49940039c0 0x7f4994003de0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f499c00c210 tx=0x7f499c01cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f3a08c3d9438866 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:40.607 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.597+0000 7f49ab7fe640 1 -- 172.21.15.86:0/2966799130 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f499c007d40 con 0x7f49940039c0 2024-04-25T12:22:40.607 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.597+0000 7f49ab7fe640 1 -- 172.21.15.86:0/2966799130 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f499c0a9020 con 0x7f49940039c0 2024-04-25T12:22:40.607 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.597+0000 7f49ab7fe640 1 -- 172.21.15.86:0/2966799130 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f499c005ae0 con 0x7f49940039c0 2024-04-25T12:22:40.607 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.597+0000 7f49b3182640 1 -- 172.21.15.86:0/2966799130 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49940039c0 msgr2=0x7f4994003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:40.608 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.597+0000 7f49b3182640 1 --2- 172.21.15.86:0/2966799130 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49940039c0 0x7f4994003de0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f499c00c210 tx=0x7f499c01cc60 comp rx=0 tx=0).stop 2024-04-25T12:22:40.608 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.597+0000 7f49b171f640 1 -- 172.21.15.86:0/2966799130 reap_dead start 2024-04-25T12:22:40.608 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.597+0000 7f49b3182640 1 -- 172.21.15.86:0/2966799130 shutdown_connections 2024-04-25T12:22:40.608 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.597+0000 7f49b3182640 1 -- 172.21.15.86:0/2966799130 >> 172.21.15.86:0/2966799130 conn(0x7f49ac06bf00 msgr2=0x7f49ac073100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:40.608 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.597+0000 7f49b3182640 1 -- 172.21.15.86:0/2966799130 shutdown_connections 2024-04-25T12:22:40.608 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.597+0000 7f49b3182640 1 -- 172.21.15.86:0/2966799130 wait complete. 2024-04-25T12:22:40.608 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.597+0000 7f49b3182640 1 Processor -- start 2024-04-25T12:22:40.608 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.597+0000 7f49b3182640 1 -- start start 2024-04-25T12:22:40.608 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.597+0000 7f49b3182640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f49940039c0 0x7f49ac148640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:40.609 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.597+0000 7f49b3182640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49ac0c9a30 0x7f49ac1f4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:40.609 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.597+0000 7f49b3182640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49ac1f4970 0x7f49ac1f7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:40.609 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.597+0000 7f49b3182640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f49ac165ae0 con 0x7f49ac1f4970 2024-04-25T12:22:40.609 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.597+0000 7f49b3182640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f49ac165960 con 0x7f49ac0c9a30 2024-04-25T12:22:40.609 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.597+0000 7f49b3182640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f49ac165c60 con 0x7f49940039c0 2024-04-25T12:22:40.609 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.597+0000 7f49b171f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49ac1f4970 0x7f49ac1f7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:40.609 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.597+0000 7f49b171f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49ac1f4970 0x7f49ac1f7370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37738/0 (socket says 172.21.15.86:37738) 2024-04-25T12:22:40.609 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.597+0000 7f49b171f640 1 -- 172.21.15.86:0/1259472294 learned_addr learned my addr 172.21.15.86:0/1259472294 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:40.610 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.601+0000 7f49b0f1e640 1 --2- 172.21.15.86:0/1259472294 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f49940039c0 0x7f49ac148640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:40.610 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.601+0000 7f49abfff640 1 --2- 172.21.15.86:0/1259472294 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49ac0c9a30 0x7f49ac1f4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:40.610 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.601+0000 7f49b171f640 1 -- 172.21.15.86:0/1259472294 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f49940039c0 msgr2=0x7f49ac148640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:40.610 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.601+0000 7f49b171f640 1 --2- 172.21.15.86:0/1259472294 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f49940039c0 0x7f49ac148640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:40.610 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.601+0000 7f49b171f640 1 -- 172.21.15.86:0/1259472294 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49ac0c9a30 msgr2=0x7f49ac1f4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:40.610 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.601+0000 7f49b171f640 1 --2- 172.21.15.86:0/1259472294 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49ac0c9a30 0x7f49ac1f4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:40.610 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.601+0000 7f49b171f640 1 -- 172.21.15.86:0/1259472294 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49ac15c1e0 con 0x7f49ac1f4970 2024-04-25T12:22:40.610 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.601+0000 7f49abfff640 1 --2- 172.21.15.86:0/1259472294 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49ac0c9a30 0x7f49ac1f4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:22:40.610 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.601+0000 7f49b171f640 1 --2- 172.21.15.86:0/1259472294 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49ac1f4970 0x7f49ac1f7370 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f49ac0caff0 tx=0x7f49a4009d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:40.611 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.601+0000 7f49a97fa640 1 -- 172.21.15.86:0/1259472294 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49a4019070 con 0x7f49ac1f4970 2024-04-25T12:22:40.611 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.601+0000 7f49a97fa640 1 -- 172.21.15.86:0/1259472294 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49a4007cb0 con 0x7f49ac1f4970 2024-04-25T12:22:40.611 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.601+0000 7f49b3182640 1 -- 172.21.15.86:0/1259472294 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49ac152540 con 0x7f49ac1f4970 2024-04-25T12:22:40.611 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.601+0000 7f49a97fa640 1 -- 172.21.15.86:0/1259472294 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49a4007e60 con 0x7f49ac1f4970 2024-04-25T12:22:40.611 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.601+0000 7f49b3182640 1 -- 172.21.15.86:0/1259472294 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49ac0caa50 con 0x7f49ac1f4970 2024-04-25T12:22:40.611 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.601+0000 7f49b3182640 1 -- 172.21.15.86:0/1259472294 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f49ac075e60 con 0x7f49ac1f4970 2024-04-25T12:22:40.611 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.601+0000 7f49a97fa640 1 -- 172.21.15.86:0/1259472294 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f49a401c070 con 0x7f49ac1f4970 2024-04-25T12:22:40.611 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.601+0000 7f49a97fa640 1 --2- 172.21.15.86:0/1259472294 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f4998068380 0x7f499806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:40.611 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.601+0000 7f49a97fa640 1 -- 172.21.15.86:0/1259472294 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f49a4087490 con 0x7f49ac1f4970 2024-04-25T12:22:40.612 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.601+0000 7f49b0f1e640 1 --2- 172.21.15.86:0/1259472294 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f4998068380 0x7f499806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:40.612 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.601+0000 7f49a97fa640 1 --2- 172.21.15.86:0/1259472294 >> [v2:172.21.15.134:6801/2261413981,v1:172.21.15.134:6803/2261413981] conn(0x7f4998071da0 0x7f4998074240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:40.612 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.601+0000 7f49a97fa640 1 -- 172.21.15.86:0/1259472294 --> [v2:172.21.15.134:6801/2261413981,v1:172.21.15.134:6803/2261413981] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f49a4021e50 con 0x7f4998071da0 2024-04-25T12:22:40.612 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.601+0000 7f49a97fa640 1 -- 172.21.15.86:0/1259472294 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f49a4087920 con 0x7f49ac1f4970 2024-04-25T12:22:40.612 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.601+0000 7f49abfff640 1 --2- 172.21.15.86:0/1259472294 >> [v2:172.21.15.134:6801/2261413981,v1:172.21.15.134:6803/2261413981] conn(0x7f4998071da0 0x7f4998074240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:40.612 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.601+0000 7f49b0f1e640 1 --2- 172.21.15.86:0/1259472294 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f4998068380 0x7f499806a840 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f499c0aa000 tx=0x7f49ac0b48d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:40.612 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.605+0000 7f49abfff640 1 --2- 172.21.15.86:0/1259472294 >> [v2:172.21.15.134:6801/2261413981,v1:172.21.15.134:6803/2261413981] conn(0x7f4998071da0 0x7f4998074240 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:40.613 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.605+0000 7f49a97fa640 1 -- 172.21.15.86:0/1259472294 <== osd.5 v2:172.21.15.134:6801/2261413981 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f49a4021e50 con 0x7f4998071da0 2024-04-25T12:22:40.621 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.617+0000 7f49b3182640 1 -- 172.21.15.86:0/1259472294 --> [v2:172.21.15.134:6801/2261413981,v1:172.21.15.134:6803/2261413981] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f49ac069180 con 0x7f4998071da0 2024-04-25T12:22:40.622 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.617+0000 7f49a97fa640 1 -- 172.21.15.86:0/1259472294 <== osd.5 v2:172.21.15.134:6801/2261413981 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f49ac069180 con 0x7f4998071da0 2024-04-25T12:22:40.623 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-25T12:22:40.623 INFO:teuthology.orchestra.run.smithi086.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T12:22:40.623 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-25T12:22:40.625 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.617+0000 7f49b3182640 1 -- 172.21.15.86:0/1259472294 >> [v2:172.21.15.134:6801/2261413981,v1:172.21.15.134:6803/2261413981] conn(0x7f4998071da0 msgr2=0x7f4998074240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:40.626 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.617+0000 7f49b3182640 1 --2- 172.21.15.86:0/1259472294 >> [v2:172.21.15.134:6801/2261413981,v1:172.21.15.134:6803/2261413981] conn(0x7f4998071da0 0x7f4998074240 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:40.626 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.617+0000 7f49b3182640 1 -- 172.21.15.86:0/1259472294 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f4998068380 msgr2=0x7f499806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:40.627 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.617+0000 7f49b3182640 1 --2- 172.21.15.86:0/1259472294 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f4998068380 0x7f499806a840 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f499c0aa000 tx=0x7f49ac0b48d0 comp rx=0 tx=0).stop 2024-04-25T12:22:40.627 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.617+0000 7f49b3182640 1 -- 172.21.15.86:0/1259472294 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49ac1f4970 msgr2=0x7f49ac1f7370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:40.627 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.617+0000 7f49b3182640 1 --2- 172.21.15.86:0/1259472294 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49ac1f4970 0x7f49ac1f7370 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f49ac0caff0 tx=0x7f49a4009d40 comp rx=0 tx=0).stop 2024-04-25T12:22:40.627 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.617+0000 7f49b171f640 1 -- 172.21.15.86:0/1259472294 reap_dead start 2024-04-25T12:22:40.627 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.617+0000 7f49b3182640 1 -- 172.21.15.86:0/1259472294 shutdown_connections 2024-04-25T12:22:40.627 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.617+0000 7f49b3182640 1 -- 172.21.15.86:0/1259472294 >> 172.21.15.86:0/1259472294 conn(0x7f49ac06bf00 msgr2=0x7f49ac0b57a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:40.627 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.617+0000 7f49b3182640 1 -- 172.21.15.86:0/1259472294 shutdown_connections 2024-04-25T12:22:40.627 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.617+0000 7f49b3182640 1 -- 172.21.15.86:0/1259472294 wait complete. 2024-04-25T12:22:40.637 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-25T12:22:40.745 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.741+0000 7fed3dcfd640 1 Processor -- start 2024-04-25T12:22:40.745 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.741+0000 7fed3dcfd640 1 -- start start 2024-04-25T12:22:40.746 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.741+0000 7fed3dcfd640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fed3814fbc0 0x7fed3806f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:40.746 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.741+0000 7fed3dcfd640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fed38074100 0x7fed380c7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:40.747 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.741+0000 7fed3dcfd640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed380c5d70 con 0x7fed3814ffa0 2024-04-25T12:22:40.747 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.741+0000 7fed3dcfd640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7fed380c6050 con 0x7fed3814fbc0 2024-04-25T12:22:40.747 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.741+0000 7fed3dcfd640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fed380c6330 con 0x7fed38074100 2024-04-25T12:22:40.747 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.741+0000 7fed377fe640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fed3814fbc0 0x7fed3806f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:40.747 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.741+0000 7fed377fe640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fed3814fbc0 0x7fed3806f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37748/0 (socket says 172.21.15.86:37748) 2024-04-25T12:22:40.747 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.741+0000 7fed377fe640 1 -- 172.21.15.86:0/2499157370 learned_addr learned my addr 172.21.15.86:0/2499157370 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:40.747 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.741+0000 7fed37fff640 1 --2- 172.21.15.86:0/2499157370 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fed38074100 0x7fed380c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:40.747 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.741+0000 7fed377fe640 1 -- 172.21.15.86:0/2499157370 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fed38074100 msgr2=0x7fed380c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:40.748 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.741+0000 7fed377fe640 1 --2- 172.21.15.86:0/2499157370 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fed38074100 0x7fed380c7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:40.748 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.741+0000 7fed377fe640 1 -- 172.21.15.86:0/2499157370 >> v1:172.21.15.134:6789/0 conn(0x7fed3814ffa0 legacy=0x7fed380c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:40.748 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.741+0000 7fed377fe640 1 -- 172.21.15.86:0/2499157370 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed380c6610 con 0x7fed3814fbc0 2024-04-25T12:22:40.749 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.745+0000 7fed377fe640 1 --2- 172.21.15.86:0/2499157370 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed3814fbc0 0x7fed3806f700 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fed28009870 tx=0x7fed2801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=269df0767bb4d0aa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:40.749 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.745+0000 7fed367fc640 1 -- 172.21.15.86:0/2499157370 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed280aa660 con 0x7fed3814fbc0 2024-04-25T12:22:40.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.745+0000 7fed367fc640 1 -- 172.21.15.86:0/2499157370 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed280af070 con 0x7fed3814fbc0 2024-04-25T12:22:40.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.745+0000 7fed367fc640 1 -- 172.21.15.86:0/2499157370 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed280aaa20 con 0x7fed3814fbc0 2024-04-25T12:22:40.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.745+0000 7fed3dcfd640 1 -- 172.21.15.86:0/2499157370 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed3814fbc0 msgr2=0x7fed3806f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:40.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.745+0000 7fed3dcfd640 1 --2- 172.21.15.86:0/2499157370 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed3814fbc0 0x7fed3806f700 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fed28009870 tx=0x7fed2801c520 comp rx=0 tx=0).stop 2024-04-25T12:22:40.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.745+0000 7fed3dcfd640 1 -- 172.21.15.86:0/2499157370 shutdown_connections 2024-04-25T12:22:40.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.745+0000 7fed3dcfd640 1 --2- 172.21.15.86:0/2499157370 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fed38074100 0x7fed380c7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:40.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.745+0000 7fed3dcfd640 1 --2- 172.21.15.86:0/2499157370 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed3814fbc0 0x7fed3806f700 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:40.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.745+0000 7fed3dcfd640 1 -- 172.21.15.86:0/2499157370 >> 172.21.15.86:0/2499157370 conn(0x7fed3806b9d0 msgr2=0x7fed3806bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:40.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.745+0000 7fed3dcfd640 1 -- 172.21.15.86:0/2499157370 shutdown_connections 2024-04-25T12:22:40.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.745+0000 7fed3dcfd640 1 -- 172.21.15.86:0/2499157370 wait complete. 2024-04-25T12:22:40.754 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.745+0000 7fed3dcfd640 1 Processor -- start 2024-04-25T12:22:40.754 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.745+0000 7fed3dcfd640 1 -- start start 2024-04-25T12:22:40.755 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.745+0000 7fed3dcfd640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fed38074100 0x7fed3814b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:40.755 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.745+0000 7fed3dcfd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed3814fbc0 0x7fed381f76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:40.755 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.745+0000 7fed3dcfd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed3814ffa0 0x7fed381f7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:40.755 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.745+0000 7fed3dcfd640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fed380c8ab0 con 0x7fed3814ffa0 2024-04-25T12:22:40.755 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.745+0000 7fed3dcfd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fed380c8930 con 0x7fed3814fbc0 2024-04-25T12:22:40.755 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.745+0000 7fed3dcfd640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fed38166090 con 0x7fed38074100 2024-04-25T12:22:40.755 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.749+0000 7fed37fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed3814ffa0 0x7fed381f7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:40.755 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.749+0000 7fed37fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed3814ffa0 0x7fed381f7bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37762/0 (socket says 172.21.15.86:37762) 2024-04-25T12:22:40.755 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.749+0000 7fed37fff640 1 -- 172.21.15.86:0/946744022 learned_addr learned my addr 172.21.15.86:0/946744022 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:40.756 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.749+0000 7fed377fe640 1 --2- 172.21.15.86:0/946744022 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fed38074100 0x7fed3814b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:40.756 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.749+0000 7fed36ffd640 1 --2- 172.21.15.86:0/946744022 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed3814fbc0 0x7fed381f76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:40.756 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.749+0000 7fed37fff640 1 -- 172.21.15.86:0/946744022 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fed38074100 msgr2=0x7fed3814b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:40.756 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.749+0000 7fed37fff640 1 --2- 172.21.15.86:0/946744022 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fed38074100 0x7fed3814b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:40.756 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.749+0000 7fed37fff640 1 -- 172.21.15.86:0/946744022 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed3814fbc0 msgr2=0x7fed381f76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:40.756 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.749+0000 7fed37fff640 1 --2- 172.21.15.86:0/946744022 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed3814fbc0 0x7fed381f76b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:40.756 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.749+0000 7fed37fff640 1 -- 172.21.15.86:0/946744022 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed380c3ed0 con 0x7fed3814ffa0 2024-04-25T12:22:40.756 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.749+0000 7fed37fff640 1 --2- 172.21.15.86:0/946744022 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed3814ffa0 0x7fed381f7bf0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fed3000cdc0 tx=0x7fed3000a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:40.756 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.749+0000 7fed1ffff640 1 -- 172.21.15.86:0/946744022 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed30003ba0 con 0x7fed3814ffa0 2024-04-25T12:22:40.757 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.749+0000 7fed1ffff640 1 -- 172.21.15.86:0/946744022 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed30003d60 con 0x7fed3814ffa0 2024-04-25T12:22:40.757 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.749+0000 7fed3dcfd640 1 -- 172.21.15.86:0/946744022 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed380c4670 con 0x7fed3814ffa0 2024-04-25T12:22:40.757 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.749+0000 7fed1ffff640 1 -- 172.21.15.86:0/946744022 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed30004260 con 0x7fed3814ffa0 2024-04-25T12:22:40.757 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.749+0000 7fed3dcfd640 1 -- 172.21.15.86:0/946744022 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed380c4c30 con 0x7fed3814ffa0 2024-04-25T12:22:40.757 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.749+0000 7fed3dcfd640 1 -- 172.21.15.86:0/946744022 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed38075df0 con 0x7fed3814ffa0 2024-04-25T12:22:40.757 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.749+0000 7fed1ffff640 1 -- 172.21.15.86:0/946744022 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fed30004400 con 0x7fed3814ffa0 2024-04-25T12:22:40.757 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.749+0000 7fed1ffff640 1 --2- 172.21.15.86:0/946744022 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fed24068380 0x7fed2406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:40.757 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.749+0000 7fed1ffff640 1 -- 172.21.15.86:0/946744022 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fed30087880 con 0x7fed3814ffa0 2024-04-25T12:22:40.757 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.749+0000 7fed377fe640 1 --2- 172.21.15.86:0/946744022 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fed24068380 0x7fed2406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:40.758 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.749+0000 7fed377fe640 1 --2- 172.21.15.86:0/946744022 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fed24068380 0x7fed2406a840 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fed280ae000 tx=0x7fed280a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:40.758 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.753+0000 7fed1ffff640 1 -- 172.21.15.86:0/946744022 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fed30057a40 con 0x7fed3814ffa0 2024-04-25T12:22:40.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.905+0000 7fed3dcfd640 1 -- 172.21.15.86:0/946744022 --> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fed380c7df0 con 0x7fed24068380 2024-04-25T12:22:40.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.905+0000 7fed1ffff640 1 -- 172.21.15.86:0/946744022 <== mgr.4107 v2:172.21.15.86:6832/3708662606 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fed380c7df0 con 0x7fed24068380 2024-04-25T12:22:40.908 INFO:teuthology.orchestra.run.smithi086.stderr:instructed osd(s) 5 to deep-scrub 2024-04-25T12:22:40.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.905+0000 7fed3dcfd640 1 -- 172.21.15.86:0/946744022 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fed24068380 msgr2=0x7fed2406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:40.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.905+0000 7fed3dcfd640 1 --2- 172.21.15.86:0/946744022 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fed24068380 0x7fed2406a840 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fed280ae000 tx=0x7fed280a7000 comp rx=0 tx=0).stop 2024-04-25T12:22:40.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.905+0000 7fed3dcfd640 1 -- 172.21.15.86:0/946744022 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed3814ffa0 msgr2=0x7fed381f7bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:40.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.905+0000 7fed3dcfd640 1 --2- 172.21.15.86:0/946744022 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed3814ffa0 0x7fed381f7bf0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fed3000cdc0 tx=0x7fed3000a660 comp rx=0 tx=0).stop 2024-04-25T12:22:40.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.905+0000 7fed3dcfd640 1 -- 172.21.15.86:0/946744022 shutdown_connections 2024-04-25T12:22:40.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.905+0000 7fed3dcfd640 1 --2- 172.21.15.86:0/946744022 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fed24068380 0x7fed2406a840 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:40.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.905+0000 7fed3dcfd640 1 --2- 172.21.15.86:0/946744022 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed3814ffa0 0x7fed381f7bf0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:40.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.905+0000 7fed3dcfd640 1 --2- 172.21.15.86:0/946744022 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed3814fbc0 0x7fed381f76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:40.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.905+0000 7fed3dcfd640 1 --2- 172.21.15.86:0/946744022 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fed38074100 0x7fed3814b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:40.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.905+0000 7fed3dcfd640 1 -- 172.21.15.86:0/946744022 >> 172.21.15.86:0/946744022 conn(0x7fed3806b9d0 msgr2=0x7fed3806e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:40.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.905+0000 7fed3dcfd640 1 -- 172.21.15.86:0/946744022 shutdown_connections 2024-04-25T12:22:40.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:40.905+0000 7fed3dcfd640 1 -- 172.21.15.86:0/946744022 wait complete. 2024-04-25T12:22:40.925 INFO:tasks.ceph:Scrubbing osd.6 2024-04-25T12:22:40.926 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-25T12:22:41.046 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.041+0000 7f1e5cf5d640 1 Processor -- start 2024-04-25T12:22:41.047 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.041+0000 7f1e5cf5d640 1 -- start start 2024-04-25T12:22:41.049 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.045+0000 7f1e5cf5d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1e58151670 0x7f1e5806cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:41.049 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.045+0000 7f1e5cf5d640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e580c8520 con 0x7f1e580c26d0 2024-04-25T12:22:41.050 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.045+0000 7f1e5cf5d640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e580c7f70 con 0x7f1e5806d4f0 2024-04-25T12:22:41.050 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.045+0000 7f1e5cf5d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f1e580c8240 con 0x7f1e58151670 2024-04-25T12:22:41.050 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.045+0000 7f1e56d9d640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f1e580c26d0 0x7f1e58157b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:42124/0 (socket says 172.21.15.86:42124) 2024-04-25T12:22:41.050 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.045+0000 7f1e56d9d640 1 -- 172.21.15.86:0/1753834156 learned_addr learned my addr 172.21.15.86:0/1753834156 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-04-25T12:22:41.050 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.045+0000 7f1e5659c640 1 --2- 172.21.15.86:0/1753834156 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1e58151670 0x7f1e5806cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:41.050 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.045+0000 7f1e5559a640 1 -- 172.21.15.86:0/1753834156 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1322980880 0 0) 0x7f1e580c8520 con 0x7f1e580c26d0 2024-04-25T12:22:41.050 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.045+0000 7f1e5559a640 1 -- 172.21.15.86:0/1753834156 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e40003530 con 0x7f1e580c26d0 2024-04-25T12:22:41.050 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.045+0000 7f1e5559a640 1 -- 172.21.15.86:0/1753834156 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3031043635 0 0) 0x7f1e40003530 con 0x7f1e580c26d0 2024-04-25T12:22:41.051 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.045+0000 7f1e5559a640 1 -- 172.21.15.86:0/1753834156 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1e58151670 msgr2=0x7f1e5806cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:41.051 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.045+0000 7f1e5559a640 1 --2- 172.21.15.86:0/1753834156 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1e58151670 0x7f1e5806cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:41.051 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.045+0000 7f1e5559a640 1 -- 172.21.15.86:0/1753834156 >> v1:172.21.15.134:6789/0 conn(0x7f1e5806d4f0 legacy=0x7f1e581573f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:41.051 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.045+0000 7f1e5559a640 1 -- 172.21.15.86:0/1753834156 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e580c8e00 con 0x7f1e580c26d0 2024-04-25T12:22:41.051 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.045+0000 7f1e5559a640 1 -- 172.21.15.86:0/1753834156 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1387950573 0 0) 0x7f1e50001a20 con 0x7f1e580c26d0 2024-04-25T12:22:41.051 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.045+0000 7f1e5559a640 1 -- 172.21.15.86:0/1753834156 >> v1:172.21.15.86:6789/0 conn(0x7f1e580c26d0 legacy=0x7f1e58157b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:41.051 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.045+0000 7f1e5559a640 1 --2- 172.21.15.86:0/1753834156 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1e58151670 0x7f1e400039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:41.051 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.045+0000 7f1e5559a640 1 --2- 172.21.15.86:0/1753834156 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e40003f70 0x7f1e40004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:41.051 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.045+0000 7f1e5559a640 1 --2- 172.21.15.86:0/1753834156 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e40004d50 0x7f1e400051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:41.052 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.045+0000 7f1e5559a640 1 -- 172.21.15.86:0/1753834156 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1e580c8240 con 0x7f1e40003f70 2024-04-25T12:22:41.052 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.045+0000 7f1e5559a640 1 -- 172.21.15.86:0/1753834156 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4000cbc0 con 0x7f1e40004d50 2024-04-25T12:22:41.052 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.045+0000 7f1e5559a640 1 -- 172.21.15.86:0/1753834156 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f1e40005a20 con 0x7f1e58151670 2024-04-25T12:22:41.052 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.045+0000 7f1e55d9b640 1 --2- 172.21.15.86:0/1753834156 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e40003f70 0x7f1e40004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:41.052 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.045+0000 7f1e5659c640 1 --2- 172.21.15.86:0/1753834156 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1e58151670 0x7f1e400039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:41.052 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.045+0000 7f1e56d9d640 1 --2- 172.21.15.86:0/1753834156 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e40004d50 0x7f1e400051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:41.052 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.045+0000 7f1e55d9b640 1 -- 172.21.15.86:0/1753834156 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1e58151670 msgr2=0x7f1e400039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:41.052 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.045+0000 7f1e55d9b640 1 --2- 172.21.15.86:0/1753834156 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1e58151670 0x7f1e400039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:41.052 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.045+0000 7f1e55d9b640 1 -- 172.21.15.86:0/1753834156 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e40004d50 msgr2=0x7f1e400051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:41.053 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.045+0000 7f1e55d9b640 1 --2- 172.21.15.86:0/1753834156 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e40004d50 0x7f1e400051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:41.053 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.045+0000 7f1e55d9b640 1 -- 172.21.15.86:0/1753834156 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e40003530 con 0x7f1e40003f70 2024-04-25T12:22:41.056 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.045+0000 7f1e55d9b640 1 --2- 172.21.15.86:0/1753834156 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e40003f70 0x7f1e40004810 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c001750 tx=0x7f1e4c01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35ceef6072504de3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:41.057 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.049+0000 7f1e5559a640 1 -- 172.21.15.86:0/1753834156 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c0013a0 con 0x7f1e40003f70 2024-04-25T12:22:41.057 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.049+0000 7f1e5559a640 1 -- 172.21.15.86:0/1753834156 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e4c0052f0 con 0x7f1e40003f70 2024-04-25T12:22:41.057 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.049+0000 7f1e5559a640 1 -- 172.21.15.86:0/1753834156 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c003840 con 0x7f1e40003f70 2024-04-25T12:22:41.057 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.049+0000 7f1e5cf5d640 1 -- 172.21.15.86:0/1753834156 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e40003f70 msgr2=0x7f1e40004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:41.057 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.049+0000 7f1e5cf5d640 1 --2- 172.21.15.86:0/1753834156 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e40003f70 0x7f1e40004810 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c001750 tx=0x7f1e4c01c3e0 comp rx=0 tx=0).stop 2024-04-25T12:22:41.057 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.049+0000 7f1e56d9d640 1 -- 172.21.15.86:0/1753834156 reap_dead start 2024-04-25T12:22:41.057 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.049+0000 7f1e5cf5d640 1 -- 172.21.15.86:0/1753834156 shutdown_connections 2024-04-25T12:22:41.057 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.049+0000 7f1e5cf5d640 1 -- 172.21.15.86:0/1753834156 >> 172.21.15.86:0/1753834156 conn(0x7f1e580ccfe0 msgr2=0x7f1e580cd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:41.057 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.049+0000 7f1e5cf5d640 1 -- 172.21.15.86:0/1753834156 shutdown_connections 2024-04-25T12:22:41.058 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.049+0000 7f1e5cf5d640 1 -- 172.21.15.86:0/1753834156 wait complete. 2024-04-25T12:22:41.058 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.049+0000 7f1e5cf5d640 1 Processor -- start 2024-04-25T12:22:41.058 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.049+0000 7f1e5cf5d640 1 -- start start 2024-04-25T12:22:41.058 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.049+0000 7f1e5cf5d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1e40003f70 0x7f1e5815abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:41.058 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.049+0000 7f1e5cf5d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e5815b5d0 0x7f1e581ed160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:41.058 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.049+0000 7f1e5cf5d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e58153f70 0x7f1e5814e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:41.058 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.049+0000 7f1e5cf5d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1e58158210 con 0x7f1e5815b5d0 2024-04-25T12:22:41.058 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.049+0000 7f1e5cf5d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1e580c38f0 con 0x7f1e58153f70 2024-04-25T12:22:41.058 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.049+0000 7f1e5cf5d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f1e580c8810 con 0x7f1e40003f70 2024-04-25T12:22:41.059 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.049+0000 7f1e55d9b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e5815b5d0 0x7f1e581ed160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:41.059 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.049+0000 7f1e55d9b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e5815b5d0 0x7f1e581ed160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37786/0 (socket says 172.21.15.86:37786) 2024-04-25T12:22:41.059 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.049+0000 7f1e55d9b640 1 -- 172.21.15.86:0/226965307 learned_addr learned my addr 172.21.15.86:0/226965307 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:41.059 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.049+0000 7f1e5659c640 1 --2- 172.21.15.86:0/226965307 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1e40003f70 0x7f1e5815abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:41.059 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.049+0000 7f1e56d9d640 1 --2- 172.21.15.86:0/226965307 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e58153f70 0x7f1e5814e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:41.059 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.049+0000 7f1e55d9b640 1 -- 172.21.15.86:0/226965307 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1e40003f70 msgr2=0x7f1e5815abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:41.059 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.049+0000 7f1e55d9b640 1 --2- 172.21.15.86:0/226965307 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1e40003f70 0x7f1e5815abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:41.059 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.049+0000 7f1e55d9b640 1 -- 172.21.15.86:0/226965307 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e58153f70 msgr2=0x7f1e5814e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:41.060 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.049+0000 7f1e55d9b640 1 --2- 172.21.15.86:0/226965307 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e58153f70 0x7f1e5814e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:41.060 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.049+0000 7f1e55d9b640 1 -- 172.21.15.86:0/226965307 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e58154f90 con 0x7f1e5815b5d0 2024-04-25T12:22:41.060 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.049+0000 7f1e55d9b640 1 --2- 172.21.15.86:0/226965307 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e5815b5d0 0x7f1e581ed160 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c001750 tx=0x7f1e40005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:41.060 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.049+0000 7f1e46ffd640 1 -- 172.21.15.86:0/226965307 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c0054a0 con 0x7f1e5815b5d0 2024-04-25T12:22:41.060 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.049+0000 7f1e46ffd640 1 -- 172.21.15.86:0/226965307 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e4c0067e0 con 0x7f1e5815b5d0 2024-04-25T12:22:41.060 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.049+0000 7f1e5cf5d640 1 -- 172.21.15.86:0/226965307 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e58154560 con 0x7f1e5815b5d0 2024-04-25T12:22:41.060 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.049+0000 7f1e46ffd640 1 -- 172.21.15.86:0/226965307 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c006990 con 0x7f1e5815b5d0 2024-04-25T12:22:41.060 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.049+0000 7f1e5cf5d640 1 -- 172.21.15.86:0/226965307 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e58154800 con 0x7f1e5815b5d0 2024-04-25T12:22:41.060 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.049+0000 7f1e5cf5d640 1 -- 172.21.15.86:0/226965307 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1e58154a40 con 0x7f1e5815b5d0 2024-04-25T12:22:41.061 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.053+0000 7f1e46ffd640 1 -- 172.21.15.86:0/226965307 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1e4c0bd020 con 0x7f1e5815b5d0 2024-04-25T12:22:41.061 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.053+0000 7f1e46ffd640 1 --2- 172.21.15.86:0/226965307 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f1e380683b0 0x7f1e3806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:41.061 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.053+0000 7f1e5659c640 1 --2- 172.21.15.86:0/226965307 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f1e380683b0 0x7f1e3806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:41.061 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.053+0000 7f1e46ffd640 1 -- 172.21.15.86:0/226965307 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f1e4c120b70 con 0x7f1e5815b5d0 2024-04-25T12:22:41.061 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.053+0000 7f1e46ffd640 1 --2- 172.21.15.86:0/226965307 >> [v2:172.21.15.134:6824/2841082767,v1:172.21.15.134:6825/2841082767] conn(0x7f1e38071dc0 0x7f1e38074260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:41.061 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.053+0000 7f1e46ffd640 1 -- 172.21.15.86:0/226965307 --> [v2:172.21.15.134:6824/2841082767,v1:172.21.15.134:6825/2841082767] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1e4c0052f0 con 0x7f1e38071dc0 2024-04-25T12:22:41.061 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.053+0000 7f1e46ffd640 1 -- 172.21.15.86:0/226965307 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f1e4c123480 con 0x7f1e5815b5d0 2024-04-25T12:22:41.061 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.053+0000 7f1e5659c640 1 --2- 172.21.15.86:0/226965307 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f1e380683b0 0x7f1e3806a870 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1e48009a30 tx=0x7f1e48008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:41.061 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.053+0000 7f1e56d9d640 1 --2- 172.21.15.86:0/226965307 >> [v2:172.21.15.134:6824/2841082767,v1:172.21.15.134:6825/2841082767] conn(0x7f1e38071dc0 0x7f1e38074260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:41.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.053+0000 7f1e56d9d640 1 --2- 172.21.15.86:0/226965307 >> [v2:172.21.15.134:6824/2841082767,v1:172.21.15.134:6825/2841082767] conn(0x7f1e38071dc0 0x7f1e38074260 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:41.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.053+0000 7f1e46ffd640 1 -- 172.21.15.86:0/226965307 <== osd.6 v2:172.21.15.134:6824/2841082767 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1e4c0052f0 con 0x7f1e38071dc0 2024-04-25T12:22:41.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.069+0000 7f1e5cf5d640 1 -- 172.21.15.86:0/226965307 --> [v2:172.21.15.134:6824/2841082767,v1:172.21.15.134:6825/2841082767] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f1e58075e60 con 0x7f1e38071dc0 2024-04-25T12:22:41.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.069+0000 7f1e46ffd640 1 -- 172.21.15.86:0/226965307 <== osd.6 v2:172.21.15.134:6824/2841082767 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f1e58075e60 con 0x7f1e38071dc0 2024-04-25T12:22:41.072 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-25T12:22:41.073 INFO:teuthology.orchestra.run.smithi086.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T12:22:41.073 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-25T12:22:41.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.069+0000 7f1e5cf5d640 1 -- 172.21.15.86:0/226965307 >> [v2:172.21.15.134:6824/2841082767,v1:172.21.15.134:6825/2841082767] conn(0x7f1e38071dc0 msgr2=0x7f1e38074260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:41.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.069+0000 7f1e5cf5d640 1 --2- 172.21.15.86:0/226965307 >> [v2:172.21.15.134:6824/2841082767,v1:172.21.15.134:6825/2841082767] conn(0x7f1e38071dc0 0x7f1e38074260 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:41.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.069+0000 7f1e5cf5d640 1 -- 172.21.15.86:0/226965307 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f1e380683b0 msgr2=0x7f1e3806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:41.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.069+0000 7f1e5cf5d640 1 --2- 172.21.15.86:0/226965307 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f1e380683b0 0x7f1e3806a870 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1e48009a30 tx=0x7f1e48008040 comp rx=0 tx=0).stop 2024-04-25T12:22:41.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.069+0000 7f1e5cf5d640 1 -- 172.21.15.86:0/226965307 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e5815b5d0 msgr2=0x7f1e581ed160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:41.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.069+0000 7f1e5cf5d640 1 --2- 172.21.15.86:0/226965307 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e5815b5d0 0x7f1e581ed160 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c001750 tx=0x7f1e40005840 comp rx=0 tx=0).stop 2024-04-25T12:22:41.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.069+0000 7f1e56d9d640 1 -- 172.21.15.86:0/226965307 reap_dead start 2024-04-25T12:22:41.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.069+0000 7f1e5cf5d640 1 -- 172.21.15.86:0/226965307 shutdown_connections 2024-04-25T12:22:41.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.069+0000 7f1e5cf5d640 1 -- 172.21.15.86:0/226965307 >> 172.21.15.86:0/226965307 conn(0x7f1e580ccfe0 msgr2=0x7f1e580cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:41.075 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.069+0000 7f1e5cf5d640 1 -- 172.21.15.86:0/226965307 shutdown_connections 2024-04-25T12:22:41.075 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.069+0000 7f1e5cf5d640 1 -- 172.21.15.86:0/226965307 wait complete. 2024-04-25T12:22:41.087 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-25T12:22:41.200 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.197+0000 7fc91d96a640 1 Processor -- start 2024-04-25T12:22:41.200 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.197+0000 7fc91d96a640 1 -- start start 2024-04-25T12:22:41.203 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.197+0000 7fc91d96a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc91814f810 0x7fc9180c9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:41.203 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.197+0000 7fc91d96a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc9180c78c0 0x7fc918159470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:41.203 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.197+0000 7fc91d96a640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9180c4c50 con 0x7fc91814fbf0 2024-04-25T12:22:41.203 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.197+0000 7fc91d96a640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fc918158fe0 con 0x7fc9180c78c0 2024-04-25T12:22:41.203 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.197+0000 7fc91d96a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fc9180c4f30 con 0x7fc91814f810 2024-04-25T12:22:41.203 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.197+0000 7fc9167fc640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fc91814fbf0 0x7fc9180cd640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:42126/0 (socket says 172.21.15.86:42126) 2024-04-25T12:22:41.204 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.197+0000 7fc9167fc640 1 -- 172.21.15.86:0/3653820277 learned_addr learned my addr 172.21.15.86:0/3653820277 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-04-25T12:22:41.204 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.197+0000 7fc915ffb640 1 -- 172.21.15.86:0/3653820277 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2322022024 0 0) 0x7fc9180c4c50 con 0x7fc91814fbf0 2024-04-25T12:22:41.204 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.197+0000 7fc915ffb640 1 -- 172.21.15.86:0/3653820277 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc900003530 con 0x7fc91814fbf0 2024-04-25T12:22:41.204 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.197+0000 7fc9177fe640 1 --2- 172.21.15.86:0/3653820277 >> v2:172.21.15.134:3300/0 conn(0x7fc9180c78c0 0x7fc918159470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:41.204 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.197+0000 7fc916ffd640 1 --2- 172.21.15.86:0/3653820277 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc91814f810 0x7fc9180c9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:41.204 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.197+0000 7fc915ffb640 1 -- 172.21.15.86:0/3653820277 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3766617749 0 0) 0x7fc900003530 con 0x7fc91814fbf0 2024-04-25T12:22:41.204 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.197+0000 7fc915ffb640 1 -- 172.21.15.86:0/3653820277 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc91814f810 msgr2=0x7fc9180c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:41.204 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.197+0000 7fc915ffb640 1 --2- 172.21.15.86:0/3653820277 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc91814f810 0x7fc9180c9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:41.204 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.197+0000 7fc915ffb640 1 -- 172.21.15.86:0/3653820277 >> v2:172.21.15.134:3300/0 conn(0x7fc9180c78c0 msgr2=0x7fc918159470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:41.205 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.197+0000 7fc915ffb640 1 --2- 172.21.15.86:0/3653820277 >> v2:172.21.15.134:3300/0 conn(0x7fc9180c78c0 0x7fc918159470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:41.205 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.197+0000 7fc915ffb640 1 -- 172.21.15.86:0/3653820277 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9180c5210 con 0x7fc91814fbf0 2024-04-25T12:22:41.205 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.197+0000 7fc915ffb640 1 -- 172.21.15.86:0/3653820277 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1387950573 0 0) 0x7fc90c001680 con 0x7fc91814fbf0 2024-04-25T12:22:41.205 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.197+0000 7fc915ffb640 1 -- 172.21.15.86:0/3653820277 >> v1:172.21.15.86:6789/0 conn(0x7fc91814fbf0 legacy=0x7fc9180cd640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:41.205 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.197+0000 7fc915ffb640 1 --2- 172.21.15.86:0/3653820277 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc91814f810 0x7fc9000039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:41.205 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.197+0000 7fc915ffb640 1 --2- 172.21.15.86:0/3653820277 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc900003f90 0x7fc900004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:41.205 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.197+0000 7fc915ffb640 1 --2- 172.21.15.86:0/3653820277 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc900004d50 0x7fc9000051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:41.205 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.197+0000 7fc915ffb640 1 -- 172.21.15.86:0/3653820277 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc918158fe0 con 0x7fc900004d50 2024-04-25T12:22:41.205 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.197+0000 7fc915ffb640 1 -- 172.21.15.86:0/3653820277 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc9180c4f30 con 0x7fc900003f90 2024-04-25T12:22:41.206 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.197+0000 7fc915ffb640 1 -- 172.21.15.86:0/3653820277 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fc90000ba80 con 0x7fc91814f810 2024-04-25T12:22:41.206 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.197+0000 7fc9177fe640 1 --2- 172.21.15.86:0/3653820277 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc900004d50 0x7fc9000051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:41.206 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.197+0000 7fc9167fc640 1 --2- 172.21.15.86:0/3653820277 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc900003f90 0x7fc900004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:41.206 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.197+0000 7fc916ffd640 1 --2- 172.21.15.86:0/3653820277 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc91814f810 0x7fc9000039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:41.206 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.197+0000 7fc9177fe640 1 -- 172.21.15.86:0/3653820277 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc91814f810 msgr2=0x7fc9000039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:41.206 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.197+0000 7fc9177fe640 1 --2- 172.21.15.86:0/3653820277 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc91814f810 0x7fc9000039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:41.206 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.197+0000 7fc9177fe640 1 -- 172.21.15.86:0/3653820277 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc900003f90 msgr2=0x7fc900004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:41.206 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.197+0000 7fc9177fe640 1 --2- 172.21.15.86:0/3653820277 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc900003f90 0x7fc900004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:41.206 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.197+0000 7fc9177fe640 1 -- 172.21.15.86:0/3653820277 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc900003530 con 0x7fc900004d50 2024-04-25T12:22:41.209 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.201+0000 7fc9177fe640 1 --2- 172.21.15.86:0/3653820277 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc900004d50 0x7fc9000051d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc910009fc0 tx=0x7fc91001ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44d357a10af004bc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:41.210 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.201+0000 7fc915ffb640 1 -- 172.21.15.86:0/3653820277 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9100b2070 con 0x7fc900004d50 2024-04-25T12:22:41.210 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.201+0000 7fc915ffb640 1 -- 172.21.15.86:0/3653820277 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9100a5cd0 con 0x7fc900004d50 2024-04-25T12:22:41.210 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.201+0000 7fc915ffb640 1 -- 172.21.15.86:0/3653820277 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc910009c10 con 0x7fc900004d50 2024-04-25T12:22:41.210 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.201+0000 7fc91d96a640 1 -- 172.21.15.86:0/3653820277 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc900004d50 msgr2=0x7fc9000051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:41.210 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.201+0000 7fc91d96a640 1 --2- 172.21.15.86:0/3653820277 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc900004d50 0x7fc9000051d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc910009fc0 tx=0x7fc91001ccc0 comp rx=0 tx=0).stop 2024-04-25T12:22:41.210 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.201+0000 7fc9177fe640 1 -- 172.21.15.86:0/3653820277 reap_dead start 2024-04-25T12:22:41.210 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.201+0000 7fc91d96a640 1 -- 172.21.15.86:0/3653820277 shutdown_connections 2024-04-25T12:22:41.211 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.201+0000 7fc91d96a640 1 -- 172.21.15.86:0/3653820277 >> 172.21.15.86:0/3653820277 conn(0x7fc91806fca0 msgr2=0x7fc9180700b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:41.211 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.201+0000 7fc91d96a640 1 -- 172.21.15.86:0/3653820277 shutdown_connections 2024-04-25T12:22:41.211 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.201+0000 7fc91d96a640 1 -- 172.21.15.86:0/3653820277 wait complete. 2024-04-25T12:22:41.211 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.201+0000 7fc91d96a640 1 Processor -- start 2024-04-25T12:22:41.211 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.201+0000 7fc91d96a640 1 -- start start 2024-04-25T12:22:41.211 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.205+0000 7fc91d96a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc900004d50 0x7fc918153a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:41.211 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.205+0000 7fc91d96a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc91815a0a0 0x7fc91815bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:41.211 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.205+0000 7fc91d96a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9180c41d0 0x7fc91815c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:41.211 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.205+0000 7fc91d96a640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc91806bb90 con 0x7fc91815a0a0 2024-04-25T12:22:41.212 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.205+0000 7fc91d96a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc9180c57d0 con 0x7fc900004d50 2024-04-25T12:22:41.212 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.205+0000 7fc91d96a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fc9180cdd50 con 0x7fc9180c41d0 2024-04-25T12:22:41.212 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.205+0000 7fc9167fc640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc91815a0a0 0x7fc91815bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:41.212 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.205+0000 7fc9167fc640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc91815a0a0 0x7fc91815bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37804/0 (socket says 172.21.15.86:37804) 2024-04-25T12:22:41.212 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.205+0000 7fc9167fc640 1 -- 172.21.15.86:0/1241388773 learned_addr learned my addr 172.21.15.86:0/1241388773 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:41.212 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.205+0000 7fc916ffd640 1 --2- 172.21.15.86:0/1241388773 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc900004d50 0x7fc918153a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:41.212 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.205+0000 7fc9177fe640 1 --2- 172.21.15.86:0/1241388773 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9180c41d0 0x7fc91815c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:41.212 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.205+0000 7fc9167fc640 1 -- 172.21.15.86:0/1241388773 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9180c41d0 msgr2=0x7fc91815c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:41.212 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.205+0000 7fc9167fc640 1 --2- 172.21.15.86:0/1241388773 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9180c41d0 0x7fc91815c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:41.212 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.205+0000 7fc9167fc640 1 -- 172.21.15.86:0/1241388773 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc900004d50 msgr2=0x7fc918153a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:41.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.205+0000 7fc9167fc640 1 --2- 172.21.15.86:0/1241388773 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc900004d50 0x7fc918153a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:41.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.205+0000 7fc9167fc640 1 -- 172.21.15.86:0/1241388773 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc91815a850 con 0x7fc91815a0a0 2024-04-25T12:22:41.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.205+0000 7fc9167fc640 1 --2- 172.21.15.86:0/1241388773 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc91815a0a0 0x7fc91815bea0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc90c007370 tx=0x7fc90c007830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:41.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.205+0000 7fc8fffff640 1 -- 172.21.15.86:0/1241388773 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc90c00f960 con 0x7fc91815a0a0 2024-04-25T12:22:41.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.205+0000 7fc8fffff640 1 -- 172.21.15.86:0/1241388773 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc90c018070 con 0x7fc91815a0a0 2024-04-25T12:22:41.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.205+0000 7fc91d96a640 1 -- 172.21.15.86:0/1241388773 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc918148cd0 con 0x7fc91815a0a0 2024-04-25T12:22:41.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.205+0000 7fc8fffff640 1 -- 172.21.15.86:0/1241388773 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc90c00fd40 con 0x7fc91815a0a0 2024-04-25T12:22:41.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.205+0000 7fc91d96a640 1 -- 172.21.15.86:0/1241388773 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc918154670 con 0x7fc91815a0a0 2024-04-25T12:22:41.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.205+0000 7fc91d96a640 1 -- 172.21.15.86:0/1241388773 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc918075df0 con 0x7fc91815a0a0 2024-04-25T12:22:41.214 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.205+0000 7fc8fffff640 1 -- 172.21.15.86:0/1241388773 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc90c01d460 con 0x7fc91815a0a0 2024-04-25T12:22:41.214 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.205+0000 7fc8fffff640 1 --2- 172.21.15.86:0/1241388773 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fc904068380 0x7fc90406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:41.214 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.205+0000 7fc8fffff640 1 -- 172.21.15.86:0/1241388773 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fc90c086de0 con 0x7fc91815a0a0 2024-04-25T12:22:41.215 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.205+0000 7fc916ffd640 1 --2- 172.21.15.86:0/1241388773 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fc904068380 0x7fc90406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:41.215 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.209+0000 7fc916ffd640 1 --2- 172.21.15.86:0/1241388773 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fc904068380 0x7fc90406a840 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc90800b9b0 tx=0x7fc908008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:41.215 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.213+0000 7fc8fffff640 1 -- 172.21.15.86:0/1241388773 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc90c0570f0 con 0x7fc91815a0a0 2024-04-25T12:22:41.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.365+0000 7fc91d96a640 1 -- 172.21.15.86:0/1241388773 --> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fc9180ce5c0 con 0x7fc904068380 2024-04-25T12:22:41.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.365+0000 7fc8fffff640 1 -- 172.21.15.86:0/1241388773 <== mgr.4107 v2:172.21.15.86:6832/3708662606 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc9180ce5c0 con 0x7fc904068380 2024-04-25T12:22:41.371 INFO:teuthology.orchestra.run.smithi086.stderr:instructed osd(s) 6 to deep-scrub 2024-04-25T12:22:41.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.369+0000 7fc91d96a640 1 -- 172.21.15.86:0/1241388773 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fc904068380 msgr2=0x7fc90406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:41.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.369+0000 7fc91d96a640 1 --2- 172.21.15.86:0/1241388773 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fc904068380 0x7fc90406a840 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc90800b9b0 tx=0x7fc908008040 comp rx=0 tx=0).stop 2024-04-25T12:22:41.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.369+0000 7fc91d96a640 1 -- 172.21.15.86:0/1241388773 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc91815a0a0 msgr2=0x7fc91815bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:41.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.369+0000 7fc91d96a640 1 --2- 172.21.15.86:0/1241388773 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc91815a0a0 0x7fc91815bea0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc90c007370 tx=0x7fc90c007830 comp rx=0 tx=0).stop 2024-04-25T12:22:41.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.369+0000 7fc91d96a640 1 -- 172.21.15.86:0/1241388773 shutdown_connections 2024-04-25T12:22:41.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.369+0000 7fc91d96a640 1 --2- 172.21.15.86:0/1241388773 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9180c41d0 0x7fc91815c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:41.374 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.369+0000 7fc91d96a640 1 --2- 172.21.15.86:0/1241388773 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fc904068380 0x7fc90406a840 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:41.374 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.369+0000 7fc91d96a640 1 --2- 172.21.15.86:0/1241388773 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc91815a0a0 0x7fc91815bea0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:41.374 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.369+0000 7fc91d96a640 1 --2- 172.21.15.86:0/1241388773 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc900004d50 0x7fc918153a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:41.374 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.369+0000 7fc91d96a640 1 -- 172.21.15.86:0/1241388773 >> 172.21.15.86:0/1241388773 conn(0x7fc91806fca0 msgr2=0x7fc9180c8950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:41.374 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.369+0000 7fc91d96a640 1 -- 172.21.15.86:0/1241388773 shutdown_connections 2024-04-25T12:22:41.374 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.369+0000 7fc91d96a640 1 -- 172.21.15.86:0/1241388773 wait complete. 2024-04-25T12:22:41.388 INFO:tasks.ceph:Scrubbing osd.7 2024-04-25T12:22:41.388 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-25T12:22:41.502 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.497+0000 7f79948a8640 1 Processor -- start 2024-04-25T12:22:41.502 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.497+0000 7f79948a8640 1 -- start start 2024-04-25T12:22:41.503 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.497+0000 7f79948a8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79901442a0 0x7f79900c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:41.503 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.497+0000 7f79948a8640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f79900cabf0 0x7f799006b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:41.503 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.497+0000 7f79948a8640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f799015b2f0 con 0x7f799006bf10 2024-04-25T12:22:41.504 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.497+0000 7f79948a8640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f7990073ad0 con 0x7f79900cabf0 2024-04-25T12:22:41.504 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.497+0000 7f79948a8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f79900731a0 con 0x7f79901442a0 2024-04-25T12:22:41.504 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.501+0000 7f798dd9b640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f79900cabf0 0x7f799006b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:41.504 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.501+0000 7f798dd9b640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f79900cabf0 0x7f799006b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37816/0 (socket says 172.21.15.86:37816) 2024-04-25T12:22:41.504 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.501+0000 7f798dd9b640 1 -- 172.21.15.86:0/1147157734 learned_addr learned my addr 172.21.15.86:0/1147157734 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:41.504 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.501+0000 7f798e59c640 1 --2- 172.21.15.86:0/1147157734 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79901442a0 0x7f79900c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:41.504 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.501+0000 7f798dd9b640 1 -- 172.21.15.86:0/1147157734 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79901442a0 msgr2=0x7f79900c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:41.504 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.501+0000 7f798dd9b640 1 --2- 172.21.15.86:0/1147157734 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79901442a0 0x7f79900c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:41.504 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.501+0000 7f798dd9b640 1 -- 172.21.15.86:0/1147157734 >> v1:172.21.15.134:6789/0 conn(0x7f799006bf10 legacy=0x7f799015e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:41.505 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.501+0000 7f798dd9b640 1 -- 172.21.15.86:0/1147157734 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7990073480 con 0x7f79900cabf0 2024-04-25T12:22:41.505 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.501+0000 7f798dd9b640 1 --2- 172.21.15.86:0/1147157734 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79900cabf0 0x7f799006b9d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f7984009870 tx=0x7f798401c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61ac4c6ee6ec4fdf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:41.505 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.501+0000 7f798d59a640 1 -- 172.21.15.86:0/1147157734 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79840b0070 con 0x7f79900cabf0 2024-04-25T12:22:41.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.501+0000 7f798d59a640 1 -- 172.21.15.86:0/1147157734 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79840ab600 con 0x7f79900cabf0 2024-04-25T12:22:41.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.501+0000 7f798d59a640 1 -- 172.21.15.86:0/1147157734 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79840ab9d0 con 0x7f79900cabf0 2024-04-25T12:22:41.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.501+0000 7f79948a8640 1 -- 172.21.15.86:0/1147157734 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79900cabf0 msgr2=0x7f799006b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:41.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.501+0000 7f79948a8640 1 --2- 172.21.15.86:0/1147157734 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79900cabf0 0x7f799006b9d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f7984009870 tx=0x7f798401c340 comp rx=0 tx=0).stop 2024-04-25T12:22:41.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.501+0000 7f79948a8640 1 -- 172.21.15.86:0/1147157734 shutdown_connections 2024-04-25T12:22:41.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.501+0000 7f79948a8640 1 --2- 172.21.15.86:0/1147157734 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79900cabf0 0x7f799006b9d0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:41.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.501+0000 7f79948a8640 1 --2- 172.21.15.86:0/1147157734 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79901442a0 0x7f79900c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:41.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.501+0000 7f79948a8640 1 -- 172.21.15.86:0/1147157734 >> 172.21.15.86:0/1147157734 conn(0x7f79900ca0d0 msgr2=0x7f79900ca4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:41.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.501+0000 7f79948a8640 1 -- 172.21.15.86:0/1147157734 shutdown_connections 2024-04-25T12:22:41.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.501+0000 7f79948a8640 1 -- 172.21.15.86:0/1147157734 wait complete. 2024-04-25T12:22:41.509 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.505+0000 7f79948a8640 1 Processor -- start 2024-04-25T12:22:41.510 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.505+0000 7f79948a8640 1 -- start start 2024-04-25T12:22:41.510 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.505+0000 7f79948a8640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f799006bf10 0x7f7990159cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:41.510 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.505+0000 7f79948a8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79900cabf0 0x7f79900cd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:41.510 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.505+0000 7f79948a8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79901442a0 0x7f7990072720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:41.510 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.505+0000 7f79948a8640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f79900740c0 con 0x7f799006bf10 2024-04-25T12:22:41.510 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.505+0000 7f79948a8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7990073f40 con 0x7f79900cabf0 2024-04-25T12:22:41.510 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.505+0000 7f79948a8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f7990144680 con 0x7f79901442a0 2024-04-25T12:22:41.511 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.505+0000 7f798e59c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f799006bf10 0x7f7990159cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:41.511 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.505+0000 7f798e59c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f799006bf10 0x7f7990159cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37832/0 (socket says 172.21.15.86:37832) 2024-04-25T12:22:41.511 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.505+0000 7f798e59c640 1 -- 172.21.15.86:0/1495472358 learned_addr learned my addr 172.21.15.86:0/1495472358 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:41.511 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.505+0000 7f798dd9b640 1 --2- 172.21.15.86:0/1495472358 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79900cabf0 0x7f79900cd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:41.511 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.505+0000 7f798ed9d640 1 --2- 172.21.15.86:0/1495472358 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79901442a0 0x7f7990072720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:41.511 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.505+0000 7f798e59c640 1 -- 172.21.15.86:0/1495472358 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79901442a0 msgr2=0x7f7990072720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:41.511 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.505+0000 7f798e59c640 1 --2- 172.21.15.86:0/1495472358 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79901442a0 0x7f7990072720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:41.511 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.505+0000 7f798e59c640 1 -- 172.21.15.86:0/1495472358 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79900cabf0 msgr2=0x7f79900cd0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:41.512 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.505+0000 7f798e59c640 1 --2- 172.21.15.86:0/1495472358 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79900cabf0 0x7f79900cd0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:41.512 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.505+0000 7f798e59c640 1 -- 172.21.15.86:0/1495472358 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f799015a200 con 0x7f799006bf10 2024-04-25T12:22:41.512 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.505+0000 7f798dd9b640 1 --2- 172.21.15.86:0/1495472358 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79900cabf0 0x7f79900cd0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:22:41.512 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.505+0000 7f798e59c640 1 --2- 172.21.15.86:0/1495472358 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f799006bf10 0x7f7990159cc0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7988007ec0 tx=0x7f798800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:41.512 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.505+0000 7f797effd640 1 -- 172.21.15.86:0/1495472358 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7988014620 con 0x7f799006bf10 2024-04-25T12:22:41.512 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.505+0000 7f797effd640 1 -- 172.21.15.86:0/1495472358 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7988019070 con 0x7f799006bf10 2024-04-25T12:22:41.512 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.505+0000 7f79948a8640 1 -- 172.21.15.86:0/1495472358 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79900c3eb0 con 0x7f799006bf10 2024-04-25T12:22:41.512 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.505+0000 7f797effd640 1 -- 172.21.15.86:0/1495472358 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7988014a20 con 0x7f799006bf10 2024-04-25T12:22:41.512 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.505+0000 7f79948a8640 1 -- 172.21.15.86:0/1495472358 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79900cc600 con 0x7f799006bf10 2024-04-25T12:22:41.513 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.505+0000 7f79948a8640 1 -- 172.21.15.86:0/1495472358 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7990075e60 con 0x7f799006bf10 2024-04-25T12:22:41.514 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.505+0000 7f797effd640 1 -- 172.21.15.86:0/1495472358 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7988014bc0 con 0x7f799006bf10 2024-04-25T12:22:41.514 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.505+0000 7f797effd640 1 --2- 172.21.15.86:0/1495472358 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f7970068380 0x7f797006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:41.514 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.505+0000 7f797effd640 1 -- 172.21.15.86:0/1495472358 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f79880886b0 con 0x7f799006bf10 2024-04-25T12:22:41.514 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.505+0000 7f798dd9b640 1 --2- 172.21.15.86:0/1495472358 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f7970068380 0x7f797006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:41.514 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.505+0000 7f797effd640 1 --2- 172.21.15.86:0/1495472358 >> [v2:172.21.15.134:6816/1277404274,v1:172.21.15.134:6817/1277404274] conn(0x7f7970071d20 0x7f79700741c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:41.515 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.509+0000 7f797effd640 1 -- 172.21.15.86:0/1495472358 --> [v2:172.21.15.134:6816/1277404274,v1:172.21.15.134:6817/1277404274] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f798800df30 con 0x7f7970071d20 2024-04-25T12:22:41.515 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.509+0000 7f797effd640 1 -- 172.21.15.86:0/1495472358 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f7988088b40 con 0x7f799006bf10 2024-04-25T12:22:41.515 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.509+0000 7f798dd9b640 1 --2- 172.21.15.86:0/1495472358 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f7970068380 0x7f797006a840 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f79840ad000 tx=0x7f7984008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:41.515 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.509+0000 7f798ed9d640 1 --2- 172.21.15.86:0/1495472358 >> [v2:172.21.15.134:6816/1277404274,v1:172.21.15.134:6817/1277404274] conn(0x7f7970071d20 0x7f79700741c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:41.515 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.509+0000 7f798ed9d640 1 --2- 172.21.15.86:0/1495472358 >> [v2:172.21.15.134:6816/1277404274,v1:172.21.15.134:6817/1277404274] conn(0x7f7970071d20 0x7f79700741c0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:41.515 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.509+0000 7f797effd640 1 -- 172.21.15.86:0/1495472358 <== osd.7 v2:172.21.15.134:6816/1277404274 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f798800df30 con 0x7f7970071d20 2024-04-25T12:22:41.526 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.521+0000 7f79948a8640 1 -- 172.21.15.86:0/1495472358 --> [v2:172.21.15.134:6816/1277404274,v1:172.21.15.134:6817/1277404274] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f79900c9c00 con 0x7f7970071d20 2024-04-25T12:22:41.526 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.521+0000 7f797effd640 1 -- 172.21.15.86:0/1495472358 <== osd.7 v2:172.21.15.134:6816/1277404274 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f79900c9c00 con 0x7f7970071d20 2024-04-25T12:22:41.527 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-25T12:22:41.527 INFO:teuthology.orchestra.run.smithi086.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T12:22:41.527 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-25T12:22:41.528 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.525+0000 7f79948a8640 1 -- 172.21.15.86:0/1495472358 >> [v2:172.21.15.134:6816/1277404274,v1:172.21.15.134:6817/1277404274] conn(0x7f7970071d20 msgr2=0x7f79700741c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:41.528 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.525+0000 7f79948a8640 1 --2- 172.21.15.86:0/1495472358 >> [v2:172.21.15.134:6816/1277404274,v1:172.21.15.134:6817/1277404274] conn(0x7f7970071d20 0x7f79700741c0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:41.528 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.525+0000 7f79948a8640 1 -- 172.21.15.86:0/1495472358 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f7970068380 msgr2=0x7f797006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:41.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.525+0000 7f79948a8640 1 --2- 172.21.15.86:0/1495472358 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f7970068380 0x7f797006a840 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f79840ad000 tx=0x7f7984008040 comp rx=0 tx=0).stop 2024-04-25T12:22:41.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.525+0000 7f79948a8640 1 -- 172.21.15.86:0/1495472358 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f799006bf10 msgr2=0x7f7990159cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:41.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.525+0000 7f79948a8640 1 --2- 172.21.15.86:0/1495472358 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f799006bf10 0x7f7990159cc0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7988007ec0 tx=0x7f798800e4b0 comp rx=0 tx=0).stop 2024-04-25T12:22:41.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.525+0000 7f798ed9d640 1 -- 172.21.15.86:0/1495472358 reap_dead start 2024-04-25T12:22:41.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.525+0000 7f79948a8640 1 -- 172.21.15.86:0/1495472358 shutdown_connections 2024-04-25T12:22:41.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.525+0000 7f79948a8640 1 -- 172.21.15.86:0/1495472358 >> 172.21.15.86:0/1495472358 conn(0x7f79900ca0d0 msgr2=0x7f79900c8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:41.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.525+0000 7f79948a8640 1 -- 172.21.15.86:0/1495472358 shutdown_connections 2024-04-25T12:22:41.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.525+0000 7f79948a8640 1 -- 172.21.15.86:0/1495472358 wait complete. 2024-04-25T12:22:41.542 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-25T12:22:41.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.641+0000 7f59b475f640 1 Processor -- start 2024-04-25T12:22:41.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.641+0000 7f59b475f640 1 -- start start 2024-04-25T12:22:41.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.641+0000 7f59b475f640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f59ac155370 0x7f59ac15b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:41.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.641+0000 7f59b475f640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f59ac15e540 0x7f59ac06d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:41.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.641+0000 7f59b475f640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59ac15ea30 con 0x7f59ac0cb260 2024-04-25T12:22:41.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.641+0000 7f59b475f640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f59ac0c5b70 con 0x7f59ac155370 2024-04-25T12:22:41.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.641+0000 7f59b475f640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f59ac15ed10 con 0x7f59ac15e540 2024-04-25T12:22:41.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.641+0000 7f59b24fb640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f59ac155370 0x7f59ac15b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:41.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.641+0000 7f59b2cfc640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f59ac0cb260 0x7f59ac0c6000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:42140/0 (socket says 172.21.15.86:42140) 2024-04-25T12:22:41.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.641+0000 7f59b24fb640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f59ac155370 0x7f59ac15b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37848/0 (socket says 172.21.15.86:37848) 2024-04-25T12:22:41.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.641+0000 7f59b2cfc640 1 -- 172.21.15.86:0/722971655 learned_addr learned my addr 172.21.15.86:0/722971655 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-04-25T12:22:41.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.641+0000 7f59b1cfa640 1 --2- 172.21.15.86:0/722971655 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f59ac15e540 0x7f59ac06d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:41.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.641+0000 7f59b24fb640 1 -- 172.21.15.86:0/722971655 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f59ac15e540 msgr2=0x7f59ac06d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:41.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.641+0000 7f59b24fb640 1 --2- 172.21.15.86:0/722971655 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f59ac15e540 0x7f59ac06d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:41.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.641+0000 7f59b24fb640 1 -- 172.21.15.86:0/722971655 >> v1:172.21.15.86:6789/0 conn(0x7f59ac0cb260 legacy=0x7f59ac0c6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:41.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.641+0000 7f59b24fb640 1 -- 172.21.15.86:0/722971655 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59ac15eff0 con 0x7f59ac155370 2024-04-25T12:22:41.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.641+0000 7f59b14f9640 1 -- 172.21.15.86:0/722971655 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2254085319 0 0) 0x7f59ac15ea30 con 0x7f59ac0cb260 2024-04-25T12:22:41.649 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.645+0000 7f59b24fb640 1 --2- 172.21.15.86:0/722971655 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59ac155370 0x7f59ac15b9d0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f599c0097c0 tx=0x7f599c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de23e614152073c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:41.649 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.645+0000 7f59b14f9640 1 -- 172.21.15.86:0/722971655 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f599c0b0070 con 0x7f59ac155370 2024-04-25T12:22:41.649 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.645+0000 7f59b14f9640 1 -- 172.21.15.86:0/722971655 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f599c0ab600 con 0x7f59ac155370 2024-04-25T12:22:41.649 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.645+0000 7f59b14f9640 1 -- 172.21.15.86:0/722971655 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f599c0ab9d0 con 0x7f59ac155370 2024-04-25T12:22:41.649 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.645+0000 7f59b475f640 1 -- 172.21.15.86:0/722971655 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59ac155370 msgr2=0x7f59ac15b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:41.649 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.645+0000 7f59b475f640 1 --2- 172.21.15.86:0/722971655 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59ac155370 0x7f59ac15b9d0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f599c0097c0 tx=0x7f599c01c4a0 comp rx=0 tx=0).stop 2024-04-25T12:22:41.650 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.645+0000 7f59b475f640 1 -- 172.21.15.86:0/722971655 shutdown_connections 2024-04-25T12:22:41.650 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.645+0000 7f59b475f640 1 --2- 172.21.15.86:0/722971655 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f59ac15e540 0x7f59ac06d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:41.650 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.645+0000 7f59b475f640 1 --2- 172.21.15.86:0/722971655 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59ac155370 0x7f59ac15b9d0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:41.650 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.645+0000 7f59b475f640 1 -- 172.21.15.86:0/722971655 >> 172.21.15.86:0/722971655 conn(0x7f59ac0676a0 msgr2=0x7f59ac067ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:41.650 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.645+0000 7f59b475f640 1 -- 172.21.15.86:0/722971655 shutdown_connections 2024-04-25T12:22:41.650 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.645+0000 7f59b475f640 1 -- 172.21.15.86:0/722971655 wait complete. 2024-04-25T12:22:41.650 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.645+0000 7f59b475f640 1 Processor -- start 2024-04-25T12:22:41.650 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.645+0000 7f59b475f640 1 -- start start 2024-04-25T12:22:41.655 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.645+0000 7f59b475f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59ac0cb260 0x7f59ac0b5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:41.655 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.645+0000 7f59b475f640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f59ac155370 0x7f59ac0cb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:41.655 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.645+0000 7f59b475f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59ac15e540 0x7f59ac13d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:41.655 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.645+0000 7f59b475f640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f59ac168480 con 0x7f59ac0cb260 2024-04-25T12:22:41.655 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.645+0000 7f59b475f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f59ac168300 con 0x7f59ac15e540 2024-04-25T12:22:41.655 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.645+0000 7f59b475f640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f59ac168600 con 0x7f59ac155370 2024-04-25T12:22:41.656 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.645+0000 7f59b24fb640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59ac0cb260 0x7f59ac0b5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:41.656 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.645+0000 7f59b24fb640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59ac0cb260 0x7f59ac0b5290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37862/0 (socket says 172.21.15.86:37862) 2024-04-25T12:22:41.656 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.645+0000 7f59b24fb640 1 -- 172.21.15.86:0/1055020531 learned_addr learned my addr 172.21.15.86:0/1055020531 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:41.656 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.645+0000 7f59b24fb640 1 -- 172.21.15.86:0/1055020531 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f59ac155370 msgr2=0x7f59ac0cb9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:41.656 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.645+0000 7f59b24fb640 1 --2- 172.21.15.86:0/1055020531 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f59ac155370 0x7f59ac0cb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:41.656 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.645+0000 7f59b24fb640 1 -- 172.21.15.86:0/1055020531 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59ac15e540 msgr2=0x7f59ac13d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:41.656 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.645+0000 7f59b24fb640 1 --2- 172.21.15.86:0/1055020531 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59ac15e540 0x7f59ac13d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:41.656 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.645+0000 7f59b24fb640 1 -- 172.21.15.86:0/1055020531 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59ac149f50 con 0x7f59ac0cb260 2024-04-25T12:22:41.657 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.645+0000 7f59b24fb640 1 --2- 172.21.15.86:0/1055020531 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59ac0cb260 0x7f59ac0b5290 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f599c0097c0 tx=0x7f599c01ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:41.657 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.645+0000 7f59aaffd640 1 -- 172.21.15.86:0/1055020531 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f599c0b0040 con 0x7f59ac0cb260 2024-04-25T12:22:41.657 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.645+0000 7f59aaffd640 1 -- 172.21.15.86:0/1055020531 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f599c004030 con 0x7f59ac0cb260 2024-04-25T12:22:41.657 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.645+0000 7f59b475f640 1 -- 172.21.15.86:0/1055020531 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59ac0b3dc0 con 0x7f59ac0cb260 2024-04-25T12:22:41.657 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.645+0000 7f59aaffd640 1 -- 172.21.15.86:0/1055020531 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f599c004420 con 0x7f59ac0cb260 2024-04-25T12:22:41.657 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.645+0000 7f59b475f640 1 -- 172.21.15.86:0/1055020531 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59ac14a1f0 con 0x7f59ac0cb260 2024-04-25T12:22:41.657 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.649+0000 7f59b475f640 1 -- 172.21.15.86:0/1055020531 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59ac075df0 con 0x7f59ac0cb260 2024-04-25T12:22:41.657 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.649+0000 7f59aaffd640 1 -- 172.21.15.86:0/1055020531 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f599c003620 con 0x7f59ac0cb260 2024-04-25T12:22:41.658 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.649+0000 7f59aaffd640 1 --2- 172.21.15.86:0/1055020531 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f59980683b0 0x7f599806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:41.658 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.649+0000 7f59aaffd640 1 -- 172.21.15.86:0/1055020531 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f599c121500 con 0x7f59ac0cb260 2024-04-25T12:22:41.658 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.649+0000 7f59b1cfa640 1 --2- 172.21.15.86:0/1055020531 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f59980683b0 0x7f599806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:41.658 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.649+0000 7f59b1cfa640 1 --2- 172.21.15.86:0/1055020531 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f59980683b0 0x7f599806a870 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f59ac0cd510 tx=0x7f59a0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:41.658 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.653+0000 7f59aaffd640 1 -- 172.21.15.86:0/1055020531 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f599c016090 con 0x7f59ac0cb260 2024-04-25T12:22:41.808 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.805+0000 7f59b475f640 1 -- 172.21.15.86:0/1055020531 --> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f59ac0cb7d0 con 0x7f59980683b0 2024-04-25T12:22:41.809 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.805+0000 7f59aaffd640 1 -- 172.21.15.86:0/1055020531 <== mgr.4107 v2:172.21.15.86:6832/3708662606 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f59ac0cb7d0 con 0x7f59980683b0 2024-04-25T12:22:41.809 INFO:teuthology.orchestra.run.smithi086.stderr:instructed osd(s) 7 to deep-scrub 2024-04-25T12:22:41.811 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.805+0000 7f59b475f640 1 -- 172.21.15.86:0/1055020531 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f59980683b0 msgr2=0x7f599806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:41.811 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.809+0000 7f59b475f640 1 --2- 172.21.15.86:0/1055020531 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f59980683b0 0x7f599806a870 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f59ac0cd510 tx=0x7f59a0008040 comp rx=0 tx=0).stop 2024-04-25T12:22:41.811 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.809+0000 7f59b475f640 1 -- 172.21.15.86:0/1055020531 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59ac0cb260 msgr2=0x7f59ac0b5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:41.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.809+0000 7f59b475f640 1 --2- 172.21.15.86:0/1055020531 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59ac0cb260 0x7f59ac0b5290 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f599c0097c0 tx=0x7f599c01ace0 comp rx=0 tx=0).stop 2024-04-25T12:22:41.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.809+0000 7f59b475f640 1 -- 172.21.15.86:0/1055020531 shutdown_connections 2024-04-25T12:22:41.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.809+0000 7f59b475f640 1 --2- 172.21.15.86:0/1055020531 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59ac15e540 0x7f59ac13d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:41.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.809+0000 7f59b475f640 1 --2- 172.21.15.86:0/1055020531 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f59ac155370 0x7f59ac0cb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:41.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.809+0000 7f59b475f640 1 --2- 172.21.15.86:0/1055020531 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f59980683b0 0x7f599806a870 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:41.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.809+0000 7f59b475f640 1 --2- 172.21.15.86:0/1055020531 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59ac0cb260 0x7f59ac0b5290 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:41.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.809+0000 7f59b475f640 1 -- 172.21.15.86:0/1055020531 >> 172.21.15.86:0/1055020531 conn(0x7f59ac0676a0 msgr2=0x7f59ac151050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:41.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.809+0000 7f59b475f640 1 -- 172.21.15.86:0/1055020531 shutdown_connections 2024-04-25T12:22:41.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.809+0000 7f59b475f640 1 -- 172.21.15.86:0/1055020531 wait complete. 2024-04-25T12:22:41.826 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T12:22:41.935 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.929+0000 7fbf205ac640 1 Processor -- start 2024-04-25T12:22:41.935 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.929+0000 7fbf205ac640 1 -- start start 2024-04-25T12:22:41.936 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.933+0000 7fbf205ac640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fbf1814fbc0 0x7fbf1806f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:41.936 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.933+0000 7fbf205ac640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf180c5d70 con 0x7fbf18074100 2024-04-25T12:22:41.936 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.933+0000 7fbf205ac640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf180c6050 con 0x7fbf1814ffa0 2024-04-25T12:22:41.937 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.933+0000 7fbf205ac640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7fbf180c6330 con 0x7fbf1814fbc0 2024-04-25T12:22:41.937 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.933+0000 7fbf1e348640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fbf1814fbc0 0x7fbf1806f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:41.937 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.933+0000 7fbf1eb49640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fbf18074100 0x7fbf180c7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:42142/0 (socket says 172.21.15.86:42142) 2024-04-25T12:22:41.937 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.933+0000 7fbf1eb49640 1 -- 172.21.15.86:0/674686462 learned_addr learned my addr 172.21.15.86:0/674686462 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-04-25T12:22:41.937 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.933+0000 7fbf1e348640 1 -- 172.21.15.86:0/674686462 >> v1:172.21.15.134:6789/0 conn(0x7fbf1814ffa0 legacy=0x7fbf180c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:41.937 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.933+0000 7fbf1e348640 1 -- 172.21.15.86:0/674686462 >> v1:172.21.15.86:6789/0 conn(0x7fbf18074100 legacy=0x7fbf180c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:41.937 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.933+0000 7fbf1d346640 1 -- 172.21.15.86:0/674686462 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3507076960 0 0) 0x7fbf180c5d70 con 0x7fbf18074100 2024-04-25T12:22:41.937 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.933+0000 7fbf1e348640 1 -- 172.21.15.86:0/674686462 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf180c6610 con 0x7fbf1814fbc0 2024-04-25T12:22:41.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.937+0000 7fbf1e348640 1 --2- 172.21.15.86:0/674686462 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf1814fbc0 0x7fbf1806f700 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fbf140097f0 tx=0x7fbf1401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b7165da55e794a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:41.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.937+0000 7fbf1d346640 1 -- 172.21.15.86:0/674686462 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf140ab680 con 0x7fbf1814fbc0 2024-04-25T12:22:41.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.937+0000 7fbf1d346640 1 -- 172.21.15.86:0/674686462 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf140b0070 con 0x7fbf1814fbc0 2024-04-25T12:22:41.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.937+0000 7fbf1d346640 1 -- 172.21.15.86:0/674686462 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf140aba40 con 0x7fbf1814fbc0 2024-04-25T12:22:41.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.937+0000 7fbf205ac640 1 -- 172.21.15.86:0/674686462 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf1814fbc0 msgr2=0x7fbf1806f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:41.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.937+0000 7fbf205ac640 1 --2- 172.21.15.86:0/674686462 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf1814fbc0 0x7fbf1806f700 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fbf140097f0 tx=0x7fbf1401c460 comp rx=0 tx=0).stop 2024-04-25T12:22:41.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.937+0000 7fbf205ac640 1 -- 172.21.15.86:0/674686462 shutdown_connections 2024-04-25T12:22:41.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.937+0000 7fbf205ac640 1 --2- 172.21.15.86:0/674686462 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf1814fbc0 0x7fbf1806f700 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:41.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.937+0000 7fbf205ac640 1 -- 172.21.15.86:0/674686462 >> 172.21.15.86:0/674686462 conn(0x7fbf1806b9d0 msgr2=0x7fbf1806bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:41.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.937+0000 7fbf205ac640 1 -- 172.21.15.86:0/674686462 shutdown_connections 2024-04-25T12:22:41.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.937+0000 7fbf205ac640 1 -- 172.21.15.86:0/674686462 wait complete. 2024-04-25T12:22:41.942 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.937+0000 7fbf205ac640 1 Processor -- start 2024-04-25T12:22:41.942 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.937+0000 7fbf205ac640 1 -- start start 2024-04-25T12:22:41.944 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.937+0000 7fbf205ac640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf18074100 0x7fbf18157850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:41.944 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.937+0000 7fbf205ac640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf1814fbc0 0x7fbf18152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:41.944 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.937+0000 7fbf205ac640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbf1814ffa0 0x7fbf18153230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:41.944 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.937+0000 7fbf205ac640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fbf18167630 con 0x7fbf1814fbc0 2024-04-25T12:22:41.944 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.937+0000 7fbf205ac640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbf181674b0 con 0x7fbf18074100 2024-04-25T12:22:41.945 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.937+0000 7fbf205ac640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fbf181677b0 con 0x7fbf1814ffa0 2024-04-25T12:22:41.945 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.937+0000 7fbf1db47640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf1814fbc0 0x7fbf18152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:41.945 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.937+0000 7fbf1db47640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf1814fbc0 0x7fbf18152cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37872/0 (socket says 172.21.15.86:37872) 2024-04-25T12:22:41.945 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.937+0000 7fbf1db47640 1 -- 172.21.15.86:0/1598869699 learned_addr learned my addr 172.21.15.86:0/1598869699 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:22:41.945 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.937+0000 7fbf1e348640 1 --2- 172.21.15.86:0/1598869699 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf18074100 0x7fbf18157850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:41.945 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.937+0000 7fbf1eb49640 1 --2- 172.21.15.86:0/1598869699 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbf1814ffa0 0x7fbf18153230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:41.945 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.937+0000 7fbf1db47640 1 -- 172.21.15.86:0/1598869699 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbf1814ffa0 msgr2=0x7fbf18153230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:41.945 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.937+0000 7fbf1db47640 1 --2- 172.21.15.86:0/1598869699 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbf1814ffa0 0x7fbf18153230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:41.946 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.937+0000 7fbf1db47640 1 -- 172.21.15.86:0/1598869699 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf18074100 msgr2=0x7fbf18157850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:41.946 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.937+0000 7fbf1db47640 1 --2- 172.21.15.86:0/1598869699 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf18074100 0x7fbf18157850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:41.946 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.937+0000 7fbf1db47640 1 -- 172.21.15.86:0/1598869699 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf18157150 con 0x7fbf1814fbc0 2024-04-25T12:22:41.946 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.937+0000 7fbf1eb49640 1 --2- 172.21.15.86:0/1598869699 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbf1814ffa0 0x7fbf18153230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:22:41.946 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.941+0000 7fbf1db47640 1 --2- 172.21.15.86:0/1598869699 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf1814fbc0 0x7fbf18152cf0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbf0800b410 tx=0x7fbf0800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:41.946 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.941+0000 7fbf0effd640 1 -- 172.21.15.86:0/1598869699 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf08015030 con 0x7fbf1814fbc0 2024-04-25T12:22:41.946 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.941+0000 7fbf0effd640 1 -- 172.21.15.86:0/1598869699 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf08004020 con 0x7fbf1814fbc0 2024-04-25T12:22:41.947 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.941+0000 7fbf205ac640 1 -- 172.21.15.86:0/1598869699 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf18159d20 con 0x7fbf1814fbc0 2024-04-25T12:22:41.947 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.941+0000 7fbf0effd640 1 -- 172.21.15.86:0/1598869699 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf08004450 con 0x7fbf1814fbc0 2024-04-25T12:22:41.947 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.941+0000 7fbf205ac640 1 -- 172.21.15.86:0/1598869699 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf18151300 con 0x7fbf1814fbc0 2024-04-25T12:22:41.947 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.941+0000 7fbf205ac640 1 -- 172.21.15.86:0/1598869699 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf18075df0 con 0x7fbf1814fbc0 2024-04-25T12:22:41.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.941+0000 7fbf0effd640 1 -- 172.21.15.86:0/1598869699 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbf08018070 con 0x7fbf1814fbc0 2024-04-25T12:22:41.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.941+0000 7fbf0effd640 1 --2- 172.21.15.86:0/1598869699 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fbefc068380 0x7fbefc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:41.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.941+0000 7fbf1e348640 1 --2- 172.21.15.86:0/1598869699 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fbefc068380 0x7fbefc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:41.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.941+0000 7fbf0effd640 1 -- 172.21.15.86:0/1598869699 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fbf08086950 con 0x7fbf1814fbc0 2024-04-25T12:22:41.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.941+0000 7fbf1e348640 1 --2- 172.21.15.86:0/1598869699 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fbefc068380 0x7fbefc06a840 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbf140af000 tx=0x7fbf140a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:41.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:41.945+0000 7fbf0effd640 1 -- 172.21.15.86:0/1598869699 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbf08056b10 con 0x7fbf1814fbc0 2024-04-25T12:22:42.096 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:42.093+0000 7fbf205ac640 1 -- 172.21.15.86:0/1598869699 --> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbf18150dd0 con 0x7fbefc068380 2024-04-25T12:22:42.117 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:42.113+0000 7fbf0effd640 1 -- 172.21.15.86:0/1598869699 <== mgr.4107 v2:172.21.15.86:6832/3708662606 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332628 (secure 0 0 0) 0x7fbf18150dd0 con 0x7fbefc068380 2024-04-25T12:22:42.121 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:22:42.123 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2024-04-25T12:22:42.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:42.121+0000 7fbf205ac640 1 -- 172.21.15.86:0/1598869699 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fbefc068380 msgr2=0x7fbefc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:42.125 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:42.121+0000 7fbf205ac640 1 --2- 172.21.15.86:0/1598869699 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fbefc068380 0x7fbefc06a840 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbf140af000 tx=0x7fbf140a7000 comp rx=0 tx=0).stop 2024-04-25T12:22:42.125 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:42.121+0000 7fbf205ac640 1 -- 172.21.15.86:0/1598869699 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf1814fbc0 msgr2=0x7fbf18152cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:42.125 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:42.121+0000 7fbf205ac640 1 --2- 172.21.15.86:0/1598869699 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf1814fbc0 0x7fbf18152cf0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbf0800b410 tx=0x7fbf0800b8d0 comp rx=0 tx=0).stop 2024-04-25T12:22:42.125 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:42.121+0000 7fbf205ac640 1 -- 172.21.15.86:0/1598869699 shutdown_connections 2024-04-25T12:22:42.125 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:42.121+0000 7fbf205ac640 1 --2- 172.21.15.86:0/1598869699 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbf1814ffa0 0x7fbf18153230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:42.125 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:42.121+0000 7fbf205ac640 1 --2- 172.21.15.86:0/1598869699 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fbefc068380 0x7fbefc06a840 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:42.125 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:42.121+0000 7fbf205ac640 1 --2- 172.21.15.86:0/1598869699 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf1814fbc0 0x7fbf18152cf0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:42.126 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:42.121+0000 7fbf205ac640 1 --2- 172.21.15.86:0/1598869699 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf18074100 0x7fbf18157850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:42.126 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:42.121+0000 7fbf205ac640 1 -- 172.21.15.86:0/1598869699 >> 172.21.15.86:0/1598869699 conn(0x7fbf1806b9d0 msgr2=0x7fbf1806bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:42.126 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:42.121+0000 7fbf205ac640 1 -- 172.21.15.86:0/1598869699 shutdown_connections 2024-04-25T12:22:42.126 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:22:42.121+0000 7fbf205ac640 1 -- 172.21.15.86:0/1598869699 wait complete. 2024-04-25T12:22:42.140 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2024-04-25T12:22:41.824686+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":602960,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":379,"num_write_kb":2494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":311,"ondisk_log_size":311,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219720,"kb_used_data":3592,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755000,"statfs":{"total":773094113280,"available":772869120000,"internally_reserved":0,"allocated":3678208,"data_stored":2120808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":564,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004306"},"pg_stats":[{"pgid":"2.1f","version":"26'13","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:14.941362+0000","last_change":"2024-04-25T12:21:23.124053+0000","last_active":"2024-04-25T12:22:14.941362+0000","last_peered":"2024-04-25T12:22:14.941362+0000","last_clean":"2024-04-25T12:22:14.941362+0000","last_became_active":"2024-04-25T12:21:23.123863+0000","last_became_peered":"2024-04-25T12:21:23.123863+0000","last_unstale":"2024-04-25T12:22:14.941362+0000","last_undegraded":"2024-04-25T12:22:14.941362+0000","last_fullsized":"2024-04-25T12:22:14.941362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:52:10.500619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.889057+0000","last_change":"2024-04-25T12:21:24.141874+0000","last_active":"2024-04-25T12:22:04.889057+0000","last_peered":"2024-04-25T12:22:04.889057+0000","last_clean":"2024-04-25T12:22:04.889057+0000","last_became_active":"2024-04-25T12:21:24.141482+0000","last_became_peered":"2024-04-25T12:21:24.141482+0000","last_unstale":"2024-04-25T12:22:04.889057+0000","last_undegraded":"2024-04-25T12:22:04.889057+0000","last_fullsized":"2024-04-25T12:22:04.889057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:45.364004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.885753+0000","last_change":"2024-04-25T12:21:28.377921+0000","last_active":"2024-04-25T12:22:04.885753+0000","last_peered":"2024-04-25T12:22:04.885753+0000","last_clean":"2024-04-25T12:22:04.885753+0000","last_became_active":"2024-04-25T12:21:28.376966+0000","last_became_peered":"2024-04-25T12:21:28.376966+0000","last_unstale":"2024-04-25T12:22:04.885753+0000","last_undegraded":"2024-04-25T12:22:04.885753+0000","last_fullsized":"2024-04-25T12:22:04.885753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:50:43.460694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.889523+0000","last_change":"2024-04-25T12:21:23.113889+0000","last_active":"2024-04-25T12:22:04.889523+0000","last_peered":"2024-04-25T12:22:04.889523+0000","last_clean":"2024-04-25T12:22:04.889523+0000","last_became_active":"2024-04-25T12:21:23.113605+0000","last_became_peered":"2024-04-25T12:21:23.113605+0000","last_unstale":"2024-04-25T12:22:04.889523+0000","last_undegraded":"2024-04-25T12:22:04.889523+0000","last_fullsized":"2024-04-25T12:22:04.889523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:01.082322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.926635+0000","last_change":"2024-04-25T12:22:04.926635+0000","last_active":"2024-04-25T12:22:04.926635+0000","last_peered":"2024-04-25T12:22:04.926635+0000","last_clean":"2024-04-25T12:22:04.926635+0000","last_became_active":"2024-04-25T12:22:04.925895+0000","last_became_peered":"2024-04-25T12:22:04.925895+0000","last_unstale":"2024-04-25T12:22:04.926635+0000","last_undegraded":"2024-04-25T12:22:04.926635+0000","last_fullsized":"2024-04-25T12:22:04.926635+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:58:49.313708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.886429+0000","last_change":"2024-04-25T12:21:28.205320+0000","last_active":"2024-04-25T12:22:04.886429+0000","last_peered":"2024-04-25T12:22:04.886429+0000","last_clean":"2024-04-25T12:22:04.886429+0000","last_became_active":"2024-04-25T12:21:28.204404+0000","last_became_peered":"2024-04-25T12:21:28.204404+0000","last_unstale":"2024-04-25T12:22:04.886429+0000","last_undegraded":"2024-04-25T12:22:04.886429+0000","last_fullsized":"2024-04-25T12:22:04.886429+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:03:17.730928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'12","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:14.950869+0000","last_change":"2024-04-25T12:21:23.132332+0000","last_active":"2024-04-25T12:22:14.950869+0000","last_peered":"2024-04-25T12:22:14.950869+0000","last_clean":"2024-04-25T12:22:14.950869+0000","last_became_active":"2024-04-25T12:21:23.131566+0000","last_became_peered":"2024-04-25T12:21:23.131566+0000","last_unstale":"2024-04-25T12:22:14.950869+0000","last_undegraded":"2024-04-25T12:22:14.950869+0000","last_fullsized":"2024-04-25T12:22:14.950869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:02.429838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.886464+0000","last_change":"2024-04-25T12:21:24.128824+0000","last_active":"2024-04-25T12:22:04.886464+0000","last_peered":"2024-04-25T12:22:04.886464+0000","last_clean":"2024-04-25T12:22:04.886464+0000","last_became_active":"2024-04-25T12:21:24.128027+0000","last_became_peered":"2024-04-25T12:21:24.128027+0000","last_unstale":"2024-04-25T12:22:04.886464+0000","last_undegraded":"2024-04-25T12:22:04.886464+0000","last_fullsized":"2024-04-25T12:22:04.886464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:57:44.137044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.888676+0000","last_change":"2024-04-25T12:21:28.202389+0000","last_active":"2024-04-25T12:22:04.888676+0000","last_peered":"2024-04-25T12:22:04.888676+0000","last_clean":"2024-04-25T12:22:04.888676+0000","last_became_active":"2024-04-25T12:21:28.201228+0000","last_became_peered":"2024-04-25T12:21:28.201228+0000","last_unstale":"2024-04-25T12:22:04.888676+0000","last_undegraded":"2024-04-25T12:22:04.888676+0000","last_fullsized":"2024-04-25T12:22:04.888676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:45:30.365480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:14.953252+0000","last_change":"2024-04-25T12:21:23.128355+0000","last_active":"2024-04-25T12:22:14.953252+0000","last_peered":"2024-04-25T12:22:14.953252+0000","last_clean":"2024-04-25T12:22:14.953252+0000","last_became_active":"2024-04-25T12:21:23.127717+0000","last_became_peered":"2024-04-25T12:21:23.127717+0000","last_unstale":"2024-04-25T12:22:14.953252+0000","last_undegraded":"2024-04-25T12:22:14.953252+0000","last_fullsized":"2024-04-25T12:22:14.953252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:26.319715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.886973+0000","last_change":"2024-04-25T12:21:24.122098+0000","last_active":"2024-04-25T12:22:04.886973+0000","last_peered":"2024-04-25T12:22:04.886973+0000","last_clean":"2024-04-25T12:22:04.886973+0000","last_became_active":"2024-04-25T12:21:24.121392+0000","last_became_peered":"2024-04-25T12:21:24.121392+0000","last_unstale":"2024-04-25T12:22:04.886973+0000","last_undegraded":"2024-04-25T12:22:04.886973+0000","last_fullsized":"2024-04-25T12:22:04.886973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:11:35.116222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.887755+0000","last_change":"2024-04-25T12:21:28.189048+0000","last_active":"2024-04-25T12:22:04.887755+0000","last_peered":"2024-04-25T12:22:04.887755+0000","last_clean":"2024-04-25T12:22:04.887755+0000","last_became_active":"2024-04-25T12:21:28.187340+0000","last_became_peered":"2024-04-25T12:21:28.187340+0000","last_unstale":"2024-04-25T12:22:04.887755+0000","last_undegraded":"2024-04-25T12:22:04.887755+0000","last_fullsized":"2024-04-25T12:22:04.887755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:47:13.797595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.893836+0000","last_change":"2024-04-25T12:21:24.126211+0000","last_active":"2024-04-25T12:22:04.893836+0000","last_peered":"2024-04-25T12:22:04.893836+0000","last_clean":"2024-04-25T12:22:04.893836+0000","last_became_active":"2024-04-25T12:21:24.123695+0000","last_became_peered":"2024-04-25T12:21:24.123695+0000","last_unstale":"2024-04-25T12:22:04.893836+0000","last_undegraded":"2024-04-25T12:22:04.893836+0000","last_fullsized":"2024-04-25T12:22:04.893836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:09:04.327157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"24'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.921191+0000","last_change":"2024-04-25T12:21:23.139676+0000","last_active":"2024-04-25T12:22:04.921191+0000","last_peered":"2024-04-25T12:22:04.921191+0000","last_clean":"2024-04-25T12:22:04.921191+0000","last_became_active":"2024-04-25T12:21:23.139025+0000","last_became_peered":"2024-04-25T12:21:23.139025+0000","last_unstale":"2024-04-25T12:22:04.921191+0000","last_undegraded":"2024-04-25T12:22:04.921191+0000","last_fullsized":"2024-04-25T12:22:04.921191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:43:51.445149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.889613+0000","last_change":"2024-04-25T12:21:28.188852+0000","last_active":"2024-04-25T12:22:04.889613+0000","last_peered":"2024-04-25T12:22:04.889613+0000","last_clean":"2024-04-25T12:22:04.889613+0000","last_became_active":"2024-04-25T12:21:28.187619+0000","last_became_peered":"2024-04-25T12:21:28.187619+0000","last_unstale":"2024-04-25T12:22:04.889613+0000","last_undegraded":"2024-04-25T12:22:04.889613+0000","last_fullsized":"2024-04-25T12:22:04.889613+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:12:14.726245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.888266+0000","last_change":"2024-04-25T12:21:24.136925+0000","last_active":"2024-04-25T12:22:04.888266+0000","last_peered":"2024-04-25T12:22:04.888266+0000","last_clean":"2024-04-25T12:22:04.888266+0000","last_became_active":"2024-04-25T12:21:24.136535+0000","last_became_peered":"2024-04-25T12:21:24.136535+0000","last_unstale":"2024-04-25T12:22:04.888266+0000","last_undegraded":"2024-04-25T12:22:04.888266+0000","last_fullsized":"2024-04-25T12:22:04.888266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:28:23.965010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:08.913144+0000","last_change":"2024-04-25T12:21:23.105571+0000","last_active":"2024-04-25T12:22:08.913144+0000","last_peered":"2024-04-25T12:22:08.913144+0000","last_clean":"2024-04-25T12:22:08.913144+0000","last_became_active":"2024-04-25T12:21:23.105051+0000","last_became_peered":"2024-04-25T12:21:23.105051+0000","last_unstale":"2024-04-25T12:22:08.913144+0000","last_undegraded":"2024-04-25T12:22:08.913144+0000","last_fullsized":"2024-04-25T12:22:08.913144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:52:40.783100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.888765+0000","last_change":"2024-04-25T12:21:28.202632+0000","last_active":"2024-04-25T12:22:04.888765+0000","last_peered":"2024-04-25T12:22:04.888765+0000","last_clean":"2024-04-25T12:22:04.888765+0000","last_became_active":"2024-04-25T12:21:28.201389+0000","last_became_peered":"2024-04-25T12:21:28.201389+0000","last_unstale":"2024-04-25T12:22:04.888765+0000","last_undegraded":"2024-04-25T12:22:04.888765+0000","last_fullsized":"2024-04-25T12:22:04.888765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:48:58.246610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.887395+0000","last_change":"2024-04-25T12:21:24.138749+0000","last_active":"2024-04-25T12:22:04.887395+0000","last_peered":"2024-04-25T12:22:04.887395+0000","last_clean":"2024-04-25T12:22:04.887395+0000","last_became_active":"2024-04-25T12:21:24.138446+0000","last_became_peered":"2024-04-25T12:21:24.138446+0000","last_unstale":"2024-04-25T12:22:04.887395+0000","last_undegraded":"2024-04-25T12:22:04.887395+0000","last_fullsized":"2024-04-25T12:22:04.887395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:22:03.856237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:14.941093+0000","last_change":"2024-04-25T12:21:23.126871+0000","last_active":"2024-04-25T12:22:14.941093+0000","last_peered":"2024-04-25T12:22:14.941093+0000","last_clean":"2024-04-25T12:22:14.941093+0000","last_became_active":"2024-04-25T12:21:23.126521+0000","last_became_peered":"2024-04-25T12:21:23.126521+0000","last_unstale":"2024-04-25T12:22:14.941093+0000","last_undegraded":"2024-04-25T12:22:14.941093+0000","last_fullsized":"2024-04-25T12:22:14.941093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:12:31.353951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.922140+0000","last_change":"2024-04-25T12:21:28.383996+0000","last_active":"2024-04-25T12:22:04.922140+0000","last_peered":"2024-04-25T12:22:04.922140+0000","last_clean":"2024-04-25T12:22:04.922140+0000","last_became_active":"2024-04-25T12:21:28.383568+0000","last_became_peered":"2024-04-25T12:21:28.383568+0000","last_unstale":"2024-04-25T12:22:04.922140+0000","last_undegraded":"2024-04-25T12:22:04.922140+0000","last_fullsized":"2024-04-25T12:22:04.922140+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:19:41.564694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.887535+0000","last_change":"2024-04-25T12:21:24.125112+0000","last_active":"2024-04-25T12:22:04.887535+0000","last_peered":"2024-04-25T12:22:04.887535+0000","last_clean":"2024-04-25T12:22:04.887535+0000","last_became_active":"2024-04-25T12:21:24.121963+0000","last_became_peered":"2024-04-25T12:21:24.121963+0000","last_unstale":"2024-04-25T12:22:04.887535+0000","last_undegraded":"2024-04-25T12:22:04.887535+0000","last_fullsized":"2024-04-25T12:22:04.887535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:33:14.123119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"24'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.919771+0000","last_change":"2024-04-25T12:21:23.117114+0000","last_active":"2024-04-25T12:22:04.919771+0000","last_peered":"2024-04-25T12:22:04.919771+0000","last_clean":"2024-04-25T12:22:04.919771+0000","last_became_active":"2024-04-25T12:21:23.115571+0000","last_became_peered":"2024-04-25T12:21:23.115571+0000","last_unstale":"2024-04-25T12:22:04.919771+0000","last_undegraded":"2024-04-25T12:22:04.919771+0000","last_fullsized":"2024-04-25T12:22:04.919771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:47.838299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.888900+0000","last_change":"2024-04-25T12:21:28.202374+0000","last_active":"2024-04-25T12:22:04.888900+0000","last_peered":"2024-04-25T12:22:04.888900+0000","last_clean":"2024-04-25T12:22:04.888900+0000","last_became_active":"2024-04-25T12:21:28.201297+0000","last_became_peered":"2024-04-25T12:21:28.201297+0000","last_unstale":"2024-04-25T12:22:04.888900+0000","last_undegraded":"2024-04-25T12:22:04.888900+0000","last_fullsized":"2024-04-25T12:22:04.888900+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:13.461169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.899183+0000","last_change":"2024-04-25T12:21:24.133827+0000","last_active":"2024-04-25T12:22:04.899183+0000","last_peered":"2024-04-25T12:22:04.899183+0000","last_clean":"2024-04-25T12:22:04.899183+0000","last_became_active":"2024-04-25T12:21:24.132703+0000","last_became_peered":"2024-04-25T12:21:24.132703+0000","last_unstale":"2024-04-25T12:22:04.899183+0000","last_undegraded":"2024-04-25T12:22:04.899183+0000","last_fullsized":"2024-04-25T12:22:04.899183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:06:22.849827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:14.949919+0000","last_change":"2024-04-25T12:21:23.132331+0000","last_active":"2024-04-25T12:22:14.949919+0000","last_peered":"2024-04-25T12:22:14.949919+0000","last_clean":"2024-04-25T12:22:14.949919+0000","last_became_active":"2024-04-25T12:21:23.131628+0000","last_became_peered":"2024-04-25T12:21:23.131628+0000","last_unstale":"2024-04-25T12:22:14.949919+0000","last_undegraded":"2024-04-25T12:22:14.949919+0000","last_fullsized":"2024-04-25T12:22:14.949919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:19:13.372172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.887229+0000","last_change":"2024-04-25T12:21:28.377407+0000","last_active":"2024-04-25T12:22:04.887229+0000","last_peered":"2024-04-25T12:22:04.887229+0000","last_clean":"2024-04-25T12:22:04.887229+0000","last_became_active":"2024-04-25T12:21:28.376224+0000","last_became_peered":"2024-04-25T12:21:28.376224+0000","last_unstale":"2024-04-25T12:22:04.887229+0000","last_undegraded":"2024-04-25T12:22:04.887229+0000","last_fullsized":"2024-04-25T12:22:04.887229+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:13:02.955979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.888952+0000","last_change":"2024-04-25T12:21:24.145468+0000","last_active":"2024-04-25T12:22:04.888952+0000","last_peered":"2024-04-25T12:22:04.888952+0000","last_clean":"2024-04-25T12:22:04.888952+0000","last_became_active":"2024-04-25T12:21:24.145132+0000","last_became_peered":"2024-04-25T12:21:24.145132+0000","last_unstale":"2024-04-25T12:22:04.888952+0000","last_undegraded":"2024-04-25T12:22:04.888952+0000","last_fullsized":"2024-04-25T12:22:04.888952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:46:44.281270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:08.911698+0000","last_change":"2024-04-25T12:21:23.131029+0000","last_active":"2024-04-25T12:22:08.911698+0000","last_peered":"2024-04-25T12:22:08.911698+0000","last_clean":"2024-04-25T12:22:08.911698+0000","last_became_active":"2024-04-25T12:21:23.130612+0000","last_became_peered":"2024-04-25T12:21:23.130612+0000","last_unstale":"2024-04-25T12:22:08.911698+0000","last_undegraded":"2024-04-25T12:22:08.911698+0000","last_fullsized":"2024-04-25T12:22:08.911698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:02.146986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.885579+0000","last_change":"2024-04-25T12:21:28.375231+0000","last_active":"2024-04-25T12:22:04.885579+0000","last_peered":"2024-04-25T12:22:04.885579+0000","last_clean":"2024-04-25T12:22:04.885579+0000","last_became_active":"2024-04-25T12:21:28.374813+0000","last_became_peered":"2024-04-25T12:21:28.374813+0000","last_unstale":"2024-04-25T12:22:04.885579+0000","last_undegraded":"2024-04-25T12:22:04.885579+0000","last_fullsized":"2024-04-25T12:22:04.885579+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:16.393582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.922376+0000","last_change":"2024-04-25T12:21:24.112280+0000","last_active":"2024-04-25T12:22:04.922376+0000","last_peered":"2024-04-25T12:22:04.922376+0000","last_clean":"2024-04-25T12:22:04.922376+0000","last_became_active":"2024-04-25T12:21:24.111430+0000","last_became_peered":"2024-04-25T12:21:24.111430+0000","last_unstale":"2024-04-25T12:22:04.922376+0000","last_undegraded":"2024-04-25T12:22:04.922376+0000","last_fullsized":"2024-04-25T12:22:04.922376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:58.325720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:08.912181+0000","last_change":"2024-04-25T12:21:23.124271+0000","last_active":"2024-04-25T12:22:08.912181+0000","last_peered":"2024-04-25T12:22:08.912181+0000","last_clean":"2024-04-25T12:22:08.912181+0000","last_became_active":"2024-04-25T12:21:23.123492+0000","last_became_peered":"2024-04-25T12:21:23.123492+0000","last_unstale":"2024-04-25T12:22:08.912181+0000","last_undegraded":"2024-04-25T12:22:08.912181+0000","last_fullsized":"2024-04-25T12:22:08.912181+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:31:09.080478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.896489+0000","last_change":"2024-04-25T12:21:28.375801+0000","last_active":"2024-04-25T12:22:04.896489+0000","last_peered":"2024-04-25T12:22:04.896489+0000","last_clean":"2024-04-25T12:22:04.896489+0000","last_became_active":"2024-04-25T12:21:28.375119+0000","last_became_peered":"2024-04-25T12:21:28.375119+0000","last_unstale":"2024-04-25T12:22:04.896489+0000","last_undegraded":"2024-04-25T12:22:04.896489+0000","last_fullsized":"2024-04-25T12:22:04.896489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:00:29.908954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.886990+0000","last_change":"2024-04-25T12:21:24.131673+0000","last_active":"2024-04-25T12:22:04.886990+0000","last_peered":"2024-04-25T12:22:04.886990+0000","last_clean":"2024-04-25T12:22:04.886990+0000","last_became_active":"2024-04-25T12:21:24.130866+0000","last_became_peered":"2024-04-25T12:21:24.130866+0000","last_unstale":"2024-04-25T12:22:04.886990+0000","last_undegraded":"2024-04-25T12:22:04.886990+0000","last_fullsized":"2024-04-25T12:22:04.886990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:09:04.327157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"26'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.922773+0000","last_change":"2024-04-25T12:21:23.106785+0000","last_active":"2024-04-25T12:22:04.922773+0000","last_peered":"2024-04-25T12:22:04.922773+0000","last_clean":"2024-04-25T12:22:04.922773+0000","last_became_active":"2024-04-25T12:21:23.105809+0000","last_became_peered":"2024-04-25T12:21:23.105809+0000","last_unstale":"2024-04-25T12:22:04.922773+0000","last_undegraded":"2024-04-25T12:22:04.922773+0000","last_fullsized":"2024-04-25T12:22:04.922773+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:17.185116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.920337+0000","last_change":"2024-04-25T12:21:28.193242+0000","last_active":"2024-04-25T12:22:04.920337+0000","last_peered":"2024-04-25T12:22:04.920337+0000","last_clean":"2024-04-25T12:22:04.920337+0000","last_became_active":"2024-04-25T12:21:28.192835+0000","last_became_peered":"2024-04-25T12:21:28.192835+0000","last_unstale":"2024-04-25T12:22:04.920337+0000","last_undegraded":"2024-04-25T12:22:04.920337+0000","last_fullsized":"2024-04-25T12:22:04.920337+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:42:52.476024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.889648+0000","last_change":"2024-04-25T12:21:24.128902+0000","last_active":"2024-04-25T12:22:04.889648+0000","last_peered":"2024-04-25T12:22:04.889648+0000","last_clean":"2024-04-25T12:22:04.889648+0000","last_became_active":"2024-04-25T12:21:24.124563+0000","last_became_peered":"2024-04-25T12:21:24.124563+0000","last_unstale":"2024-04-25T12:22:04.889648+0000","last_undegraded":"2024-04-25T12:22:04.889648+0000","last_fullsized":"2024-04-25T12:22:04.889648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:16.937980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:14.953290+0000","last_change":"2024-04-25T12:21:23.114222+0000","last_active":"2024-04-25T12:22:14.953290+0000","last_peered":"2024-04-25T12:22:14.953290+0000","last_clean":"2024-04-25T12:22:14.953290+0000","last_became_active":"2024-04-25T12:21:23.113504+0000","last_became_peered":"2024-04-25T12:21:23.113504+0000","last_unstale":"2024-04-25T12:22:14.953290+0000","last_undegraded":"2024-04-25T12:22:14.953290+0000","last_fullsized":"2024-04-25T12:22:14.953290+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:37:42.382391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.922111+0000","last_change":"2024-04-25T12:21:28.200532+0000","last_active":"2024-04-25T12:22:04.922111+0000","last_peered":"2024-04-25T12:22:04.922111+0000","last_clean":"2024-04-25T12:22:04.922111+0000","last_became_active":"2024-04-25T12:21:28.200082+0000","last_became_peered":"2024-04-25T12:21:28.200082+0000","last_unstale":"2024-04-25T12:22:04.922111+0000","last_undegraded":"2024-04-25T12:22:04.922111+0000","last_fullsized":"2024-04-25T12:22:04.922111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:24.889665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.920686+0000","last_change":"2024-04-25T12:21:24.112524+0000","last_active":"2024-04-25T12:22:04.920686+0000","last_peered":"2024-04-25T12:22:04.920686+0000","last_clean":"2024-04-25T12:22:04.920686+0000","last_became_active":"2024-04-25T12:21:24.111503+0000","last_became_peered":"2024-04-25T12:21:24.111503+0000","last_unstale":"2024-04-25T12:22:04.920686+0000","last_undegraded":"2024-04-25T12:22:04.920686+0000","last_fullsized":"2024-04-25T12:22:04.920686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:03:35.982959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:14.944694+0000","last_change":"2024-04-25T12:21:23.108434+0000","last_active":"2024-04-25T12:22:14.944694+0000","last_peered":"2024-04-25T12:22:14.944694+0000","last_clean":"2024-04-25T12:22:14.944694+0000","last_became_active":"2024-04-25T12:21:23.108051+0000","last_became_peered":"2024-04-25T12:21:23.108051+0000","last_unstale":"2024-04-25T12:22:14.944694+0000","last_undegraded":"2024-04-25T12:22:14.944694+0000","last_fullsized":"2024-04-25T12:22:14.944694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:49.222950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.922506+0000","last_change":"2024-04-25T12:21:28.189825+0000","last_active":"2024-04-25T12:22:04.922506+0000","last_peered":"2024-04-25T12:22:04.922506+0000","last_clean":"2024-04-25T12:22:04.922506+0000","last_became_active":"2024-04-25T12:21:28.189247+0000","last_became_peered":"2024-04-25T12:21:28.189247+0000","last_unstale":"2024-04-25T12:22:04.922506+0000","last_undegraded":"2024-04-25T12:22:04.922506+0000","last_fullsized":"2024-04-25T12:22:04.922506+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:54:02.752212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.894738+0000","last_change":"2024-04-25T12:21:24.105746+0000","last_active":"2024-04-25T12:22:04.894738+0000","last_peered":"2024-04-25T12:22:04.894738+0000","last_clean":"2024-04-25T12:22:04.894738+0000","last_became_active":"2024-04-25T12:21:24.104947+0000","last_became_peered":"2024-04-25T12:21:24.104947+0000","last_unstale":"2024-04-25T12:22:04.894738+0000","last_undegraded":"2024-04-25T12:22:04.894738+0000","last_fullsized":"2024-04-25T12:22:04.894738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:46:14.853789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.919808+0000","last_change":"2024-04-25T12:21:23.114591+0000","last_active":"2024-04-25T12:22:04.919808+0000","last_peered":"2024-04-25T12:22:04.919808+0000","last_clean":"2024-04-25T12:22:04.919808+0000","last_became_active":"2024-04-25T12:21:23.113829+0000","last_became_peered":"2024-04-25T12:21:23.113829+0000","last_unstale":"2024-04-25T12:22:04.919808+0000","last_undegraded":"2024-04-25T12:22:04.919808+0000","last_fullsized":"2024-04-25T12:22:04.919808+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:51:38.471436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.898786+0000","last_change":"2024-04-25T12:21:28.378024+0000","last_active":"2024-04-25T12:22:04.898786+0000","last_peered":"2024-04-25T12:22:04.898786+0000","last_clean":"2024-04-25T12:22:04.898786+0000","last_became_active":"2024-04-25T12:21:28.377639+0000","last_became_peered":"2024-04-25T12:21:28.377639+0000","last_unstale":"2024-04-25T12:22:04.898786+0000","last_undegraded":"2024-04-25T12:22:04.898786+0000","last_fullsized":"2024-04-25T12:22:04.898786+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:18:40.723659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.886368+0000","last_change":"2024-04-25T12:21:24.120719+0000","last_active":"2024-04-25T12:22:04.886368+0000","last_peered":"2024-04-25T12:22:04.886368+0000","last_clean":"2024-04-25T12:22:04.886368+0000","last_became_active":"2024-04-25T12:21:24.119870+0000","last_became_peered":"2024-04-25T12:21:24.119870+0000","last_unstale":"2024-04-25T12:22:04.886368+0000","last_undegraded":"2024-04-25T12:22:04.886368+0000","last_fullsized":"2024-04-25T12:22:04.886368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:53:15.175473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:08.909810+0000","last_change":"2024-04-25T12:21:23.103524+0000","last_active":"2024-04-25T12:22:08.909810+0000","last_peered":"2024-04-25T12:22:08.909810+0000","last_clean":"2024-04-25T12:22:08.909810+0000","last_became_active":"2024-04-25T12:21:23.102790+0000","last_became_peered":"2024-04-25T12:21:23.102790+0000","last_unstale":"2024-04-25T12:22:08.909810+0000","last_undegraded":"2024-04-25T12:22:08.909810+0000","last_fullsized":"2024-04-25T12:22:08.909810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:15:54.796303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":182,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.919869+0000","last_change":"2024-04-25T12:21:13.081186+0000","last_active":"2024-04-25T12:22:04.919869+0000","last_peered":"2024-04-25T12:22:04.919869+0000","last_clean":"2024-04-25T12:22:04.919869+0000","last_became_active":"2024-04-25T12:21:13.076753+0000","last_became_peered":"2024-04-25T12:21:13.076753+0000","last_unstale":"2024-04-25T12:22:04.919869+0000","last_undegraded":"2024-04-25T12:22:04.919869+0000","last_fullsized":"2024-04-25T12:22:04.919869+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:12.013694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:12.013694+0000","last_clean_scrub_stamp":"2024-04-25T12:21:12.013694+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:18:03.288120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.894131+0000","last_change":"2024-04-25T12:21:28.379372+0000","last_active":"2024-04-25T12:22:04.894131+0000","last_peered":"2024-04-25T12:22:04.894131+0000","last_clean":"2024-04-25T12:22:04.894131+0000","last_became_active":"2024-04-25T12:21:28.378522+0000","last_became_peered":"2024-04-25T12:21:28.378522+0000","last_unstale":"2024-04-25T12:22:04.894131+0000","last_undegraded":"2024-04-25T12:22:04.894131+0000","last_fullsized":"2024-04-25T12:22:04.894131+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:54:35.288829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.921450+0000","last_change":"2024-04-25T12:21:24.144632+0000","last_active":"2024-04-25T12:22:04.921450+0000","last_peered":"2024-04-25T12:22:04.921450+0000","last_clean":"2024-04-25T12:22:04.921450+0000","last_became_active":"2024-04-25T12:21:24.142085+0000","last_became_peered":"2024-04-25T12:21:24.142085+0000","last_unstale":"2024-04-25T12:22:04.921450+0000","last_undegraded":"2024-04-25T12:22:04.921450+0000","last_fullsized":"2024-04-25T12:22:04.921450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:16:55.634329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:23.478572+0000","last_change":"2024-04-25T12:21:23.126527+0000","last_active":"2024-04-25T12:22:23.478572+0000","last_peered":"2024-04-25T12:22:23.478572+0000","last_clean":"2024-04-25T12:22:23.478572+0000","last_became_active":"2024-04-25T12:21:23.126103+0000","last_became_peered":"2024-04-25T12:21:23.126103+0000","last_unstale":"2024-04-25T12:22:23.478572+0000","last_undegraded":"2024-04-25T12:22:23.478572+0000","last_fullsized":"2024-04-25T12:22:23.478572+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:16:36.502824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.891785+0000","last_change":"2024-04-25T12:21:28.379480+0000","last_active":"2024-04-25T12:22:04.891785+0000","last_peered":"2024-04-25T12:22:04.891785+0000","last_clean":"2024-04-25T12:22:04.891785+0000","last_became_active":"2024-04-25T12:21:28.378559+0000","last_became_peered":"2024-04-25T12:21:28.378559+0000","last_unstale":"2024-04-25T12:22:04.891785+0000","last_undegraded":"2024-04-25T12:22:04.891785+0000","last_fullsized":"2024-04-25T12:22:04.891785+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:40.975592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.886708+0000","last_change":"2024-04-25T12:21:24.129518+0000","last_active":"2024-04-25T12:22:04.886708+0000","last_peered":"2024-04-25T12:22:04.886708+0000","last_clean":"2024-04-25T12:22:04.886708+0000","last_became_active":"2024-04-25T12:21:24.126968+0000","last_became_peered":"2024-04-25T12:21:24.126968+0000","last_unstale":"2024-04-25T12:22:04.886708+0000","last_undegraded":"2024-04-25T12:22:04.886708+0000","last_fullsized":"2024-04-25T12:22:04.886708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:49.243645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:08.913274+0000","last_change":"2024-04-25T12:21:23.116529+0000","last_active":"2024-04-25T12:22:08.913274+0000","last_peered":"2024-04-25T12:22:08.913274+0000","last_clean":"2024-04-25T12:22:08.913274+0000","last_became_active":"2024-04-25T12:21:23.116148+0000","last_became_peered":"2024-04-25T12:21:23.116148+0000","last_unstale":"2024-04-25T12:22:08.913274+0000","last_undegraded":"2024-04-25T12:22:08.913274+0000","last_fullsized":"2024-04-25T12:22:08.913274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:01:45.567238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.897064+0000","last_change":"2024-04-25T12:21:28.194823+0000","last_active":"2024-04-25T12:22:04.897064+0000","last_peered":"2024-04-25T12:22:04.897064+0000","last_clean":"2024-04-25T12:22:04.897064+0000","last_became_active":"2024-04-25T12:21:28.194191+0000","last_became_peered":"2024-04-25T12:21:28.194191+0000","last_unstale":"2024-04-25T12:22:04.897064+0000","last_undegraded":"2024-04-25T12:22:04.897064+0000","last_fullsized":"2024-04-25T12:22:04.897064+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:50:30.454926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.921672+0000","last_change":"2024-04-25T12:21:24.146733+0000","last_active":"2024-04-25T12:22:04.921672+0000","last_peered":"2024-04-25T12:22:04.921672+0000","last_clean":"2024-04-25T12:22:04.921672+0000","last_became_active":"2024-04-25T12:21:24.145807+0000","last_became_peered":"2024-04-25T12:21:24.145807+0000","last_unstale":"2024-04-25T12:22:04.921672+0000","last_undegraded":"2024-04-25T12:22:04.921672+0000","last_fullsized":"2024-04-25T12:22:04.921672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:07:35.092827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:14.944106+0000","last_change":"2024-04-25T12:21:23.103393+0000","last_active":"2024-04-25T12:22:14.944106+0000","last_peered":"2024-04-25T12:22:14.944106+0000","last_clean":"2024-04-25T12:22:14.944106+0000","last_became_active":"2024-04-25T12:21:23.102997+0000","last_became_peered":"2024-04-25T12:21:23.102997+0000","last_unstale":"2024-04-25T12:22:14.944106+0000","last_undegraded":"2024-04-25T12:22:14.944106+0000","last_fullsized":"2024-04-25T12:22:14.944106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:40:23.054158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.885200+0000","last_change":"2024-04-25T12:21:28.384645+0000","last_active":"2024-04-25T12:22:04.885200+0000","last_peered":"2024-04-25T12:22:04.885200+0000","last_clean":"2024-04-25T12:22:04.885200+0000","last_became_active":"2024-04-25T12:21:28.382953+0000","last_became_peered":"2024-04-25T12:21:28.382953+0000","last_unstale":"2024-04-25T12:22:04.885200+0000","last_undegraded":"2024-04-25T12:22:04.885200+0000","last_fullsized":"2024-04-25T12:22:04.885200+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:40:56.218533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.920897+0000","last_change":"2024-04-25T12:21:24.146557+0000","last_active":"2024-04-25T12:22:04.920897+0000","last_peered":"2024-04-25T12:22:04.920897+0000","last_clean":"2024-04-25T12:22:04.920897+0000","last_became_active":"2024-04-25T12:21:24.146162+0000","last_became_peered":"2024-04-25T12:21:24.146162+0000","last_unstale":"2024-04-25T12:22:04.920897+0000","last_undegraded":"2024-04-25T12:22:04.920897+0000","last_fullsized":"2024-04-25T12:22:04.920897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:09:00.995503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.889472+0000","last_change":"2024-04-25T12:21:23.135467+0000","last_active":"2024-04-25T12:22:04.889472+0000","last_peered":"2024-04-25T12:22:04.889472+0000","last_clean":"2024-04-25T12:22:04.889472+0000","last_became_active":"2024-04-25T12:21:23.134441+0000","last_became_peered":"2024-04-25T12:21:23.134441+0000","last_unstale":"2024-04-25T12:22:04.889472+0000","last_undegraded":"2024-04-25T12:22:04.889472+0000","last_fullsized":"2024-04-25T12:22:04.889472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:44:33.069221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.886118+0000","last_change":"2024-04-25T12:21:28.202610+0000","last_active":"2024-04-25T12:22:04.886118+0000","last_peered":"2024-04-25T12:22:04.886118+0000","last_clean":"2024-04-25T12:22:04.886118+0000","last_became_active":"2024-04-25T12:21:28.201479+0000","last_became_peered":"2024-04-25T12:21:28.201479+0000","last_unstale":"2024-04-25T12:22:04.886118+0000","last_undegraded":"2024-04-25T12:22:04.886118+0000","last_fullsized":"2024-04-25T12:22:04.886118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:25:15.458202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.920270+0000","last_change":"2024-04-25T12:21:24.145131+0000","last_active":"2024-04-25T12:22:04.920270+0000","last_peered":"2024-04-25T12:22:04.920270+0000","last_clean":"2024-04-25T12:22:04.920270+0000","last_became_active":"2024-04-25T12:21:24.142422+0000","last_became_peered":"2024-04-25T12:21:24.142422+0000","last_unstale":"2024-04-25T12:22:04.920270+0000","last_undegraded":"2024-04-25T12:22:04.920270+0000","last_fullsized":"2024-04-25T12:22:04.920270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:40:24.312543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'17","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:08.910633+0000","last_change":"2024-04-25T12:21:23.104288+0000","last_active":"2024-04-25T12:22:08.910633+0000","last_peered":"2024-04-25T12:22:08.910633+0000","last_clean":"2024-04-25T12:22:08.910633+0000","last_became_active":"2024-04-25T12:21:23.103680+0000","last_became_peered":"2024-04-25T12:21:23.103680+0000","last_unstale":"2024-04-25T12:22:08.910633+0000","last_undegraded":"2024-04-25T12:22:08.910633+0000","last_fullsized":"2024-04-25T12:22:08.910633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:29.672890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.898513+0000","last_change":"2024-04-25T12:21:28.199834+0000","last_active":"2024-04-25T12:22:04.898513+0000","last_peered":"2024-04-25T12:22:04.898513+0000","last_clean":"2024-04-25T12:22:04.898513+0000","last_became_active":"2024-04-25T12:21:28.199411+0000","last_became_peered":"2024-04-25T12:21:28.199411+0000","last_unstale":"2024-04-25T12:22:04.898513+0000","last_undegraded":"2024-04-25T12:22:04.898513+0000","last_fullsized":"2024-04-25T12:22:04.898513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:52:34.443813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.892493+0000","last_change":"2024-04-25T12:21:24.127488+0000","last_active":"2024-04-25T12:22:04.892493+0000","last_peered":"2024-04-25T12:22:04.892493+0000","last_clean":"2024-04-25T12:22:04.892493+0000","last_became_active":"2024-04-25T12:21:24.126721+0000","last_became_peered":"2024-04-25T12:21:24.126721+0000","last_unstale":"2024-04-25T12:22:04.892493+0000","last_undegraded":"2024-04-25T12:22:04.892493+0000","last_fullsized":"2024-04-25T12:22:04.892493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:02.153025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:23.488464+0000","last_change":"2024-04-25T12:21:23.139626+0000","last_active":"2024-04-25T12:22:23.488464+0000","last_peered":"2024-04-25T12:22:23.488464+0000","last_clean":"2024-04-25T12:22:23.488464+0000","last_became_active":"2024-04-25T12:21:23.138837+0000","last_became_peered":"2024-04-25T12:21:23.138837+0000","last_unstale":"2024-04-25T12:22:23.488464+0000","last_undegraded":"2024-04-25T12:22:23.488464+0000","last_fullsized":"2024-04-25T12:22:23.488464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:09.309384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.888695+0000","last_change":"2024-04-25T12:21:28.383919+0000","last_active":"2024-04-25T12:22:04.888695+0000","last_peered":"2024-04-25T12:22:04.888695+0000","last_clean":"2024-04-25T12:22:04.888695+0000","last_became_active":"2024-04-25T12:21:28.383298+0000","last_became_peered":"2024-04-25T12:21:28.383298+0000","last_unstale":"2024-04-25T12:22:04.888695+0000","last_undegraded":"2024-04-25T12:22:04.888695+0000","last_fullsized":"2024-04-25T12:22:04.888695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:01.115040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.921039+0000","last_change":"2024-04-25T12:21:24.146454+0000","last_active":"2024-04-25T12:22:04.921039+0000","last_peered":"2024-04-25T12:22:04.921039+0000","last_clean":"2024-04-25T12:22:04.921039+0000","last_became_active":"2024-04-25T12:21:24.145931+0000","last_became_peered":"2024-04-25T12:21:24.145931+0000","last_unstale":"2024-04-25T12:22:04.921039+0000","last_undegraded":"2024-04-25T12:22:04.921039+0000","last_fullsized":"2024-04-25T12:22:04.921039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:35:22.490243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:08.909090+0000","last_change":"2024-04-25T12:21:23.122495+0000","last_active":"2024-04-25T12:22:08.909090+0000","last_peered":"2024-04-25T12:22:08.909090+0000","last_clean":"2024-04-25T12:22:08.909090+0000","last_became_active":"2024-04-25T12:21:23.121429+0000","last_became_peered":"2024-04-25T12:21:23.121429+0000","last_unstale":"2024-04-25T12:22:08.909090+0000","last_undegraded":"2024-04-25T12:22:08.909090+0000","last_fullsized":"2024-04-25T12:22:08.909090+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:10.530248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.886402+0000","last_change":"2024-04-25T12:21:28.375971+0000","last_active":"2024-04-25T12:22:04.886402+0000","last_peered":"2024-04-25T12:22:04.886402+0000","last_clean":"2024-04-25T12:22:04.886402+0000","last_became_active":"2024-04-25T12:21:28.375013+0000","last_became_peered":"2024-04-25T12:21:28.375013+0000","last_unstale":"2024-04-25T12:22:04.886402+0000","last_undegraded":"2024-04-25T12:22:04.886402+0000","last_fullsized":"2024-04-25T12:22:04.886402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:56:45.398763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.895854+0000","last_change":"2024-04-25T12:21:24.138293+0000","last_active":"2024-04-25T12:22:04.895854+0000","last_peered":"2024-04-25T12:22:04.895854+0000","last_clean":"2024-04-25T12:22:04.895854+0000","last_became_active":"2024-04-25T12:21:24.138016+0000","last_became_peered":"2024-04-25T12:21:24.138016+0000","last_unstale":"2024-04-25T12:22:04.895854+0000","last_undegraded":"2024-04-25T12:22:04.895854+0000","last_fullsized":"2024-04-25T12:22:04.895854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:48:54.078239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'9","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:14.940825+0000","last_change":"2024-04-25T12:21:23.136227+0000","last_active":"2024-04-25T12:22:14.940825+0000","last_peered":"2024-04-25T12:22:14.940825+0000","last_clean":"2024-04-25T12:22:14.940825+0000","last_became_active":"2024-04-25T12:21:23.135947+0000","last_became_peered":"2024-04-25T12:21:23.135947+0000","last_unstale":"2024-04-25T12:22:14.940825+0000","last_undegraded":"2024-04-25T12:22:14.940825+0000","last_fullsized":"2024-04-25T12:22:14.940825+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:41:24.323924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.886878+0000","last_change":"2024-04-25T12:21:28.378564+0000","last_active":"2024-04-25T12:22:04.886878+0000","last_peered":"2024-04-25T12:22:04.886878+0000","last_clean":"2024-04-25T12:22:04.886878+0000","last_became_active":"2024-04-25T12:21:28.377532+0000","last_became_peered":"2024-04-25T12:21:28.377532+0000","last_unstale":"2024-04-25T12:22:04.886878+0000","last_undegraded":"2024-04-25T12:22:04.886878+0000","last_fullsized":"2024-04-25T12:22:04.886878+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:20.576562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.902496+0000","last_change":"2024-04-25T12:22:04.900963+0000","last_active":"2024-04-25T12:22:04.902496+0000","last_peered":"2024-04-25T12:22:04.902496+0000","last_clean":"2024-04-25T12:22:04.902496+0000","last_became_active":"2024-04-25T12:22:04.899942+0000","last_became_peered":"2024-04-25T12:22:04.899942+0000","last_unstale":"2024-04-25T12:22:04.902496+0000","last_undegraded":"2024-04-25T12:22:04.902496+0000","last_fullsized":"2024-04-25T12:22:04.902496+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:34:36.179214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.14","version":"26'16","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:23.494045+0000","last_change":"2024-04-25T12:21:23.130231+0000","last_active":"2024-04-25T12:22:23.494045+0000","last_peered":"2024-04-25T12:22:23.494045+0000","last_clean":"2024-04-25T12:22:23.494045+0000","last_became_active":"2024-04-25T12:21:23.129474+0000","last_became_peered":"2024-04-25T12:21:23.129474+0000","last_unstale":"2024-04-25T12:22:23.494045+0000","last_undegraded":"2024-04-25T12:22:23.494045+0000","last_fullsized":"2024-04-25T12:22:23.494045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:50.974387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4424,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.920504+0000","last_change":"2024-04-25T12:21:28.200551+0000","last_active":"2024-04-25T12:22:04.920504+0000","last_peered":"2024-04-25T12:22:04.920504+0000","last_clean":"2024-04-25T12:22:04.920504+0000","last_became_active":"2024-04-25T12:21:28.200152+0000","last_became_peered":"2024-04-25T12:21:28.200152+0000","last_unstale":"2024-04-25T12:22:04.920504+0000","last_undegraded":"2024-04-25T12:22:04.920504+0000","last_fullsized":"2024-04-25T12:22:04.920504+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:17:34.847925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.889734+0000","last_change":"2024-04-25T12:21:24.142957+0000","last_active":"2024-04-25T12:22:04.889734+0000","last_peered":"2024-04-25T12:22:04.889734+0000","last_clean":"2024-04-25T12:22:04.889734+0000","last_became_active":"2024-04-25T12:21:24.142594+0000","last_became_peered":"2024-04-25T12:21:24.142594+0000","last_unstale":"2024-04-25T12:22:04.889734+0000","last_undegraded":"2024-04-25T12:22:04.889734+0000","last_fullsized":"2024-04-25T12:22:04.889734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:36:47.719946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.922151+0000","last_change":"2024-04-25T12:21:23.125118+0000","last_active":"2024-04-25T12:22:04.922151+0000","last_peered":"2024-04-25T12:22:04.922151+0000","last_clean":"2024-04-25T12:22:04.922151+0000","last_became_active":"2024-04-25T12:21:23.124836+0000","last_became_peered":"2024-04-25T12:21:23.124836+0000","last_unstale":"2024-04-25T12:22:04.922151+0000","last_undegraded":"2024-04-25T12:22:04.922151+0000","last_fullsized":"2024-04-25T12:22:04.922151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:03:28.500940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.889244+0000","last_change":"2024-04-25T12:21:28.194476+0000","last_active":"2024-04-25T12:22:04.889244+0000","last_peered":"2024-04-25T12:22:04.889244+0000","last_clean":"2024-04-25T12:22:04.889244+0000","last_became_active":"2024-04-25T12:21:28.193277+0000","last_became_peered":"2024-04-25T12:21:28.193277+0000","last_unstale":"2024-04-25T12:22:04.889244+0000","last_undegraded":"2024-04-25T12:22:04.889244+0000","last_fullsized":"2024-04-25T12:22:04.889244+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:31.495441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.898278+0000","last_change":"2024-04-25T12:21:24.115104+0000","last_active":"2024-04-25T12:22:04.898278+0000","last_peered":"2024-04-25T12:22:04.898278+0000","last_clean":"2024-04-25T12:22:04.898278+0000","last_became_active":"2024-04-25T12:21:24.114367+0000","last_became_peered":"2024-04-25T12:21:24.114367+0000","last_unstale":"2024-04-25T12:22:04.898278+0000","last_undegraded":"2024-04-25T12:22:04.898278+0000","last_fullsized":"2024-04-25T12:22:04.898278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:03.107076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:14.951344+0000","last_change":"2024-04-25T12:21:23.132996+0000","last_active":"2024-04-25T12:22:14.951344+0000","last_peered":"2024-04-25T12:22:14.951344+0000","last_clean":"2024-04-25T12:22:14.951344+0000","last_became_active":"2024-04-25T12:21:23.132223+0000","last_became_peered":"2024-04-25T12:21:23.132223+0000","last_unstale":"2024-04-25T12:22:14.951344+0000","last_undegraded":"2024-04-25T12:22:14.951344+0000","last_fullsized":"2024-04-25T12:22:14.951344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:18.689461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.886057+0000","last_change":"2024-04-25T12:21:28.203302+0000","last_active":"2024-04-25T12:22:04.886057+0000","last_peered":"2024-04-25T12:22:04.886057+0000","last_clean":"2024-04-25T12:22:04.886057+0000","last_became_active":"2024-04-25T12:21:28.202800+0000","last_became_peered":"2024-04-25T12:21:28.202800+0000","last_unstale":"2024-04-25T12:22:04.886057+0000","last_undegraded":"2024-04-25T12:22:04.886057+0000","last_fullsized":"2024-04-25T12:22:04.886057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:27:16.676736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.925107+0000","last_change":"2024-04-25T12:22:04.922613+0000","last_active":"2024-04-25T12:22:04.925107+0000","last_peered":"2024-04-25T12:22:04.925107+0000","last_clean":"2024-04-25T12:22:04.925107+0000","last_became_active":"2024-04-25T12:22:04.921770+0000","last_became_peered":"2024-04-25T12:22:04.921770+0000","last_unstale":"2024-04-25T12:22:04.925107+0000","last_undegraded":"2024-04-25T12:22:04.925107+0000","last_fullsized":"2024-04-25T12:22:04.925107+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:19:15.639901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"26'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:23.484338+0000","last_change":"2024-04-25T12:21:23.130843+0000","last_active":"2024-04-25T12:22:23.484338+0000","last_peered":"2024-04-25T12:22:23.484338+0000","last_clean":"2024-04-25T12:22:23.484338+0000","last_became_active":"2024-04-25T12:21:23.129967+0000","last_became_peered":"2024-04-25T12:21:23.129967+0000","last_unstale":"2024-04-25T12:22:23.484338+0000","last_undegraded":"2024-04-25T12:22:23.484338+0000","last_fullsized":"2024-04-25T12:22:23.484338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:19:22.719364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.885925+0000","last_change":"2024-04-25T12:21:28.384082+0000","last_active":"2024-04-25T12:22:04.885925+0000","last_peered":"2024-04-25T12:22:04.885925+0000","last_clean":"2024-04-25T12:22:04.885925+0000","last_became_active":"2024-04-25T12:21:28.383228+0000","last_became_peered":"2024-04-25T12:21:28.383228+0000","last_unstale":"2024-04-25T12:22:04.885925+0000","last_undegraded":"2024-04-25T12:22:04.885925+0000","last_fullsized":"2024-04-25T12:22:04.885925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:14.600341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.898196+0000","last_change":"2024-04-25T12:21:28.378352+0000","last_active":"2024-04-25T12:22:04.898196+0000","last_peered":"2024-04-25T12:22:04.898196+0000","last_clean":"2024-04-25T12:22:04.898196+0000","last_became_active":"2024-04-25T12:21:28.377742+0000","last_became_peered":"2024-04-25T12:21:28.377742+0000","last_unstale":"2024-04-25T12:22:04.898196+0000","last_undegraded":"2024-04-25T12:22:04.898196+0000","last_fullsized":"2024-04-25T12:22:04.898196+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:20.075296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.920494+0000","last_change":"2024-04-25T12:21:24.126158+0000","last_active":"2024-04-25T12:22:04.920494+0000","last_peered":"2024-04-25T12:22:04.920494+0000","last_clean":"2024-04-25T12:22:04.920494+0000","last_became_active":"2024-04-25T12:21:24.125448+0000","last_became_peered":"2024-04-25T12:21:24.125448+0000","last_unstale":"2024-04-25T12:22:04.920494+0000","last_undegraded":"2024-04-25T12:22:04.920494+0000","last_fullsized":"2024-04-25T12:22:04.920494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:42.769206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:08.908401+0000","last_change":"2024-04-25T12:21:23.117159+0000","last_active":"2024-04-25T12:22:08.908401+0000","last_peered":"2024-04-25T12:22:08.908401+0000","last_clean":"2024-04-25T12:22:08.908401+0000","last_became_active":"2024-04-25T12:21:23.115911+0000","last_became_peered":"2024-04-25T12:21:23.115911+0000","last_unstale":"2024-04-25T12:22:08.908401+0000","last_undegraded":"2024-04-25T12:22:08.908401+0000","last_fullsized":"2024-04-25T12:22:08.908401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:46:10.238958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.900044+0000","last_change":"2024-04-25T12:22:04.900044+0000","last_active":"2024-04-25T12:22:04.900044+0000","last_peered":"2024-04-25T12:22:04.900044+0000","last_clean":"2024-04-25T12:22:04.900044+0000","last_became_active":"2024-04-25T12:22:04.899300+0000","last_became_peered":"2024-04-25T12:22:04.899300+0000","last_unstale":"2024-04-25T12:22:04.900044+0000","last_undegraded":"2024-04-25T12:22:04.900044+0000","last_fullsized":"2024-04-25T12:22:04.900044+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:00:51.607957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,0],"acting":[6,5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.886379+0000","last_change":"2024-04-25T12:21:24.137477+0000","last_active":"2024-04-25T12:22:04.886379+0000","last_peered":"2024-04-25T12:22:04.886379+0000","last_clean":"2024-04-25T12:22:04.886379+0000","last_became_active":"2024-04-25T12:21:24.137078+0000","last_became_peered":"2024-04-25T12:21:24.137078+0000","last_unstale":"2024-04-25T12:22:04.886379+0000","last_undegraded":"2024-04-25T12:22:04.886379+0000","last_fullsized":"2024-04-25T12:22:04.886379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:53.321239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.886985+0000","last_change":"2024-04-25T12:21:23.130046+0000","last_active":"2024-04-25T12:22:04.886985+0000","last_peered":"2024-04-25T12:22:04.886985+0000","last_clean":"2024-04-25T12:22:04.886985+0000","last_became_active":"2024-04-25T12:21:23.129779+0000","last_became_peered":"2024-04-25T12:21:23.129779+0000","last_unstale":"2024-04-25T12:22:04.886985+0000","last_undegraded":"2024-04-25T12:22:04.886985+0000","last_fullsized":"2024-04-25T12:22:04.886985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:24:43.733780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:08.910854+0000","last_change":"2024-04-25T12:21:23.138152+0000","last_active":"2024-04-25T12:22:08.910854+0000","last_peered":"2024-04-25T12:22:08.910854+0000","last_clean":"2024-04-25T12:22:08.910854+0000","last_became_active":"2024-04-25T12:21:23.137393+0000","last_became_peered":"2024-04-25T12:21:23.137393+0000","last_unstale":"2024-04-25T12:22:08.910854+0000","last_undegraded":"2024-04-25T12:22:08.910854+0000","last_fullsized":"2024-04-25T12:22:08.910854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:10:42.713304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.897354+0000","last_change":"2024-04-25T12:21:24.122299+0000","last_active":"2024-04-25T12:22:04.897354+0000","last_peered":"2024-04-25T12:22:04.897354+0000","last_clean":"2024-04-25T12:22:04.897354+0000","last_became_active":"2024-04-25T12:21:24.121480+0000","last_became_peered":"2024-04-25T12:21:24.121480+0000","last_unstale":"2024-04-25T12:22:04.897354+0000","last_undegraded":"2024-04-25T12:22:04.897354+0000","last_fullsized":"2024-04-25T12:22:04.897354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:05:46.050357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.900613+0000","last_change":"2024-04-25T12:22:04.900613+0000","last_active":"2024-04-25T12:22:04.900613+0000","last_peered":"2024-04-25T12:22:04.900613+0000","last_clean":"2024-04-25T12:22:04.900613+0000","last_became_active":"2024-04-25T12:22:04.900006+0000","last_became_peered":"2024-04-25T12:22:04.900006+0000","last_unstale":"2024-04-25T12:22:04.900613+0000","last_undegraded":"2024-04-25T12:22:04.900613+0000","last_fullsized":"2024-04-25T12:22:04.900613+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:06:18.454386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,5],"acting":[2,0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:23.483056+0000","last_change":"2024-04-25T12:21:23.113080+0000","last_active":"2024-04-25T12:22:23.483056+0000","last_peered":"2024-04-25T12:22:23.483056+0000","last_clean":"2024-04-25T12:22:23.483056+0000","last_became_active":"2024-04-25T12:21:23.112721+0000","last_became_peered":"2024-04-25T12:21:23.112721+0000","last_unstale":"2024-04-25T12:22:23.483056+0000","last_undegraded":"2024-04-25T12:22:23.483056+0000","last_fullsized":"2024-04-25T12:22:23.483056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:22.063439+0000","last_clean_scrub_stamp":"2024-04-25T12:21:22.063439+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:25.396377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.888327+0000","last_change":"2024-04-25T12:21:24.134267+0000","last_active":"2024-04-25T12:22:04.888327+0000","last_peered":"2024-04-25T12:22:04.888327+0000","last_clean":"2024-04-25T12:22:04.888327+0000","last_became_active":"2024-04-25T12:21:24.133493+0000","last_became_peered":"2024-04-25T12:21:24.133493+0000","last_unstale":"2024-04-25T12:22:04.888327+0000","last_undegraded":"2024-04-25T12:22:04.888327+0000","last_fullsized":"2024-04-25T12:22:04.888327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:24:25.810067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.896184+0000","last_change":"2024-04-25T12:22:04.896184+0000","last_active":"2024-04-25T12:22:04.896184+0000","last_peered":"2024-04-25T12:22:04.896184+0000","last_clean":"2024-04-25T12:22:04.896184+0000","last_became_active":"2024-04-25T12:22:04.895198+0000","last_became_peered":"2024-04-25T12:22:04.895198+0000","last_unstale":"2024-04-25T12:22:04.896184+0000","last_undegraded":"2024-04-25T12:22:04.896184+0000","last_fullsized":"2024-04-25T12:22:04.896184+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:00.687023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,2],"acting":[3,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.892094+0000","last_change":"2024-04-25T12:21:24.126582+0000","last_active":"2024-04-25T12:22:04.892094+0000","last_peered":"2024-04-25T12:22:04.892094+0000","last_clean":"2024-04-25T12:22:04.892094+0000","last_became_active":"2024-04-25T12:21:24.125831+0000","last_became_peered":"2024-04-25T12:21:24.125831+0000","last_unstale":"2024-04-25T12:22:04.892094+0000","last_undegraded":"2024-04-25T12:22:04.892094+0000","last_fullsized":"2024-04-25T12:22:04.892094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:53.129274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.891228+0000","last_change":"2024-04-25T12:21:24.117441+0000","last_active":"2024-04-25T12:22:04.891228+0000","last_peered":"2024-04-25T12:22:04.891228+0000","last_clean":"2024-04-25T12:22:04.891228+0000","last_became_active":"2024-04-25T12:21:24.116498+0000","last_became_peered":"2024-04-25T12:21:24.116498+0000","last_unstale":"2024-04-25T12:22:04.891228+0000","last_undegraded":"2024-04-25T12:22:04.891228+0000","last_fullsized":"2024-04-25T12:22:04.891228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:06:45.632199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.886040+0000","last_change":"2024-04-25T12:21:24.117995+0000","last_active":"2024-04-25T12:22:04.886040+0000","last_peered":"2024-04-25T12:22:04.886040+0000","last_clean":"2024-04-25T12:22:04.886040+0000","last_became_active":"2024-04-25T12:21:24.114742+0000","last_became_peered":"2024-04-25T12:21:24.114742+0000","last_unstale":"2024-04-25T12:22:04.886040+0000","last_undegraded":"2024-04-25T12:22:04.886040+0000","last_fullsized":"2024-04-25T12:22:04.886040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:59.864082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.897343+0000","last_change":"2024-04-25T12:21:24.134863+0000","last_active":"2024-04-25T12:22:04.897343+0000","last_peered":"2024-04-25T12:22:04.897343+0000","last_clean":"2024-04-25T12:22:04.897343+0000","last_became_active":"2024-04-25T12:21:24.126476+0000","last_became_peered":"2024-04-25T12:21:24.126476+0000","last_unstale":"2024-04-25T12:22:04.897343+0000","last_undegraded":"2024-04-25T12:22:04.897343+0000","last_fullsized":"2024-04-25T12:22:04.897343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:19:32.516429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.887326+0000","last_change":"2024-04-25T12:21:24.135699+0000","last_active":"2024-04-25T12:22:04.887326+0000","last_peered":"2024-04-25T12:22:04.887326+0000","last_clean":"2024-04-25T12:22:04.887326+0000","last_became_active":"2024-04-25T12:21:24.135257+0000","last_became_peered":"2024-04-25T12:21:24.135257+0000","last_unstale":"2024-04-25T12:22:04.887326+0000","last_undegraded":"2024-04-25T12:22:04.887326+0000","last_fullsized":"2024-04-25T12:22:04.887326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:55:21.195220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.921749+0000","last_change":"2024-04-25T12:21:24.132760+0000","last_active":"2024-04-25T12:22:04.921749+0000","last_peered":"2024-04-25T12:22:04.921749+0000","last_clean":"2024-04-25T12:22:04.921749+0000","last_became_active":"2024-04-25T12:21:24.132225+0000","last_became_peered":"2024-04-25T12:21:24.132225+0000","last_unstale":"2024-04-25T12:22:04.921749+0000","last_undegraded":"2024-04-25T12:22:04.921749+0000","last_fullsized":"2024-04-25T12:22:04.921749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:44:23.025905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.895018+0000","last_change":"2024-04-25T12:21:24.148515+0000","last_active":"2024-04-25T12:22:04.895018+0000","last_peered":"2024-04-25T12:22:04.895018+0000","last_clean":"2024-04-25T12:22:04.895018+0000","last_became_active":"2024-04-25T12:21:24.148025+0000","last_became_peered":"2024-04-25T12:21:24.148025+0000","last_unstale":"2024-04-25T12:22:04.895018+0000","last_undegraded":"2024-04-25T12:22:04.895018+0000","last_fullsized":"2024-04-25T12:22:04.895018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:49:29.665678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.888799+0000","last_change":"2024-04-25T12:21:24.135856+0000","last_active":"2024-04-25T12:22:04.888799+0000","last_peered":"2024-04-25T12:22:04.888799+0000","last_clean":"2024-04-25T12:22:04.888799+0000","last_became_active":"2024-04-25T12:21:24.135310+0000","last_became_peered":"2024-04-25T12:21:24.135310+0000","last_unstale":"2024-04-25T12:22:04.888799+0000","last_undegraded":"2024-04-25T12:22:04.888799+0000","last_fullsized":"2024-04-25T12:22:04.888799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:02.396753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.885451+0000","last_change":"2024-04-25T12:21:24.119002+0000","last_active":"2024-04-25T12:22:04.885451+0000","last_peered":"2024-04-25T12:22:04.885451+0000","last_clean":"2024-04-25T12:22:04.885451+0000","last_became_active":"2024-04-25T12:21:24.112992+0000","last_became_peered":"2024-04-25T12:21:24.112992+0000","last_unstale":"2024-04-25T12:22:04.885451+0000","last_undegraded":"2024-04-25T12:22:04.885451+0000","last_fullsized":"2024-04-25T12:22:04.885451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:44:34.461656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.886239+0000","last_change":"2024-04-25T12:21:24.118251+0000","last_active":"2024-04-25T12:22:04.886239+0000","last_peered":"2024-04-25T12:22:04.886239+0000","last_clean":"2024-04-25T12:22:04.886239+0000","last_became_active":"2024-04-25T12:21:24.117412+0000","last_became_peered":"2024-04-25T12:21:24.117412+0000","last_unstale":"2024-04-25T12:22:04.886239+0000","last_undegraded":"2024-04-25T12:22:04.886239+0000","last_fullsized":"2024-04-25T12:22:04.886239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:44:13.238510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.885958+0000","last_change":"2024-04-25T12:21:24.138641+0000","last_active":"2024-04-25T12:22:04.885958+0000","last_peered":"2024-04-25T12:22:04.885958+0000","last_clean":"2024-04-25T12:22:04.885958+0000","last_became_active":"2024-04-25T12:21:24.137937+0000","last_became_peered":"2024-04-25T12:21:24.137937+0000","last_unstale":"2024-04-25T12:22:04.885958+0000","last_undegraded":"2024-04-25T12:22:04.885958+0000","last_fullsized":"2024-04-25T12:22:04.885958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:55:49.291319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.896812+0000","last_change":"2024-04-25T12:21:24.137779+0000","last_active":"2024-04-25T12:22:04.896812+0000","last_peered":"2024-04-25T12:22:04.896812+0000","last_clean":"2024-04-25T12:22:04.896812+0000","last_became_active":"2024-04-25T12:21:24.137431+0000","last_became_peered":"2024-04-25T12:21:24.137431+0000","last_unstale":"2024-04-25T12:22:04.896812+0000","last_undegraded":"2024-04-25T12:22:04.896812+0000","last_fullsized":"2024-04-25T12:22:04.896812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:24:24.181972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.894528+0000","last_change":"2024-04-25T12:21:24.128960+0000","last_active":"2024-04-25T12:22:04.894528+0000","last_peered":"2024-04-25T12:22:04.894528+0000","last_clean":"2024-04-25T12:22:04.894528+0000","last_became_active":"2024-04-25T12:21:24.128125+0000","last_became_peered":"2024-04-25T12:21:24.128125+0000","last_unstale":"2024-04-25T12:22:04.894528+0000","last_undegraded":"2024-04-25T12:22:04.894528+0000","last_fullsized":"2024-04-25T12:22:04.894528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:01.701850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.921873+0000","last_change":"2024-04-25T12:21:24.149001+0000","last_active":"2024-04-25T12:22:04.921873+0000","last_peered":"2024-04-25T12:22:04.921873+0000","last_clean":"2024-04-25T12:22:04.921873+0000","last_became_active":"2024-04-25T12:21:24.147230+0000","last_became_peered":"2024-04-25T12:21:24.147230+0000","last_unstale":"2024-04-25T12:22:04.921873+0000","last_undegraded":"2024-04-25T12:22:04.921873+0000","last_fullsized":"2024-04-25T12:22:04.921873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:05:17.824845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.891883+0000","last_change":"2024-04-25T12:21:24.119941+0000","last_active":"2024-04-25T12:22:04.891883+0000","last_peered":"2024-04-25T12:22:04.891883+0000","last_clean":"2024-04-25T12:22:04.891883+0000","last_became_active":"2024-04-25T12:21:24.118761+0000","last_became_peered":"2024-04-25T12:21:24.118761+0000","last_unstale":"2024-04-25T12:22:04.891883+0000","last_undegraded":"2024-04-25T12:22:04.891883+0000","last_fullsized":"2024-04-25T12:22:04.891883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:49:41.353812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.887528+0000","last_change":"2024-04-25T12:21:24.144163+0000","last_active":"2024-04-25T12:22:04.887528+0000","last_peered":"2024-04-25T12:22:04.887528+0000","last_clean":"2024-04-25T12:22:04.887528+0000","last_became_active":"2024-04-25T12:21:24.143786+0000","last_became_peered":"2024-04-25T12:21:24.143786+0000","last_unstale":"2024-04-25T12:22:04.887528+0000","last_undegraded":"2024-04-25T12:22:04.887528+0000","last_fullsized":"2024-04-25T12:22:04.887528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:17.961437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.885408+0000","last_change":"2024-04-25T12:21:24.107551+0000","last_active":"2024-04-25T12:22:04.885408+0000","last_peered":"2024-04-25T12:22:04.885408+0000","last_clean":"2024-04-25T12:22:04.885408+0000","last_became_active":"2024-04-25T12:21:24.106818+0000","last_became_peered":"2024-04-25T12:21:24.106818+0000","last_unstale":"2024-04-25T12:22:04.885408+0000","last_undegraded":"2024-04-25T12:22:04.885408+0000","last_fullsized":"2024-04-25T12:22:04.885408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:09:24.627007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.920846+0000","last_change":"2024-04-25T12:21:24.114917+0000","last_active":"2024-04-25T12:22:04.920846+0000","last_peered":"2024-04-25T12:22:04.920846+0000","last_clean":"2024-04-25T12:22:04.920846+0000","last_became_active":"2024-04-25T12:21:24.114237+0000","last_became_peered":"2024-04-25T12:21:24.114237+0000","last_unstale":"2024-04-25T12:22:04.920846+0000","last_undegraded":"2024-04-25T12:22:04.920846+0000","last_fullsized":"2024-04-25T12:22:04.920846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:32:38.296553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.895600+0000","last_change":"2024-04-25T12:21:24.132860+0000","last_active":"2024-04-25T12:22:04.895600+0000","last_peered":"2024-04-25T12:22:04.895600+0000","last_clean":"2024-04-25T12:22:04.895600+0000","last_became_active":"2024-04-25T12:21:24.132094+0000","last_became_peered":"2024-04-25T12:21:24.132094+0000","last_unstale":"2024-04-25T12:22:04.895600+0000","last_undegraded":"2024-04-25T12:22:04.895600+0000","last_fullsized":"2024-04-25T12:22:04.895600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:27:24.026145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.901390+0000","last_change":"2024-04-25T12:22:04.897436+0000","last_active":"2024-04-25T12:22:04.901390+0000","last_peered":"2024-04-25T12:22:04.901390+0000","last_clean":"2024-04-25T12:22:04.901390+0000","last_became_active":"2024-04-25T12:22:04.896529+0000","last_became_peered":"2024-04-25T12:22:04.896529+0000","last_unstale":"2024-04-25T12:22:04.901390+0000","last_undegraded":"2024-04-25T12:22:04.901390+0000","last_fullsized":"2024-04-25T12:22:04.901390+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:02:55.727071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.889462+0000","last_change":"2024-04-25T12:21:24.124288+0000","last_active":"2024-04-25T12:22:04.889462+0000","last_peered":"2024-04-25T12:22:04.889462+0000","last_clean":"2024-04-25T12:22:04.889462+0000","last_became_active":"2024-04-25T12:21:24.116973+0000","last_became_peered":"2024-04-25T12:21:24.116973+0000","last_unstale":"2024-04-25T12:22:04.889462+0000","last_undegraded":"2024-04-25T12:22:04.889462+0000","last_fullsized":"2024-04-25T12:22:04.889462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:34:53.390321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.894234+0000","last_change":"2024-04-25T12:21:24.115615+0000","last_active":"2024-04-25T12:22:04.894234+0000","last_peered":"2024-04-25T12:22:04.894234+0000","last_clean":"2024-04-25T12:22:04.894234+0000","last_became_active":"2024-04-25T12:21:24.114829+0000","last_became_peered":"2024-04-25T12:21:24.114829+0000","last_unstale":"2024-04-25T12:22:04.894234+0000","last_undegraded":"2024-04-25T12:22:04.894234+0000","last_fullsized":"2024-04-25T12:22:04.894234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:17.961437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.895028+0000","last_change":"2024-04-25T12:21:24.117225+0000","last_active":"2024-04-25T12:22:04.895028+0000","last_peered":"2024-04-25T12:22:04.895028+0000","last_clean":"2024-04-25T12:22:04.895028+0000","last_became_active":"2024-04-25T12:21:24.116359+0000","last_became_peered":"2024-04-25T12:21:24.116359+0000","last_unstale":"2024-04-25T12:22:04.895028+0000","last_undegraded":"2024-04-25T12:22:04.895028+0000","last_fullsized":"2024-04-25T12:22:04.895028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:22:27.461512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.921638+0000","last_change":"2024-04-25T12:21:24.145198+0000","last_active":"2024-04-25T12:22:04.921638+0000","last_peered":"2024-04-25T12:22:04.921638+0000","last_clean":"2024-04-25T12:22:04.921638+0000","last_became_active":"2024-04-25T12:21:24.142353+0000","last_became_peered":"2024-04-25T12:21:24.142353+0000","last_unstale":"2024-04-25T12:22:04.921638+0000","last_undegraded":"2024-04-25T12:22:04.921638+0000","last_fullsized":"2024-04-25T12:22:04.921638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:44:24.335226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.885945+0000","last_change":"2024-04-25T12:21:24.128086+0000","last_active":"2024-04-25T12:22:04.885945+0000","last_peered":"2024-04-25T12:22:04.885945+0000","last_clean":"2024-04-25T12:22:04.885945+0000","last_became_active":"2024-04-25T12:21:24.127315+0000","last_became_peered":"2024-04-25T12:21:24.127315+0000","last_unstale":"2024-04-25T12:22:04.885945+0000","last_undegraded":"2024-04-25T12:22:04.885945+0000","last_fullsized":"2024-04-25T12:22:04.885945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:20.513145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.920184+0000","last_change":"2024-04-25T12:21:24.142394+0000","last_active":"2024-04-25T12:22:04.920184+0000","last_peered":"2024-04-25T12:22:04.920184+0000","last_clean":"2024-04-25T12:22:04.920184+0000","last_became_active":"2024-04-25T12:21:24.142029+0000","last_became_peered":"2024-04-25T12:21:24.142029+0000","last_unstale":"2024-04-25T12:22:04.920184+0000","last_undegraded":"2024-04-25T12:22:04.920184+0000","last_fullsized":"2024-04-25T12:22:04.920184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:02:56.129724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.885858+0000","last_change":"2024-04-25T12:21:24.113876+0000","last_active":"2024-04-25T12:22:04.885858+0000","last_peered":"2024-04-25T12:22:04.885858+0000","last_clean":"2024-04-25T12:22:04.885858+0000","last_became_active":"2024-04-25T12:21:24.112339+0000","last_became_peered":"2024-04-25T12:21:24.112339+0000","last_unstale":"2024-04-25T12:22:04.885858+0000","last_undegraded":"2024-04-25T12:22:04.885858+0000","last_fullsized":"2024-04-25T12:22:04.885858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:31:44.641068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.920602+0000","last_change":"2024-04-25T12:21:24.144879+0000","last_active":"2024-04-25T12:22:04.920602+0000","last_peered":"2024-04-25T12:22:04.920602+0000","last_clean":"2024-04-25T12:22:04.920602+0000","last_became_active":"2024-04-25T12:21:24.142422+0000","last_became_peered":"2024-04-25T12:21:24.142422+0000","last_unstale":"2024-04-25T12:22:04.920602+0000","last_undegraded":"2024-04-25T12:22:04.920602+0000","last_fullsized":"2024-04-25T12:22:04.920602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:03.206429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.886225+0000","last_change":"2024-04-25T12:21:24.132561+0000","last_active":"2024-04-25T12:22:04.886225+0000","last_peered":"2024-04-25T12:22:04.886225+0000","last_clean":"2024-04-25T12:22:04.886225+0000","last_became_active":"2024-04-25T12:21:24.131746+0000","last_became_peered":"2024-04-25T12:21:24.131746+0000","last_unstale":"2024-04-25T12:22:04.886225+0000","last_undegraded":"2024-04-25T12:22:04.886225+0000","last_fullsized":"2024-04-25T12:22:04.886225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:24.441417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.898100+0000","last_change":"2024-04-25T12:21:24.111956+0000","last_active":"2024-04-25T12:22:04.898100+0000","last_peered":"2024-04-25T12:22:04.898100+0000","last_clean":"2024-04-25T12:22:04.898100+0000","last_became_active":"2024-04-25T12:21:24.111154+0000","last_became_peered":"2024-04-25T12:21:24.111154+0000","last_unstale":"2024-04-25T12:22:04.898100+0000","last_undegraded":"2024-04-25T12:22:04.898100+0000","last_fullsized":"2024-04-25T12:22:04.898100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:39:56.070884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.922005+0000","last_change":"2024-04-25T12:21:24.134511+0000","last_active":"2024-04-25T12:22:04.922005+0000","last_peered":"2024-04-25T12:22:04.922005+0000","last_clean":"2024-04-25T12:22:04.922005+0000","last_became_active":"2024-04-25T12:21:24.133839+0000","last_became_peered":"2024-04-25T12:21:24.133839+0000","last_unstale":"2024-04-25T12:22:04.922005+0000","last_undegraded":"2024-04-25T12:22:04.922005+0000","last_fullsized":"2024-04-25T12:22:04.922005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:43.263673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.921347+0000","last_change":"2024-04-25T12:21:24.147519+0000","last_active":"2024-04-25T12:22:04.921347+0000","last_peered":"2024-04-25T12:22:04.921347+0000","last_clean":"2024-04-25T12:22:04.921347+0000","last_became_active":"2024-04-25T12:21:24.146805+0000","last_became_peered":"2024-04-25T12:21:24.146805+0000","last_unstale":"2024-04-25T12:22:04.921347+0000","last_undegraded":"2024-04-25T12:22:04.921347+0000","last_fullsized":"2024-04-25T12:22:04.921347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:23.200746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":12592,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":25184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":194,"ondisk_log_size":194,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":909312,"data_stored":707411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":120157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":327680,"data_stored":118875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":116273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":120191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":116405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":115893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":901120,"data_stored":705603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":5796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T12:22:42.148 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-04-25T12:21:22.063439+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.148 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-25T12:21:23.073559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.148 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-25T12:21:27.142878+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=27, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.148 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-04-25T12:21:22.063439+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.149 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-25T12:21:23.073559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.149 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-25T12:21:27.142878+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=27, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.149 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-04-25T12:21:22.063439+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.149 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-25T12:21:23.073559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.149 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-25T12:21:27.142878+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=27, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.149 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-04-25T12:21:22.063439+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.150 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-25T12:21:23.073559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.150 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-25T12:21:27.142878+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=27, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.150 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-25T12:21:23.073559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.150 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-04-25T12:21:22.063439+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.150 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-25T12:21:27.142878+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=27, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.150 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-25T12:21:23.073559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.151 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-04-25T12:21:22.063439+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.151 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-25T12:21:27.142878+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=27, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.151 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-25T12:21:23.073559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.151 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-04-25T12:21:22.063439+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.151 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-25T12:21:27.142878+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=27, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.151 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-25T12:21:23.073559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.152 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-04-25T12:21:22.063439+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.152 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-25T12:21:27.142878+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=27, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.152 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-25T12:21:23.073559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.152 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-25T12:21:22.063439+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.152 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-25T12:21:27.142878+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=27, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.152 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-25T12:21:23.073559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.152 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-25T12:21:22.063439+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.153 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-25T12:21:27.142878+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=27, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.153 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-25T12:21:23.073559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.153 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-25T12:21:22.063439+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.153 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-25T12:21:27.142878+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=27, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.153 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-25T12:21:23.073559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.153 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-25T12:21:22.063439+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.154 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-25T12:21:27.142878+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=27, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.154 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-25T12:21:23.073559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.154 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-25T12:21:22.063439+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.154 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-25T12:21:27.142878+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=27, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.154 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-25T12:21:23.073559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.154 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-25T12:21:22.063439+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.155 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-25T12:21:27.142878+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=27, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.155 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-25T12:21:23.073559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.155 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-25T12:21:22.063439+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.155 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-25T12:21:27.142878+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=27, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.155 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-25T12:21:23.073559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.155 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-25T12:21:22.063439+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.156 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-25T12:21:12.013694+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.156 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-25T12:21:27.142878+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=27, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.156 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-25T12:21:23.073559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.156 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-04-25T12:21:22.063439+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.156 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-25T12:21:27.142878+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=27, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.157 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-25T12:21:23.073559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.157 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-04-25T12:21:22.063439+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.157 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-25T12:21:27.142878+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=27, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.157 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-25T12:21:23.073559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.157 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-04-25T12:21:22.063439+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.157 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-25T12:21:27.142878+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=27, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.158 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-25T12:21:23.073559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.158 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-04-25T12:21:22.063439+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.158 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-25T12:21:27.142878+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=27, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.158 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-25T12:21:23.073559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.158 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-04-25T12:21:22.063439+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.158 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-25T12:21:27.142878+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=27, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.159 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-25T12:21:23.073559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.159 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-04-25T12:21:22.063439+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.159 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-25T12:21:27.142878+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=27, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.159 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-25T12:21:23.073559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.159 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-04-25T12:21:22.063439+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.159 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-25T12:21:27.142878+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=27, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.160 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-25T12:21:23.073559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.160 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-04-25T12:21:22.063439+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.160 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-25T12:21:27.142878+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=27, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.160 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-25T12:21:23.073559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.160 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-04-25T12:21:22.063439+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.161 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-25T12:21:27.142878+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=27, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.161 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-25T12:21:23.073559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.161 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-04-25T12:21:22.063439+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.161 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-25T12:21:27.142878+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=27, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.161 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-25T12:21:23.073559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.161 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-04-25T12:21:22.063439+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.162 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-25T12:21:27.142878+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=27, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.162 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-25T12:21:23.073559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.162 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-04-25T12:21:22.063439+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.162 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-25T12:21:27.142878+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=27, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.162 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-25T12:21:27.142878+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=27, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.163 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-25T12:21:23.073559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.163 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-04-25T12:21:22.063439+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.163 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-25T12:21:27.142878+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=27, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.163 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-25T12:21:23.073559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.163 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-04-25T12:21:22.063439+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.163 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-04-25T12:21:22.063439+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.164 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-25T12:21:23.073559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.164 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-25T12:21:27.142878+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=27, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.164 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-04-25T12:21:22.063439+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.164 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-25T12:21:23.073559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.164 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-25T12:21:27.142878+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=27, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.164 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-25T12:21:23.073559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.165 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-25T12:21:23.073559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.165 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-25T12:21:23.073559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.165 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-25T12:21:23.073559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.165 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-25T12:21:23.073559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.165 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-25T12:21:23.073559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.166 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-25T12:21:23.073559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.166 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-25T12:21:23.073559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.166 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-25T12:21:23.073559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.166 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-25T12:21:23.073559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.166 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-25T12:21:23.073559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.167 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-25T12:21:23.073559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.167 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-25T12:21:23.073559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.167 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-25T12:21:23.073559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.167 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-25T12:21:23.073559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.167 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-25T12:21:23.073559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.168 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-25T12:21:23.073559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.168 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-25T12:21:23.073559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.168 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-25T12:21:23.073559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.168 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-25T12:21:23.073559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.168 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-25T12:21:23.073559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.168 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-25T12:21:23.073559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.169 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-25T12:21:23.073559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.169 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-25T12:21:23.073559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.169 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-25T12:21:23.073559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.169 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-25T12:21:23.073559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.169 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-25T12:21:23.073559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.170 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-25T12:21:23.073559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.170 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-25T12:21:23.073559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.170 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-25T12:21:23.073559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.170 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-25T12:21:23.073559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.170 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-25T12:21:23.073559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:22:42.170 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-25T12:22:53.068 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T12:22:53.071 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T12:23:02.172 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T12:23:02.303 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.301+0000 7fbeacd0e640 1 Processor -- start 2024-04-25T12:23:02.304 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.301+0000 7fbeacd0e640 1 -- start start 2024-04-25T12:23:02.307 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.301+0000 7fbeacd0e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbea80c9c10 0x7fbea80c91c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:23:02.307 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.301+0000 7fbeacd0e640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbea80ca960 con 0x7fbea80c5f20 2024-04-25T12:23:02.308 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.301+0000 7fbeacd0e640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbea80c7f30 con 0x7fbea80c9700 2024-04-25T12:23:02.308 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.301+0000 7fbeacd0e640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fbea80ca0c0 con 0x7fbea80c9c10 2024-04-25T12:23:02.308 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.301+0000 7fbea659c640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fbea80c5f20 0x7fbea80c86f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:45354/0 (socket says 172.21.15.86:45354) 2024-04-25T12:23:02.308 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.301+0000 7fbea659c640 1 -- 172.21.15.86:0/2517118419 learned_addr learned my addr 172.21.15.86:0/2517118419 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-04-25T12:23:02.308 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.301+0000 7fbe9ffff640 1 --2- 172.21.15.86:0/2517118419 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbea80c9c10 0x7fbea80c91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:23:02.308 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.301+0000 7fbea5d9b640 1 -- 172.21.15.86:0/2517118419 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2920584785 0 0) 0x7fbea80ca960 con 0x7fbea80c5f20 2024-04-25T12:23:02.308 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.301+0000 7fbea5d9b640 1 -- 172.21.15.86:0/2517118419 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe94003530 con 0x7fbea80c5f20 2024-04-25T12:23:02.309 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.301+0000 7fbea5d9b640 1 -- 172.21.15.86:0/2517118419 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1466124534 0 0) 0x7fbe94003530 con 0x7fbea80c5f20 2024-04-25T12:23:02.309 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.301+0000 7fbea5d9b640 1 -- 172.21.15.86:0/2517118419 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbea80c9c10 msgr2=0x7fbea80c91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:23:02.309 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.301+0000 7fbea5d9b640 1 --2- 172.21.15.86:0/2517118419 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbea80c9c10 0x7fbea80c91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:02.309 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.301+0000 7fbea5d9b640 1 -- 172.21.15.86:0/2517118419 >> v1:172.21.15.134:6789/0 conn(0x7fbea80c9700 legacy=0x7fbea8152c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:23:02.309 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.301+0000 7fbea5d9b640 1 -- 172.21.15.86:0/2517118419 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbea80ca3a0 con 0x7fbea80c5f20 2024-04-25T12:23:02.309 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.301+0000 7fbea5d9b640 1 -- 172.21.15.86:0/2517118419 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1387950573 0 0) 0x7fbe90001680 con 0x7fbea80c5f20 2024-04-25T12:23:02.309 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.301+0000 7fbea5d9b640 1 -- 172.21.15.86:0/2517118419 >> v1:172.21.15.86:6789/0 conn(0x7fbea80c5f20 legacy=0x7fbea80c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:23:02.310 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.301+0000 7fbea5d9b640 1 --2- 172.21.15.86:0/2517118419 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbea80c9c10 0x7fbe940039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:23:02.310 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.301+0000 7fbea5d9b640 1 --2- 172.21.15.86:0/2517118419 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbe94003f70 0x7fbe94004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:23:02.310 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.301+0000 7fbea5d9b640 1 --2- 172.21.15.86:0/2517118419 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe94004d50 0x7fbe940051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:23:02.310 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.301+0000 7fbea5d9b640 1 -- 172.21.15.86:0/2517118419 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fbea80ca0c0 con 0x7fbe94003f70 2024-04-25T12:23:02.310 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.301+0000 7fbea5d9b640 1 -- 172.21.15.86:0/2517118419 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbe9400bb40 con 0x7fbe94004d50 2024-04-25T12:23:02.310 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.301+0000 7fbea5d9b640 1 -- 172.21.15.86:0/2517118419 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fbe9400bd40 con 0x7fbea80c9c10 2024-04-25T12:23:02.310 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.301+0000 7fbe9ffff640 1 --2- 172.21.15.86:0/2517118419 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbe94003f70 0x7fbe94004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:23:02.311 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.301+0000 7fbea659c640 1 --2- 172.21.15.86:0/2517118419 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbea80c9c10 0x7fbe940039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:23:02.311 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.301+0000 7fbea6d9d640 1 --2- 172.21.15.86:0/2517118419 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe94004d50 0x7fbe940051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:23:02.311 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.301+0000 7fbe9ffff640 1 -- 172.21.15.86:0/2517118419 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbea80c9c10 msgr2=0x7fbe940039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:23:02.311 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.301+0000 7fbe9ffff640 1 --2- 172.21.15.86:0/2517118419 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbea80c9c10 0x7fbe940039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:02.311 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.301+0000 7fbe9ffff640 1 -- 172.21.15.86:0/2517118419 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe94004d50 msgr2=0x7fbe940051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:23:02.311 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.301+0000 7fbe9ffff640 1 --2- 172.21.15.86:0/2517118419 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe94004d50 0x7fbe940051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:02.311 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.301+0000 7fbe9ffff640 1 -- 172.21.15.86:0/2517118419 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe94003530 con 0x7fbe94003f70 2024-04-25T12:23:02.316 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.305+0000 7fbe9ffff640 1 --2- 172.21.15.86:0/2517118419 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbe94003f70 0x7fbe94004810 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fbe98009ab0 tx=0x7fbe9801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d78e2c468fc44d79 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:23:02.316 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.305+0000 7fbea5d9b640 1 -- 172.21.15.86:0/2517118419 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe980b2070 con 0x7fbe94003f70 2024-04-25T12:23:02.316 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.305+0000 7fbea5d9b640 1 -- 172.21.15.86:0/2517118419 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe980a5640 con 0x7fbe94003f70 2024-04-25T12:23:02.316 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.305+0000 7fbea5d9b640 1 -- 172.21.15.86:0/2517118419 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe980096b0 con 0x7fbe94003f70 2024-04-25T12:23:02.316 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.305+0000 7fbeacd0e640 1 -- 172.21.15.86:0/2517118419 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbe94003f70 msgr2=0x7fbe94004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:23:02.316 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.305+0000 7fbeacd0e640 1 --2- 172.21.15.86:0/2517118419 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbe94003f70 0x7fbe94004810 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fbe98009ab0 tx=0x7fbe9801ca50 comp rx=0 tx=0).stop 2024-04-25T12:23:02.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.305+0000 7fbea6d9d640 1 -- 172.21.15.86:0/2517118419 reap_dead start 2024-04-25T12:23:02.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.305+0000 7fbeacd0e640 1 -- 172.21.15.86:0/2517118419 shutdown_connections 2024-04-25T12:23:02.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.305+0000 7fbeacd0e640 1 -- 172.21.15.86:0/2517118419 >> 172.21.15.86:0/2517118419 conn(0x7fbea80676a0 msgr2=0x7fbea8067ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:23:02.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.305+0000 7fbeacd0e640 1 -- 172.21.15.86:0/2517118419 shutdown_connections 2024-04-25T12:23:02.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.305+0000 7fbeacd0e640 1 -- 172.21.15.86:0/2517118419 wait complete. 2024-04-25T12:23:02.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.305+0000 7fbeacd0e640 1 Processor -- start 2024-04-25T12:23:02.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.305+0000 7fbeacd0e640 1 -- start start 2024-04-25T12:23:02.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.309+0000 7fbeacd0e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe94003f70 0x7fbea81484b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:23:02.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.309+0000 7fbeacd0e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbea80cc670 0x7fbea814e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:23:02.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.309+0000 7fbeacd0e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbea814ee60 0x7fbea814a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:23:02.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.309+0000 7fbeacd0e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fbea80c5830 con 0x7fbea80cc670 2024-04-25T12:23:02.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.309+0000 7fbeacd0e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbea80c81d0 con 0x7fbea814ee60 2024-04-25T12:23:02.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.309+0000 7fbeacd0e640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fbea80c59b0 con 0x7fbe94003f70 2024-04-25T12:23:02.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.309+0000 7fbe9ffff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbea80cc670 0x7fbea814e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:23:02.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.309+0000 7fbe9ffff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbea80cc670 0x7fbea814e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51570/0 (socket says 172.21.15.86:51570) 2024-04-25T12:23:02.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.309+0000 7fbe9ffff640 1 -- 172.21.15.86:0/3607534391 learned_addr learned my addr 172.21.15.86:0/3607534391 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:23:02.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.309+0000 7fbea659c640 1 --2- 172.21.15.86:0/3607534391 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe94003f70 0x7fbea81484b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:23:02.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.309+0000 7fbea6d9d640 1 --2- 172.21.15.86:0/3607534391 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbea814ee60 0x7fbea814a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:23:02.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.309+0000 7fbe9ffff640 1 -- 172.21.15.86:0/3607534391 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe94003f70 msgr2=0x7fbea81484b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:23:02.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.309+0000 7fbe9ffff640 1 --2- 172.21.15.86:0/3607534391 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe94003f70 0x7fbea81484b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:02.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.309+0000 7fbe9ffff640 1 -- 172.21.15.86:0/3607534391 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbea814ee60 msgr2=0x7fbea814a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:23:02.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.309+0000 7fbe9ffff640 1 --2- 172.21.15.86:0/3607534391 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbea814ee60 0x7fbea814a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:02.320 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.309+0000 7fbe9ffff640 1 -- 172.21.15.86:0/3607534391 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbea814dfd0 con 0x7fbea80cc670 2024-04-25T12:23:02.320 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.309+0000 7fbe9ffff640 1 --2- 172.21.15.86:0/3607534391 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbea80cc670 0x7fbea814e920 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fbe98009ab0 tx=0x7fbe94005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:23:02.320 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.309+0000 7fbe9effd640 1 -- 172.21.15.86:0/3607534391 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe980bc020 con 0x7fbea80cc670 2024-04-25T12:23:02.320 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.309+0000 7fbe9effd640 1 -- 172.21.15.86:0/3607534391 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe98004020 con 0x7fbea80cc670 2024-04-25T12:23:02.320 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.309+0000 7fbeacd0e640 1 -- 172.21.15.86:0/3607534391 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbea814e2b0 con 0x7fbea80cc670 2024-04-25T12:23:02.320 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.309+0000 7fbe9effd640 1 -- 172.21.15.86:0/3607534391 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe980b2040 con 0x7fbea80cc670 2024-04-25T12:23:02.320 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.309+0000 7fbeacd0e640 1 -- 172.21.15.86:0/3607534391 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbea814ceb0 con 0x7fbea80cc670 2024-04-25T12:23:02.321 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.309+0000 7fbeacd0e640 1 -- 172.21.15.86:0/3607534391 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbea8075df0 con 0x7fbea80cc670 2024-04-25T12:23:02.321 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.309+0000 7fbe9effd640 1 -- 172.21.15.86:0/3607534391 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbe98003620 con 0x7fbea80cc670 2024-04-25T12:23:02.321 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.309+0000 7fbe9effd640 1 --2- 172.21.15.86:0/3607534391 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fbe88068380 0x7fbe8806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:23:02.321 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.309+0000 7fbe9effd640 1 -- 172.21.15.86:0/3607534391 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fbe981211d0 con 0x7fbea80cc670 2024-04-25T12:23:02.321 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.309+0000 7fbea659c640 1 --2- 172.21.15.86:0/3607534391 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fbe88068380 0x7fbe8806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:23:02.321 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.313+0000 7fbea659c640 1 --2- 172.21.15.86:0/3607534391 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fbe88068380 0x7fbe8806a840 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbe90001ec0 tx=0x7fbe90007040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:23:02.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.317+0000 7fbe9effd640 1 -- 172.21.15.86:0/3607534391 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbe980c6020 con 0x7fbea80cc670 2024-04-25T12:23:02.478 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.473+0000 7fbeacd0e640 1 -- 172.21.15.86:0/3607534391 --> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbea80ccee0 con 0x7fbe88068380 2024-04-25T12:23:02.487 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.485+0000 7fbe9effd640 1 -- 172.21.15.86:0/3607534391 <== mgr.4107 v2:172.21.15.86:6832/3708662606 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332516 (secure 0 0 0) 0x7fbea80ccee0 con 0x7fbe88068380 2024-04-25T12:23:02.491 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:23:02.493 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2024-04-25T12:23:02.494 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.489+0000 7fbeacd0e640 1 -- 172.21.15.86:0/3607534391 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fbe88068380 msgr2=0x7fbe8806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:23:02.495 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.489+0000 7fbeacd0e640 1 --2- 172.21.15.86:0/3607534391 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fbe88068380 0x7fbe8806a840 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbe90001ec0 tx=0x7fbe90007040 comp rx=0 tx=0).stop 2024-04-25T12:23:02.495 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.489+0000 7fbeacd0e640 1 -- 172.21.15.86:0/3607534391 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbea80cc670 msgr2=0x7fbea814e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:23:02.495 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.489+0000 7fbeacd0e640 1 --2- 172.21.15.86:0/3607534391 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbea80cc670 0x7fbea814e920 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fbe98009ab0 tx=0x7fbe94005840 comp rx=0 tx=0).stop 2024-04-25T12:23:02.495 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.489+0000 7fbeacd0e640 1 -- 172.21.15.86:0/3607534391 shutdown_connections 2024-04-25T12:23:02.495 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.489+0000 7fbeacd0e640 1 --2- 172.21.15.86:0/3607534391 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbea814ee60 0x7fbea814a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:02.495 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.489+0000 7fbeacd0e640 1 --2- 172.21.15.86:0/3607534391 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fbe88068380 0x7fbe8806a840 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:02.495 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.489+0000 7fbeacd0e640 1 --2- 172.21.15.86:0/3607534391 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbea80cc670 0x7fbea814e920 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:02.495 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.489+0000 7fbeacd0e640 1 --2- 172.21.15.86:0/3607534391 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe94003f70 0x7fbea81484b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:02.496 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.489+0000 7fbeacd0e640 1 -- 172.21.15.86:0/3607534391 >> 172.21.15.86:0/3607534391 conn(0x7fbea80676a0 msgr2=0x7fbea8071160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:23:02.496 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.489+0000 7fbeacd0e640 1 -- 172.21.15.86:0/3607534391 shutdown_connections 2024-04-25T12:23:02.496 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:02.489+0000 7fbeacd0e640 1 -- 172.21.15.86:0/3607534391 wait complete. 2024-04-25T12:23:02.510 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":74,"stamp":"2024-04-25T12:23:01.833208+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":602960,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":379,"num_write_kb":2494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":391,"ondisk_log_size":391,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223880,"kb_used_data":3592,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750840,"statfs":{"total":773094113280,"available":772864860160,"internally_reserved":0,"allocated":3678208,"data_stored":2120808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004933"},"pg_stats":[{"pgid":"2.1f","version":"26'18","reported_seq":53,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:40.336349+0000","last_change":"2024-04-25T12:22:40.336380+0000","last_active":"2024-04-25T12:22:40.336349+0000","last_peered":"2024-04-25T12:22:40.336349+0000","last_clean":"2024-04-25T12:22:40.336349+0000","last_became_active":"2024-04-25T12:21:23.123863+0000","last_became_peered":"2024-04-25T12:21:23.123863+0000","last_unstale":"2024-04-25T12:22:40.336349+0000","last_undegraded":"2024-04-25T12:22:40.336349+0000","last_fullsized":"2024-04-25T12:22:40.336349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'18","last_scrub_stamp":"2024-04-25T12:22:40.336281+0000","last_deep_scrub":"26'18","last_deep_scrub_stamp":"2024-04-25T12:22:40.336281+0000","last_clean_scrub_stamp":"2024-04-25T12:22:40.336281+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:20.470268+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:42.562674+0000","last_change":"2024-04-25T12:22:42.562727+0000","last_active":"2024-04-25T12:22:42.562674+0000","last_peered":"2024-04-25T12:22:42.562674+0000","last_clean":"2024-04-25T12:22:42.562674+0000","last_became_active":"2024-04-25T12:21:24.141482+0000","last_became_peered":"2024-04-25T12:21:24.141482+0000","last_unstale":"2024-04-25T12:22:42.562674+0000","last_undegraded":"2024-04-25T12:22:42.562674+0000","last_fullsized":"2024-04-25T12:22:42.562674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:42.562478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:42.562478+0000","last_clean_scrub_stamp":"2024-04-25T12:22:42.562478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:46:56.890508+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:56.529910+0000","last_change":"2024-04-25T12:22:56.529973+0000","last_active":"2024-04-25T12:22:56.529910+0000","last_peered":"2024-04-25T12:22:56.529910+0000","last_clean":"2024-04-25T12:22:56.529910+0000","last_became_active":"2024-04-25T12:21:28.376966+0000","last_became_peered":"2024-04-25T12:21:28.376966+0000","last_unstale":"2024-04-25T12:22:56.529910+0000","last_undegraded":"2024-04-25T12:22:56.529910+0000","last_fullsized":"2024-04-25T12:22:56.529910+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:56.529733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:56.529733+0000","last_clean_scrub_stamp":"2024-04-25T12:22:56.529733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:31:35.817338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'2","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:45.583873+0000","last_change":"2024-04-25T12:22:45.583935+0000","last_active":"2024-04-25T12:22:45.583873+0000","last_peered":"2024-04-25T12:22:45.583873+0000","last_clean":"2024-04-25T12:22:45.583873+0000","last_became_active":"2024-04-25T12:21:23.113605+0000","last_became_peered":"2024-04-25T12:21:23.113605+0000","last_unstale":"2024-04-25T12:22:45.583873+0000","last_undegraded":"2024-04-25T12:22:45.583873+0000","last_fullsized":"2024-04-25T12:22:45.583873+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'2","last_scrub_stamp":"2024-04-25T12:22:45.583695+0000","last_deep_scrub":"24'2","last_deep_scrub_stamp":"2024-04-25T12:22:45.583695+0000","last_clean_scrub_stamp":"2024-04-25T12:22:45.583695+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:01:51.656276+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:55.319539+0000","last_change":"2024-04-25T12:22:55.319638+0000","last_active":"2024-04-25T12:22:55.319539+0000","last_peered":"2024-04-25T12:22:55.319539+0000","last_clean":"2024-04-25T12:22:55.319539+0000","last_became_active":"2024-04-25T12:22:04.925895+0000","last_became_peered":"2024-04-25T12:22:04.925895+0000","last_unstale":"2024-04-25T12:22:55.319539+0000","last_undegraded":"2024-04-25T12:22:55.319539+0000","last_fullsized":"2024-04-25T12:22:55.319539+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:55.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:55.319253+0000","last_clean_scrub_stamp":"2024-04-25T12:22:55.319253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:00:05.379516+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:53.537851+0000","last_change":"2024-04-25T12:22:53.537958+0000","last_active":"2024-04-25T12:22:53.537851+0000","last_peered":"2024-04-25T12:22:53.537851+0000","last_clean":"2024-04-25T12:22:53.537851+0000","last_became_active":"2024-04-25T12:21:28.204404+0000","last_became_peered":"2024-04-25T12:21:28.204404+0000","last_unstale":"2024-04-25T12:22:53.537851+0000","last_undegraded":"2024-04-25T12:22:53.537851+0000","last_fullsized":"2024-04-25T12:22:53.537851+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:53.537585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:53.537585+0000","last_clean_scrub_stamp":"2024-04-25T12:22:53.537585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:51:32.614692+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'18","reported_seq":53,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:48.744798+0000","last_change":"2024-04-25T12:22:48.744876+0000","last_active":"2024-04-25T12:22:48.744798+0000","last_peered":"2024-04-25T12:22:48.744798+0000","last_clean":"2024-04-25T12:22:48.744798+0000","last_became_active":"2024-04-25T12:21:23.131566+0000","last_became_peered":"2024-04-25T12:21:23.131566+0000","last_unstale":"2024-04-25T12:22:48.744798+0000","last_undegraded":"2024-04-25T12:22:48.744798+0000","last_fullsized":"2024-04-25T12:22:48.744798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'18","last_scrub_stamp":"2024-04-25T12:22:48.744628+0000","last_deep_scrub":"26'18","last_deep_scrub_stamp":"2024-04-25T12:22:48.744628+0000","last_clean_scrub_stamp":"2024-04-25T12:22:48.744628+0000","objects_scrubbed":7,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:01:02.447634+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:50.930135+0000","last_change":"2024-04-25T12:22:50.930188+0000","last_active":"2024-04-25T12:22:50.930135+0000","last_peered":"2024-04-25T12:22:50.930135+0000","last_clean":"2024-04-25T12:22:50.930135+0000","last_became_active":"2024-04-25T12:21:24.128027+0000","last_became_peered":"2024-04-25T12:21:24.128027+0000","last_unstale":"2024-04-25T12:22:50.930135+0000","last_undegraded":"2024-04-25T12:22:50.930135+0000","last_fullsized":"2024-04-25T12:22:50.930135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:50.929953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:50.929953+0000","last_clean_scrub_stamp":"2024-04-25T12:22:50.929953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:19.337434+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:52.575801+0000","last_change":"2024-04-25T12:22:52.575860+0000","last_active":"2024-04-25T12:22:52.575801+0000","last_peered":"2024-04-25T12:22:52.575801+0000","last_clean":"2024-04-25T12:22:52.575801+0000","last_became_active":"2024-04-25T12:21:28.201228+0000","last_became_peered":"2024-04-25T12:21:28.201228+0000","last_unstale":"2024-04-25T12:22:52.575801+0000","last_undegraded":"2024-04-25T12:22:52.575801+0000","last_fullsized":"2024-04-25T12:22:52.575801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:52.575605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:52.575605+0000","last_clean_scrub_stamp":"2024-04-25T12:22:52.575605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:00.104515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'8","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:47.713281+0000","last_change":"2024-04-25T12:22:47.713353+0000","last_active":"2024-04-25T12:22:47.713281+0000","last_peered":"2024-04-25T12:22:47.713281+0000","last_clean":"2024-04-25T12:22:47.713281+0000","last_became_active":"2024-04-25T12:21:23.127717+0000","last_became_peered":"2024-04-25T12:21:23.127717+0000","last_unstale":"2024-04-25T12:22:47.713281+0000","last_undegraded":"2024-04-25T12:22:47.713281+0000","last_fullsized":"2024-04-25T12:22:47.713281+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-04-25T12:22:47.713102+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-04-25T12:22:47.713102+0000","last_clean_scrub_stamp":"2024-04-25T12:22:47.713102+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:51:02.373171+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:40.919651+0000","last_change":"2024-04-25T12:22:40.919705+0000","last_active":"2024-04-25T12:22:40.919651+0000","last_peered":"2024-04-25T12:22:40.919651+0000","last_clean":"2024-04-25T12:22:40.919651+0000","last_became_active":"2024-04-25T12:21:24.121392+0000","last_became_peered":"2024-04-25T12:21:24.121392+0000","last_unstale":"2024-04-25T12:22:40.919651+0000","last_undegraded":"2024-04-25T12:22:40.919651+0000","last_fullsized":"2024-04-25T12:22:40.919651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:40.919449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:40.919449+0000","last_clean_scrub_stamp":"2024-04-25T12:22:40.919449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:54:31.674064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:47.626532+0000","last_change":"2024-04-25T12:22:47.626593+0000","last_active":"2024-04-25T12:22:47.626532+0000","last_peered":"2024-04-25T12:22:47.626532+0000","last_clean":"2024-04-25T12:22:47.626532+0000","last_became_active":"2024-04-25T12:21:28.187340+0000","last_became_peered":"2024-04-25T12:21:28.187340+0000","last_unstale":"2024-04-25T12:22:47.626532+0000","last_undegraded":"2024-04-25T12:22:47.626532+0000","last_fullsized":"2024-04-25T12:22:47.626532+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:47.626350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:47.626350+0000","last_clean_scrub_stamp":"2024-04-25T12:22:47.626350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:39:57.411515+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:49.303087+0000","last_change":"2024-04-25T12:22:49.303142+0000","last_active":"2024-04-25T12:22:49.303087+0000","last_peered":"2024-04-25T12:22:49.303087+0000","last_clean":"2024-04-25T12:22:49.303087+0000","last_became_active":"2024-04-25T12:21:24.123695+0000","last_became_peered":"2024-04-25T12:21:24.123695+0000","last_unstale":"2024-04-25T12:22:49.303087+0000","last_undegraded":"2024-04-25T12:22:49.303087+0000","last_fullsized":"2024-04-25T12:22:49.303087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:49.302901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:49.302901+0000","last_clean_scrub_stamp":"2024-04-25T12:22:49.302901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:25:22.812559+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'6","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:49.719112+0000","last_change":"2024-04-25T12:22:49.719183+0000","last_active":"2024-04-25T12:22:49.719112+0000","last_peered":"2024-04-25T12:22:49.719112+0000","last_clean":"2024-04-25T12:22:49.719112+0000","last_became_active":"2024-04-25T12:21:23.139025+0000","last_became_peered":"2024-04-25T12:21:23.139025+0000","last_unstale":"2024-04-25T12:22:49.719112+0000","last_undegraded":"2024-04-25T12:22:49.719112+0000","last_fullsized":"2024-04-25T12:22:49.719112+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-04-25T12:22:49.718945+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-04-25T12:22:49.718945+0000","last_clean_scrub_stamp":"2024-04-25T12:22:49.718945+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:58.946427+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:46.632102+0000","last_change":"2024-04-25T12:22:46.632185+0000","last_active":"2024-04-25T12:22:46.632102+0000","last_peered":"2024-04-25T12:22:46.632102+0000","last_clean":"2024-04-25T12:22:46.632102+0000","last_became_active":"2024-04-25T12:21:28.187619+0000","last_became_peered":"2024-04-25T12:21:28.187619+0000","last_unstale":"2024-04-25T12:22:46.632102+0000","last_undegraded":"2024-04-25T12:22:46.632102+0000","last_fullsized":"2024-04-25T12:22:46.632102+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:46.631911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:46.631911+0000","last_clean_scrub_stamp":"2024-04-25T12:22:46.631911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:45:46.230182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:43.541177+0000","last_change":"2024-04-25T12:22:43.541235+0000","last_active":"2024-04-25T12:22:43.541177+0000","last_peered":"2024-04-25T12:22:43.541177+0000","last_clean":"2024-04-25T12:22:43.541177+0000","last_became_active":"2024-04-25T12:21:24.136535+0000","last_became_peered":"2024-04-25T12:21:24.136535+0000","last_unstale":"2024-04-25T12:22:43.541177+0000","last_undegraded":"2024-04-25T12:22:43.541177+0000","last_fullsized":"2024-04-25T12:22:43.541177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:43.540978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:43.540978+0000","last_clean_scrub_stamp":"2024-04-25T12:22:43.540978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:36:03.693964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'4","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:40.605728+0000","last_change":"2024-04-25T12:22:40.605784+0000","last_active":"2024-04-25T12:22:40.605728+0000","last_peered":"2024-04-25T12:22:40.605728+0000","last_clean":"2024-04-25T12:22:40.605728+0000","last_became_active":"2024-04-25T12:21:23.105051+0000","last_became_peered":"2024-04-25T12:21:23.105051+0000","last_unstale":"2024-04-25T12:22:40.605728+0000","last_undegraded":"2024-04-25T12:22:40.605728+0000","last_fullsized":"2024-04-25T12:22:40.605728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2024-04-25T12:22:40.605629+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2024-04-25T12:22:40.605629+0000","last_clean_scrub_stamp":"2024-04-25T12:22:40.605629+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:30.162807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:51.546419+0000","last_change":"2024-04-25T12:22:51.546481+0000","last_active":"2024-04-25T12:22:51.546419+0000","last_peered":"2024-04-25T12:22:51.546419+0000","last_clean":"2024-04-25T12:22:51.546419+0000","last_became_active":"2024-04-25T12:21:28.201389+0000","last_became_peered":"2024-04-25T12:21:28.201389+0000","last_unstale":"2024-04-25T12:22:51.546419+0000","last_undegraded":"2024-04-25T12:22:51.546419+0000","last_fullsized":"2024-04-25T12:22:51.546419+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:51.546228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:51.546228+0000","last_clean_scrub_stamp":"2024-04-25T12:22:51.546228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:51:02.870030+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:40.533252+0000","last_change":"2024-04-25T12:22:40.533278+0000","last_active":"2024-04-25T12:22:40.533252+0000","last_peered":"2024-04-25T12:22:40.533252+0000","last_clean":"2024-04-25T12:22:40.533252+0000","last_became_active":"2024-04-25T12:21:24.138446+0000","last_became_peered":"2024-04-25T12:21:24.138446+0000","last_unstale":"2024-04-25T12:22:40.533252+0000","last_undegraded":"2024-04-25T12:22:40.533252+0000","last_fullsized":"2024-04-25T12:22:40.533252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:40.533171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:40.533171+0000","last_clean_scrub_stamp":"2024-04-25T12:22:40.533171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:42.709007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'10","reported_seq":45,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:44.663914+0000","last_change":"2024-04-25T12:22:44.663987+0000","last_active":"2024-04-25T12:22:44.663914+0000","last_peered":"2024-04-25T12:22:44.663914+0000","last_clean":"2024-04-25T12:22:44.663914+0000","last_became_active":"2024-04-25T12:21:23.126521+0000","last_became_peered":"2024-04-25T12:21:23.126521+0000","last_unstale":"2024-04-25T12:22:44.663914+0000","last_undegraded":"2024-04-25T12:22:44.663914+0000","last_fullsized":"2024-04-25T12:22:44.663914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'10","last_scrub_stamp":"2024-04-25T12:22:44.663739+0000","last_deep_scrub":"26'10","last_deep_scrub_stamp":"2024-04-25T12:22:44.663739+0000","last_clean_scrub_stamp":"2024-04-25T12:22:44.663739+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:16:39.942970+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:55.660274+0000","last_change":"2024-04-25T12:22:55.660336+0000","last_active":"2024-04-25T12:22:55.660274+0000","last_peered":"2024-04-25T12:22:55.660274+0000","last_clean":"2024-04-25T12:22:55.660274+0000","last_became_active":"2024-04-25T12:21:28.383568+0000","last_became_peered":"2024-04-25T12:21:28.383568+0000","last_unstale":"2024-04-25T12:22:55.660274+0000","last_undegraded":"2024-04-25T12:22:55.660274+0000","last_fullsized":"2024-04-25T12:22:55.660274+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:55.660066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:55.660066+0000","last_clean_scrub_stamp":"2024-04-25T12:22:55.660066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:56:56.367844+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:42.498716+0000","last_change":"2024-04-25T12:22:42.498819+0000","last_active":"2024-04-25T12:22:42.498716+0000","last_peered":"2024-04-25T12:22:42.498716+0000","last_clean":"2024-04-25T12:22:42.498716+0000","last_became_active":"2024-04-25T12:21:24.121963+0000","last_became_peered":"2024-04-25T12:21:24.121963+0000","last_unstale":"2024-04-25T12:22:42.498716+0000","last_undegraded":"2024-04-25T12:22:42.498716+0000","last_fullsized":"2024-04-25T12:22:42.498716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:42.498481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:42.498481+0000","last_clean_scrub_stamp":"2024-04-25T12:22:42.498481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:24:53.367814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'3","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:45.759053+0000","last_change":"2024-04-25T12:22:45.759118+0000","last_active":"2024-04-25T12:22:45.759053+0000","last_peered":"2024-04-25T12:22:45.759053+0000","last_clean":"2024-04-25T12:22:45.759053+0000","last_became_active":"2024-04-25T12:21:23.115571+0000","last_became_peered":"2024-04-25T12:21:23.115571+0000","last_unstale":"2024-04-25T12:22:45.759053+0000","last_undegraded":"2024-04-25T12:22:45.759053+0000","last_fullsized":"2024-04-25T12:22:45.759053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-04-25T12:22:45.758887+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-04-25T12:22:45.758887+0000","last_clean_scrub_stamp":"2024-04-25T12:22:45.758887+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:58:25.859480+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:49.566845+0000","last_change":"2024-04-25T12:22:49.566915+0000","last_active":"2024-04-25T12:22:49.566845+0000","last_peered":"2024-04-25T12:22:49.566845+0000","last_clean":"2024-04-25T12:22:49.566845+0000","last_became_active":"2024-04-25T12:21:28.201297+0000","last_became_peered":"2024-04-25T12:21:28.201297+0000","last_unstale":"2024-04-25T12:22:49.566845+0000","last_undegraded":"2024-04-25T12:22:49.566845+0000","last_fullsized":"2024-04-25T12:22:49.566845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:49.566642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:49.566642+0000","last_clean_scrub_stamp":"2024-04-25T12:22:49.566642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:29:28.595245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:47.380267+0000","last_change":"2024-04-25T12:22:47.380324+0000","last_active":"2024-04-25T12:22:47.380267+0000","last_peered":"2024-04-25T12:22:47.380267+0000","last_clean":"2024-04-25T12:22:47.380267+0000","last_became_active":"2024-04-25T12:21:24.132703+0000","last_became_peered":"2024-04-25T12:21:24.132703+0000","last_unstale":"2024-04-25T12:22:47.380267+0000","last_undegraded":"2024-04-25T12:22:47.380267+0000","last_fullsized":"2024-04-25T12:22:47.380267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:47.380093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:47.380093+0000","last_clean_scrub_stamp":"2024-04-25T12:22:47.380093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:33:55.596755+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'10","reported_seq":45,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:44.300030+0000","last_change":"2024-04-25T12:22:44.300114+0000","last_active":"2024-04-25T12:22:44.300030+0000","last_peered":"2024-04-25T12:22:44.300030+0000","last_clean":"2024-04-25T12:22:44.300030+0000","last_became_active":"2024-04-25T12:21:23.131628+0000","last_became_peered":"2024-04-25T12:21:23.131628+0000","last_unstale":"2024-04-25T12:22:44.300030+0000","last_undegraded":"2024-04-25T12:22:44.300030+0000","last_fullsized":"2024-04-25T12:22:44.300030+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'10","last_scrub_stamp":"2024-04-25T12:22:44.299858+0000","last_deep_scrub":"26'10","last_deep_scrub_stamp":"2024-04-25T12:22:44.299858+0000","last_clean_scrub_stamp":"2024-04-25T12:22:44.299858+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:49:40.204289+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:54.537749+0000","last_change":"2024-04-25T12:22:54.537806+0000","last_active":"2024-04-25T12:22:54.537749+0000","last_peered":"2024-04-25T12:22:54.537749+0000","last_clean":"2024-04-25T12:22:54.537749+0000","last_became_active":"2024-04-25T12:21:28.376224+0000","last_became_peered":"2024-04-25T12:21:28.376224+0000","last_unstale":"2024-04-25T12:22:54.537749+0000","last_undegraded":"2024-04-25T12:22:54.537749+0000","last_fullsized":"2024-04-25T12:22:54.537749+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:54.537567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:54.537567+0000","last_clean_scrub_stamp":"2024-04-25T12:22:54.537567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:43:05.193650+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:52.517434+0000","last_change":"2024-04-25T12:22:52.517491+0000","last_active":"2024-04-25T12:22:52.517434+0000","last_peered":"2024-04-25T12:22:52.517434+0000","last_clean":"2024-04-25T12:22:52.517434+0000","last_became_active":"2024-04-25T12:21:24.145132+0000","last_became_peered":"2024-04-25T12:21:24.145132+0000","last_unstale":"2024-04-25T12:22:52.517434+0000","last_undegraded":"2024-04-25T12:22:52.517434+0000","last_fullsized":"2024-04-25T12:22:52.517434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:52.517264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:52.517264+0000","last_clean_scrub_stamp":"2024-04-25T12:22:52.517264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:16:44.554002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'11","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:45.633511+0000","last_change":"2024-04-25T12:22:45.633592+0000","last_active":"2024-04-25T12:22:45.633511+0000","last_peered":"2024-04-25T12:22:45.633511+0000","last_clean":"2024-04-25T12:22:45.633511+0000","last_became_active":"2024-04-25T12:21:23.130612+0000","last_became_peered":"2024-04-25T12:21:23.130612+0000","last_unstale":"2024-04-25T12:22:45.633511+0000","last_undegraded":"2024-04-25T12:22:45.633511+0000","last_fullsized":"2024-04-25T12:22:45.633511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'11","last_scrub_stamp":"2024-04-25T12:22:45.633339+0000","last_deep_scrub":"26'11","last_deep_scrub_stamp":"2024-04-25T12:22:45.633339+0000","last_clean_scrub_stamp":"2024-04-25T12:22:45.633339+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:16:53.089405+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:54.497643+0000","last_change":"2024-04-25T12:22:54.497699+0000","last_active":"2024-04-25T12:22:54.497643+0000","last_peered":"2024-04-25T12:22:54.497643+0000","last_clean":"2024-04-25T12:22:54.497643+0000","last_became_active":"2024-04-25T12:21:28.374813+0000","last_became_peered":"2024-04-25T12:21:28.374813+0000","last_unstale":"2024-04-25T12:22:54.497643+0000","last_undegraded":"2024-04-25T12:22:54.497643+0000","last_fullsized":"2024-04-25T12:22:54.497643+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:54.497470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:54.497470+0000","last_clean_scrub_stamp":"2024-04-25T12:22:54.497470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:04:33.119936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:46.666467+0000","last_change":"2024-04-25T12:22:46.666527+0000","last_active":"2024-04-25T12:22:46.666467+0000","last_peered":"2024-04-25T12:22:46.666467+0000","last_clean":"2024-04-25T12:22:46.666467+0000","last_became_active":"2024-04-25T12:21:24.111430+0000","last_became_peered":"2024-04-25T12:21:24.111430+0000","last_unstale":"2024-04-25T12:22:46.666467+0000","last_undegraded":"2024-04-25T12:22:46.666467+0000","last_fullsized":"2024-04-25T12:22:46.666467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:46.666218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:46.666218+0000","last_clean_scrub_stamp":"2024-04-25T12:22:46.666218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:29.071242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'7","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:46.743538+0000","last_change":"2024-04-25T12:22:46.743610+0000","last_active":"2024-04-25T12:22:46.743538+0000","last_peered":"2024-04-25T12:22:46.743538+0000","last_clean":"2024-04-25T12:22:46.743538+0000","last_became_active":"2024-04-25T12:21:23.123492+0000","last_became_peered":"2024-04-25T12:21:23.123492+0000","last_unstale":"2024-04-25T12:22:46.743538+0000","last_undegraded":"2024-04-25T12:22:46.743538+0000","last_fullsized":"2024-04-25T12:22:46.743538+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-04-25T12:22:46.743372+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-04-25T12:22:46.743372+0000","last_clean_scrub_stamp":"2024-04-25T12:22:46.743372+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:50:20.215243+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:52.320294+0000","last_change":"2024-04-25T12:22:52.320357+0000","last_active":"2024-04-25T12:22:52.320294+0000","last_peered":"2024-04-25T12:22:52.320294+0000","last_clean":"2024-04-25T12:22:52.320294+0000","last_became_active":"2024-04-25T12:21:28.375119+0000","last_became_peered":"2024-04-25T12:21:28.375119+0000","last_unstale":"2024-04-25T12:22:52.320294+0000","last_undegraded":"2024-04-25T12:22:52.320294+0000","last_fullsized":"2024-04-25T12:22:52.320294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:52.320113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:52.320113+0000","last_clean_scrub_stamp":"2024-04-25T12:22:52.320113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:06.167567+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:52.941569+0000","last_change":"2024-04-25T12:22:52.941620+0000","last_active":"2024-04-25T12:22:52.941569+0000","last_peered":"2024-04-25T12:22:52.941569+0000","last_clean":"2024-04-25T12:22:52.941569+0000","last_became_active":"2024-04-25T12:21:24.130866+0000","last_became_peered":"2024-04-25T12:21:24.130866+0000","last_unstale":"2024-04-25T12:22:52.941569+0000","last_undegraded":"2024-04-25T12:22:52.941569+0000","last_fullsized":"2024-04-25T12:22:52.941569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:52.941395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:52.941395+0000","last_clean_scrub_stamp":"2024-04-25T12:22:52.941395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:07:58.027149+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"26'1","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:41.601999+0000","last_change":"2024-04-25T12:22:41.602024+0000","last_active":"2024-04-25T12:22:41.601999+0000","last_peered":"2024-04-25T12:22:41.601999+0000","last_clean":"2024-04-25T12:22:41.601999+0000","last_became_active":"2024-04-25T12:21:23.105809+0000","last_became_peered":"2024-04-25T12:21:23.105809+0000","last_unstale":"2024-04-25T12:22:41.601999+0000","last_undegraded":"2024-04-25T12:22:41.601999+0000","last_fullsized":"2024-04-25T12:22:41.601999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1","last_scrub_stamp":"2024-04-25T12:22:41.601927+0000","last_deep_scrub":"26'1","last_deep_scrub_stamp":"2024-04-25T12:22:41.601927+0000","last_clean_scrub_stamp":"2024-04-25T12:22:41.601927+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:15.506966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:52.643491+0000","last_change":"2024-04-25T12:22:52.643560+0000","last_active":"2024-04-25T12:22:52.643491+0000","last_peered":"2024-04-25T12:22:52.643491+0000","last_clean":"2024-04-25T12:22:52.643491+0000","last_became_active":"2024-04-25T12:21:28.192835+0000","last_became_peered":"2024-04-25T12:21:28.192835+0000","last_unstale":"2024-04-25T12:22:52.643491+0000","last_undegraded":"2024-04-25T12:22:52.643491+0000","last_fullsized":"2024-04-25T12:22:52.643491+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:52.643313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:52.643313+0000","last_clean_scrub_stamp":"2024-04-25T12:22:52.643313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:05:32.459029+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:43.506245+0000","last_change":"2024-04-25T12:22:43.506297+0000","last_active":"2024-04-25T12:22:43.506245+0000","last_peered":"2024-04-25T12:22:43.506245+0000","last_clean":"2024-04-25T12:22:43.506245+0000","last_became_active":"2024-04-25T12:21:24.124563+0000","last_became_peered":"2024-04-25T12:21:24.124563+0000","last_unstale":"2024-04-25T12:22:43.506245+0000","last_undegraded":"2024-04-25T12:22:43.506245+0000","last_fullsized":"2024-04-25T12:22:43.506245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:43.506083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:43.506083+0000","last_clean_scrub_stamp":"2024-04-25T12:22:43.506083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:36:29.972364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'5","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:43.930933+0000","last_change":"2024-04-25T12:22:43.930999+0000","last_active":"2024-04-25T12:22:43.930933+0000","last_peered":"2024-04-25T12:22:43.930933+0000","last_clean":"2024-04-25T12:22:43.930933+0000","last_became_active":"2024-04-25T12:21:23.113504+0000","last_became_peered":"2024-04-25T12:21:23.113504+0000","last_unstale":"2024-04-25T12:22:43.930933+0000","last_undegraded":"2024-04-25T12:22:43.930933+0000","last_fullsized":"2024-04-25T12:22:43.930933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-04-25T12:22:43.930764+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-04-25T12:22:43.930764+0000","last_clean_scrub_stamp":"2024-04-25T12:22:43.930764+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:24:04.507696+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:53.638361+0000","last_change":"2024-04-25T12:22:53.638480+0000","last_active":"2024-04-25T12:22:53.638361+0000","last_peered":"2024-04-25T12:22:53.638361+0000","last_clean":"2024-04-25T12:22:53.638361+0000","last_became_active":"2024-04-25T12:21:28.200082+0000","last_became_peered":"2024-04-25T12:21:28.200082+0000","last_unstale":"2024-04-25T12:22:53.638361+0000","last_undegraded":"2024-04-25T12:22:53.638361+0000","last_fullsized":"2024-04-25T12:22:53.638361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:53.638117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:53.638117+0000","last_clean_scrub_stamp":"2024-04-25T12:22:53.638117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:50.858381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:47.625138+0000","last_change":"2024-04-25T12:22:47.625192+0000","last_active":"2024-04-25T12:22:47.625138+0000","last_peered":"2024-04-25T12:22:47.625138+0000","last_clean":"2024-04-25T12:22:47.625138+0000","last_became_active":"2024-04-25T12:21:24.111503+0000","last_became_peered":"2024-04-25T12:21:24.111503+0000","last_unstale":"2024-04-25T12:22:47.625138+0000","last_undegraded":"2024-04-25T12:22:47.625138+0000","last_fullsized":"2024-04-25T12:22:47.625138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:47.624933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:47.624933+0000","last_clean_scrub_stamp":"2024-04-25T12:22:47.624933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:56:32.673946+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'7","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:41.722905+0000","last_change":"2024-04-25T12:22:41.722951+0000","last_active":"2024-04-25T12:22:41.722905+0000","last_peered":"2024-04-25T12:22:41.722905+0000","last_clean":"2024-04-25T12:22:41.722905+0000","last_became_active":"2024-04-25T12:21:23.108051+0000","last_became_peered":"2024-04-25T12:21:23.108051+0000","last_unstale":"2024-04-25T12:22:41.722905+0000","last_undegraded":"2024-04-25T12:22:41.722905+0000","last_fullsized":"2024-04-25T12:22:41.722905+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-04-25T12:22:41.722809+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-04-25T12:22:41.722809+0000","last_clean_scrub_stamp":"2024-04-25T12:22:41.722809+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:03:55.630408+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:51.625153+0000","last_change":"2024-04-25T12:22:51.625212+0000","last_active":"2024-04-25T12:22:51.625153+0000","last_peered":"2024-04-25T12:22:51.625153+0000","last_clean":"2024-04-25T12:22:51.625153+0000","last_became_active":"2024-04-25T12:21:28.189247+0000","last_became_peered":"2024-04-25T12:21:28.189247+0000","last_unstale":"2024-04-25T12:22:51.625153+0000","last_undegraded":"2024-04-25T12:22:51.625153+0000","last_fullsized":"2024-04-25T12:22:51.625153+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:51.624983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:51.624983+0000","last_clean_scrub_stamp":"2024-04-25T12:22:51.624983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:32.033636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:42.270331+0000","last_change":"2024-04-25T12:22:42.270402+0000","last_active":"2024-04-25T12:22:42.270331+0000","last_peered":"2024-04-25T12:22:42.270331+0000","last_clean":"2024-04-25T12:22:42.270331+0000","last_became_active":"2024-04-25T12:21:24.104947+0000","last_became_peered":"2024-04-25T12:21:24.104947+0000","last_unstale":"2024-04-25T12:22:42.270331+0000","last_undegraded":"2024-04-25T12:22:42.270331+0000","last_fullsized":"2024-04-25T12:22:42.270331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:42.270167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:42.270167+0000","last_clean_scrub_stamp":"2024-04-25T12:22:42.270167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:39:32.940827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'5","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:44.788078+0000","last_change":"2024-04-25T12:22:44.788214+0000","last_active":"2024-04-25T12:22:44.788078+0000","last_peered":"2024-04-25T12:22:44.788078+0000","last_clean":"2024-04-25T12:22:44.788078+0000","last_became_active":"2024-04-25T12:21:23.113829+0000","last_became_peered":"2024-04-25T12:21:23.113829+0000","last_unstale":"2024-04-25T12:22:44.788078+0000","last_undegraded":"2024-04-25T12:22:44.788078+0000","last_fullsized":"2024-04-25T12:22:44.788078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-04-25T12:22:44.787871+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-04-25T12:22:44.787871+0000","last_clean_scrub_stamp":"2024-04-25T12:22:44.787871+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:38:32.317606+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:53.280209+0000","last_change":"2024-04-25T12:22:53.280324+0000","last_active":"2024-04-25T12:22:53.280209+0000","last_peered":"2024-04-25T12:22:53.280209+0000","last_clean":"2024-04-25T12:22:53.280209+0000","last_became_active":"2024-04-25T12:21:28.377639+0000","last_became_peered":"2024-04-25T12:21:28.377639+0000","last_unstale":"2024-04-25T12:22:53.280209+0000","last_undegraded":"2024-04-25T12:22:53.280209+0000","last_fullsized":"2024-04-25T12:22:53.280209+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:53.279906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:53.279906+0000","last_clean_scrub_stamp":"2024-04-25T12:22:53.279906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:38:22.557301+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:48.522529+0000","last_change":"2024-04-25T12:22:48.522583+0000","last_active":"2024-04-25T12:22:48.522529+0000","last_peered":"2024-04-25T12:22:48.522529+0000","last_clean":"2024-04-25T12:22:48.522529+0000","last_became_active":"2024-04-25T12:21:24.119870+0000","last_became_peered":"2024-04-25T12:21:24.119870+0000","last_unstale":"2024-04-25T12:22:48.522529+0000","last_undegraded":"2024-04-25T12:22:48.522529+0000","last_fullsized":"2024-04-25T12:22:48.522529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:48.522310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:48.522310+0000","last_clean_scrub_stamp":"2024-04-25T12:22:48.522310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:30:41.405379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'10","reported_seq":45,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:42.913680+0000","last_change":"2024-04-25T12:22:42.913751+0000","last_active":"2024-04-25T12:22:42.913680+0000","last_peered":"2024-04-25T12:22:42.913680+0000","last_clean":"2024-04-25T12:22:42.913680+0000","last_became_active":"2024-04-25T12:21:23.102790+0000","last_became_peered":"2024-04-25T12:21:23.102790+0000","last_unstale":"2024-04-25T12:22:42.913680+0000","last_undegraded":"2024-04-25T12:22:42.913680+0000","last_fullsized":"2024-04-25T12:22:42.913680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'10","last_scrub_stamp":"2024-04-25T12:22:42.913494+0000","last_deep_scrub":"26'10","last_deep_scrub_stamp":"2024-04-25T12:22:42.913494+0000","last_clean_scrub_stamp":"2024-04-25T12:22:42.913494+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:05:14.748931+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"26'119","reported_seq":193,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:43.772547+0000","last_change":"2024-04-25T12:22:43.772619+0000","last_active":"2024-04-25T12:22:43.772547+0000","last_peered":"2024-04-25T12:22:43.772547+0000","last_clean":"2024-04-25T12:22:43.772547+0000","last_became_active":"2024-04-25T12:21:13.076753+0000","last_became_peered":"2024-04-25T12:21:13.076753+0000","last_unstale":"2024-04-25T12:22:43.772547+0000","last_undegraded":"2024-04-25T12:22:43.772547+0000","last_fullsized":"2024-04-25T12:22:43.772547+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'119","last_scrub_stamp":"2024-04-25T12:22:43.772358+0000","last_deep_scrub":"26'119","last_deep_scrub_stamp":"2024-04-25T12:22:43.772358+0000","last_clean_scrub_stamp":"2024-04-25T12:22:43.772358+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:31:39.406183+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:54.267849+0000","last_change":"2024-04-25T12:22:54.267910+0000","last_active":"2024-04-25T12:22:54.267849+0000","last_peered":"2024-04-25T12:22:54.267849+0000","last_clean":"2024-04-25T12:22:54.267849+0000","last_became_active":"2024-04-25T12:21:28.378522+0000","last_became_peered":"2024-04-25T12:21:28.378522+0000","last_unstale":"2024-04-25T12:22:54.267849+0000","last_undegraded":"2024-04-25T12:22:54.267849+0000","last_fullsized":"2024-04-25T12:22:54.267849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:54.267658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:54.267658+0000","last_clean_scrub_stamp":"2024-04-25T12:22:54.267658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:42:43.305144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:42.734909+0000","last_change":"2024-04-25T12:22:42.734968+0000","last_active":"2024-04-25T12:22:42.734909+0000","last_peered":"2024-04-25T12:22:42.734909+0000","last_clean":"2024-04-25T12:22:42.734909+0000","last_became_active":"2024-04-25T12:21:24.142085+0000","last_became_peered":"2024-04-25T12:21:24.142085+0000","last_unstale":"2024-04-25T12:22:42.734909+0000","last_undegraded":"2024-04-25T12:22:42.734909+0000","last_fullsized":"2024-04-25T12:22:42.734909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:42.734718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:42.734718+0000","last_clean_scrub_stamp":"2024-04-25T12:22:42.734718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:05.088499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'9","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:42.742303+0000","last_change":"2024-04-25T12:22:42.742404+0000","last_active":"2024-04-25T12:22:42.742303+0000","last_peered":"2024-04-25T12:22:42.742303+0000","last_clean":"2024-04-25T12:22:42.742303+0000","last_became_active":"2024-04-25T12:21:23.126103+0000","last_became_peered":"2024-04-25T12:21:23.126103+0000","last_unstale":"2024-04-25T12:22:42.742303+0000","last_undegraded":"2024-04-25T12:22:42.742303+0000","last_fullsized":"2024-04-25T12:22:42.742303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9","last_scrub_stamp":"2024-04-25T12:22:42.742133+0000","last_deep_scrub":"26'9","last_deep_scrub_stamp":"2024-04-25T12:22:42.742133+0000","last_clean_scrub_stamp":"2024-04-25T12:22:42.742133+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:03:16.734072+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:55.273673+0000","last_change":"2024-04-25T12:22:55.273730+0000","last_active":"2024-04-25T12:22:55.273673+0000","last_peered":"2024-04-25T12:22:55.273673+0000","last_clean":"2024-04-25T12:22:55.273673+0000","last_became_active":"2024-04-25T12:21:28.378559+0000","last_became_peered":"2024-04-25T12:21:28.378559+0000","last_unstale":"2024-04-25T12:22:55.273673+0000","last_undegraded":"2024-04-25T12:22:55.273673+0000","last_fullsized":"2024-04-25T12:22:55.273673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:55.273480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:55.273480+0000","last_clean_scrub_stamp":"2024-04-25T12:22:55.273480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:49:43.112798+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:51.901975+0000","last_change":"2024-04-25T12:22:51.902028+0000","last_active":"2024-04-25T12:22:51.901975+0000","last_peered":"2024-04-25T12:22:51.901975+0000","last_clean":"2024-04-25T12:22:51.901975+0000","last_became_active":"2024-04-25T12:21:24.126968+0000","last_became_peered":"2024-04-25T12:21:24.126968+0000","last_unstale":"2024-04-25T12:22:51.901975+0000","last_undegraded":"2024-04-25T12:22:51.901975+0000","last_fullsized":"2024-04-25T12:22:51.901975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:51.901794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:51.901794+0000","last_clean_scrub_stamp":"2024-04-25T12:22:51.901794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:30:12.830987+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'4","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:42.623813+0000","last_change":"2024-04-25T12:22:42.623875+0000","last_active":"2024-04-25T12:22:42.623813+0000","last_peered":"2024-04-25T12:22:42.623813+0000","last_clean":"2024-04-25T12:22:42.623813+0000","last_became_active":"2024-04-25T12:21:23.116148+0000","last_became_peered":"2024-04-25T12:21:23.116148+0000","last_unstale":"2024-04-25T12:22:42.623813+0000","last_undegraded":"2024-04-25T12:22:42.623813+0000","last_fullsized":"2024-04-25T12:22:42.623813+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2024-04-25T12:22:42.623644+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2024-04-25T12:22:42.623644+0000","last_clean_scrub_stamp":"2024-04-25T12:22:42.623644+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:51:20.933906+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:50.355744+0000","last_change":"2024-04-25T12:22:50.355857+0000","last_active":"2024-04-25T12:22:50.355744+0000","last_peered":"2024-04-25T12:22:50.355744+0000","last_clean":"2024-04-25T12:22:50.355744+0000","last_became_active":"2024-04-25T12:21:28.194191+0000","last_became_peered":"2024-04-25T12:21:28.194191+0000","last_unstale":"2024-04-25T12:22:50.355744+0000","last_undegraded":"2024-04-25T12:22:50.355744+0000","last_fullsized":"2024-04-25T12:22:50.355744+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:50.355517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:50.355517+0000","last_clean_scrub_stamp":"2024-04-25T12:22:50.355517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:04:03.685699+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:56.839544+0000","last_change":"2024-04-25T12:22:56.839599+0000","last_active":"2024-04-25T12:22:56.839544+0000","last_peered":"2024-04-25T12:22:56.839544+0000","last_clean":"2024-04-25T12:22:56.839544+0000","last_became_active":"2024-04-25T12:21:24.145807+0000","last_became_peered":"2024-04-25T12:21:24.145807+0000","last_unstale":"2024-04-25T12:22:56.839544+0000","last_undegraded":"2024-04-25T12:22:56.839544+0000","last_fullsized":"2024-04-25T12:22:56.839544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:56.839367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:56.839367+0000","last_clean_scrub_stamp":"2024-04-25T12:22:56.839367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:55:33.939386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"26'6","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:39.715610+0000","last_change":"2024-04-25T12:22:39.715636+0000","last_active":"2024-04-25T12:22:39.715610+0000","last_peered":"2024-04-25T12:22:39.715610+0000","last_clean":"2024-04-25T12:22:39.715610+0000","last_became_active":"2024-04-25T12:21:23.102997+0000","last_became_peered":"2024-04-25T12:21:23.102997+0000","last_unstale":"2024-04-25T12:22:39.715610+0000","last_undegraded":"2024-04-25T12:22:39.715610+0000","last_fullsized":"2024-04-25T12:22:39.715610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-04-25T12:22:39.715546+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-04-25T12:22:39.715546+0000","last_clean_scrub_stamp":"2024-04-25T12:22:39.715546+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:42:33.033467+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.885360+0000","last_change":"2024-04-25T12:21:28.384645+0000","last_active":"2024-04-25T12:22:04.885360+0000","last_peered":"2024-04-25T12:22:04.885360+0000","last_clean":"2024-04-25T12:22:04.885360+0000","last_became_active":"2024-04-25T12:21:28.382953+0000","last_became_peered":"2024-04-25T12:21:28.382953+0000","last_unstale":"2024-04-25T12:22:04.885360+0000","last_undegraded":"2024-04-25T12:22:04.885360+0000","last_fullsized":"2024-04-25T12:22:04.885360+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:55.802735+0000","last_change":"2024-04-25T12:22:55.802795+0000","last_active":"2024-04-25T12:22:55.802735+0000","last_peered":"2024-04-25T12:22:55.802735+0000","last_clean":"2024-04-25T12:22:55.802735+0000","last_became_active":"2024-04-25T12:21:24.146162+0000","last_became_peered":"2024-04-25T12:21:24.146162+0000","last_unstale":"2024-04-25T12:22:55.802735+0000","last_undegraded":"2024-04-25T12:22:55.802735+0000","last_fullsized":"2024-04-25T12:22:55.802735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:55.802570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:55.802570+0000","last_clean_scrub_stamp":"2024-04-25T12:22:55.802570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:24:49.531292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'4","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:40.493640+0000","last_change":"2024-04-25T12:22:40.493708+0000","last_active":"2024-04-25T12:22:40.493640+0000","last_peered":"2024-04-25T12:22:40.493640+0000","last_clean":"2024-04-25T12:22:40.493640+0000","last_became_active":"2024-04-25T12:21:23.134441+0000","last_became_peered":"2024-04-25T12:21:23.134441+0000","last_unstale":"2024-04-25T12:22:40.493640+0000","last_undegraded":"2024-04-25T12:22:40.493640+0000","last_fullsized":"2024-04-25T12:22:40.493640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2024-04-25T12:22:40.493462+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2024-04-25T12:22:40.493462+0000","last_clean_scrub_stamp":"2024-04-25T12:22:40.493462+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:25:53.259898+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:50.583457+0000","last_change":"2024-04-25T12:22:50.583569+0000","last_active":"2024-04-25T12:22:50.583457+0000","last_peered":"2024-04-25T12:22:50.583457+0000","last_clean":"2024-04-25T12:22:50.583457+0000","last_became_active":"2024-04-25T12:21:28.201479+0000","last_became_peered":"2024-04-25T12:21:28.201479+0000","last_unstale":"2024-04-25T12:22:50.583457+0000","last_undegraded":"2024-04-25T12:22:50.583457+0000","last_fullsized":"2024-04-25T12:22:50.583457+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:50.583184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:50.583184+0000","last_clean_scrub_stamp":"2024-04-25T12:22:50.583184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:37:16.402593+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:52.732417+0000","last_change":"2024-04-25T12:22:52.732473+0000","last_active":"2024-04-25T12:22:52.732417+0000","last_peered":"2024-04-25T12:22:52.732417+0000","last_clean":"2024-04-25T12:22:52.732417+0000","last_became_active":"2024-04-25T12:21:24.142422+0000","last_became_peered":"2024-04-25T12:21:24.142422+0000","last_unstale":"2024-04-25T12:22:52.732417+0000","last_undegraded":"2024-04-25T12:22:52.732417+0000","last_fullsized":"2024-04-25T12:22:52.732417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:52.732235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:52.732235+0000","last_clean_scrub_stamp":"2024-04-25T12:22:52.732235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:36.605844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'25","reported_seq":60,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:40.679884+0000","last_change":"2024-04-25T12:22:40.679918+0000","last_active":"2024-04-25T12:22:40.679884+0000","last_peered":"2024-04-25T12:22:40.679884+0000","last_clean":"2024-04-25T12:22:40.679884+0000","last_became_active":"2024-04-25T12:21:23.103680+0000","last_became_peered":"2024-04-25T12:21:23.103680+0000","last_unstale":"2024-04-25T12:22:40.679884+0000","last_undegraded":"2024-04-25T12:22:40.679884+0000","last_fullsized":"2024-04-25T12:22:40.679884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'25","last_scrub_stamp":"2024-04-25T12:22:40.679824+0000","last_deep_scrub":"26'25","last_deep_scrub_stamp":"2024-04-25T12:22:40.679824+0000","last_clean_scrub_stamp":"2024-04-25T12:22:40.679824+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:38:04.661304+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:51.370321+0000","last_change":"2024-04-25T12:22:51.370400+0000","last_active":"2024-04-25T12:22:51.370321+0000","last_peered":"2024-04-25T12:22:51.370321+0000","last_clean":"2024-04-25T12:22:51.370321+0000","last_became_active":"2024-04-25T12:21:28.199411+0000","last_became_peered":"2024-04-25T12:21:28.199411+0000","last_unstale":"2024-04-25T12:22:51.370321+0000","last_undegraded":"2024-04-25T12:22:51.370321+0000","last_fullsized":"2024-04-25T12:22:51.370321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:51.370136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:51.370136+0000","last_clean_scrub_stamp":"2024-04-25T12:22:51.370136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:58.327026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:51.228947+0000","last_change":"2024-04-25T12:22:51.229004+0000","last_active":"2024-04-25T12:22:51.228947+0000","last_peered":"2024-04-25T12:22:51.228947+0000","last_clean":"2024-04-25T12:22:51.228947+0000","last_became_active":"2024-04-25T12:21:24.126721+0000","last_became_peered":"2024-04-25T12:21:24.126721+0000","last_unstale":"2024-04-25T12:22:51.228947+0000","last_undegraded":"2024-04-25T12:22:51.228947+0000","last_fullsized":"2024-04-25T12:22:51.228947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:51.228765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:51.228765+0000","last_clean_scrub_stamp":"2024-04-25T12:22:51.228765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:21:29.009058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'9","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:46.288790+0000","last_change":"2024-04-25T12:22:46.288860+0000","last_active":"2024-04-25T12:22:46.288790+0000","last_peered":"2024-04-25T12:22:46.288790+0000","last_clean":"2024-04-25T12:22:46.288790+0000","last_became_active":"2024-04-25T12:21:23.138837+0000","last_became_peered":"2024-04-25T12:21:23.138837+0000","last_unstale":"2024-04-25T12:22:46.288790+0000","last_undegraded":"2024-04-25T12:22:46.288790+0000","last_fullsized":"2024-04-25T12:22:46.288790+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9","last_scrub_stamp":"2024-04-25T12:22:46.288597+0000","last_deep_scrub":"26'9","last_deep_scrub_stamp":"2024-04-25T12:22:46.288597+0000","last_clean_scrub_stamp":"2024-04-25T12:22:46.288597+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:29:04.825565+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.888822+0000","last_change":"2024-04-25T12:21:28.383919+0000","last_active":"2024-04-25T12:22:04.888822+0000","last_peered":"2024-04-25T12:22:04.888822+0000","last_clean":"2024-04-25T12:22:04.888822+0000","last_became_active":"2024-04-25T12:21:28.383298+0000","last_became_peered":"2024-04-25T12:21:28.383298+0000","last_unstale":"2024-04-25T12:22:04.888822+0000","last_undegraded":"2024-04-25T12:22:04.888822+0000","last_fullsized":"2024-04-25T12:22:04.888822+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:54.785279+0000","last_change":"2024-04-25T12:22:54.785333+0000","last_active":"2024-04-25T12:22:54.785279+0000","last_peered":"2024-04-25T12:22:54.785279+0000","last_clean":"2024-04-25T12:22:54.785279+0000","last_became_active":"2024-04-25T12:21:24.145931+0000","last_became_peered":"2024-04-25T12:21:24.145931+0000","last_unstale":"2024-04-25T12:22:54.785279+0000","last_undegraded":"2024-04-25T12:22:54.785279+0000","last_fullsized":"2024-04-25T12:22:54.785279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:54.785105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:54.785105+0000","last_clean_scrub_stamp":"2024-04-25T12:22:54.785105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:17:24.635481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'8","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:45.898347+0000","last_change":"2024-04-25T12:22:45.898418+0000","last_active":"2024-04-25T12:22:45.898347+0000","last_peered":"2024-04-25T12:22:45.898347+0000","last_clean":"2024-04-25T12:22:45.898347+0000","last_became_active":"2024-04-25T12:21:23.121429+0000","last_became_peered":"2024-04-25T12:21:23.121429+0000","last_unstale":"2024-04-25T12:22:45.898347+0000","last_undegraded":"2024-04-25T12:22:45.898347+0000","last_fullsized":"2024-04-25T12:22:45.898347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-04-25T12:22:45.898153+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-04-25T12:22:45.898153+0000","last_clean_scrub_stamp":"2024-04-25T12:22:45.898153+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:39:39.691310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:55.536451+0000","last_change":"2024-04-25T12:22:55.536510+0000","last_active":"2024-04-25T12:22:55.536451+0000","last_peered":"2024-04-25T12:22:55.536451+0000","last_clean":"2024-04-25T12:22:55.536451+0000","last_became_active":"2024-04-25T12:21:28.375013+0000","last_became_peered":"2024-04-25T12:21:28.375013+0000","last_unstale":"2024-04-25T12:22:55.536451+0000","last_undegraded":"2024-04-25T12:22:55.536451+0000","last_fullsized":"2024-04-25T12:22:55.536451+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:55.536268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:55.536268+0000","last_clean_scrub_stamp":"2024-04-25T12:22:55.536268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:00:31.541096+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:49.380724+0000","last_change":"2024-04-25T12:22:49.380774+0000","last_active":"2024-04-25T12:22:49.380724+0000","last_peered":"2024-04-25T12:22:49.380724+0000","last_clean":"2024-04-25T12:22:49.380724+0000","last_became_active":"2024-04-25T12:21:24.138016+0000","last_became_peered":"2024-04-25T12:21:24.138016+0000","last_unstale":"2024-04-25T12:22:49.380724+0000","last_undegraded":"2024-04-25T12:22:49.380724+0000","last_fullsized":"2024-04-25T12:22:49.380724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:49.380551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:49.380551+0000","last_clean_scrub_stamp":"2024-04-25T12:22:49.380551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:33:03.357242+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'14","reported_seq":49,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:41.315760+0000","last_change":"2024-04-25T12:22:41.315835+0000","last_active":"2024-04-25T12:22:41.315760+0000","last_peered":"2024-04-25T12:22:41.315760+0000","last_clean":"2024-04-25T12:22:41.315760+0000","last_became_active":"2024-04-25T12:21:23.135947+0000","last_became_peered":"2024-04-25T12:21:23.135947+0000","last_unstale":"2024-04-25T12:22:41.315760+0000","last_undegraded":"2024-04-25T12:22:41.315760+0000","last_fullsized":"2024-04-25T12:22:41.315760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'14","last_scrub_stamp":"2024-04-25T12:22:41.315592+0000","last_deep_scrub":"26'14","last_deep_scrub_stamp":"2024-04-25T12:22:41.315592+0000","last_clean_scrub_stamp":"2024-04-25T12:22:41.315592+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:01:51.690230+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.886930+0000","last_change":"2024-04-25T12:21:28.378564+0000","last_active":"2024-04-25T12:22:04.886930+0000","last_peered":"2024-04-25T12:22:04.886930+0000","last_clean":"2024-04-25T12:22:04.886930+0000","last_became_active":"2024-04-25T12:21:28.377532+0000","last_became_peered":"2024-04-25T12:21:28.377532+0000","last_unstale":"2024-04-25T12:22:04.886930+0000","last_undegraded":"2024-04-25T12:22:04.886930+0000","last_fullsized":"2024-04-25T12:22:04.886930+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:47.729667+0000","last_change":"2024-04-25T12:22:47.729722+0000","last_active":"2024-04-25T12:22:47.729667+0000","last_peered":"2024-04-25T12:22:47.729667+0000","last_clean":"2024-04-25T12:22:47.729667+0000","last_became_active":"2024-04-25T12:22:04.899942+0000","last_became_peered":"2024-04-25T12:22:04.899942+0000","last_unstale":"2024-04-25T12:22:47.729667+0000","last_undegraded":"2024-04-25T12:22:47.729667+0000","last_fullsized":"2024-04-25T12:22:47.729667+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:47.729505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:47.729505+0000","last_clean_scrub_stamp":"2024-04-25T12:22:47.729505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:01:52.006419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.14","version":"26'19","reported_seq":54,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:42.334269+0000","last_change":"2024-04-25T12:22:42.334404+0000","last_active":"2024-04-25T12:22:42.334269+0000","last_peered":"2024-04-25T12:22:42.334269+0000","last_clean":"2024-04-25T12:22:42.334269+0000","last_became_active":"2024-04-25T12:21:23.129474+0000","last_became_peered":"2024-04-25T12:21:23.129474+0000","last_unstale":"2024-04-25T12:22:42.334269+0000","last_undegraded":"2024-04-25T12:22:42.334269+0000","last_fullsized":"2024-04-25T12:22:42.334269+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'19","last_scrub_stamp":"2024-04-25T12:22:42.334069+0000","last_deep_scrub":"26'19","last_deep_scrub_stamp":"2024-04-25T12:22:42.334069+0000","last_clean_scrub_stamp":"2024-04-25T12:22:42.334069+0000","objects_scrubbed":6,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:03:30.466348+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4424,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:54.616693+0000","last_change":"2024-04-25T12:22:54.616755+0000","last_active":"2024-04-25T12:22:54.616693+0000","last_peered":"2024-04-25T12:22:54.616693+0000","last_clean":"2024-04-25T12:22:54.616693+0000","last_became_active":"2024-04-25T12:21:28.200152+0000","last_became_peered":"2024-04-25T12:21:28.200152+0000","last_unstale":"2024-04-25T12:22:54.616693+0000","last_undegraded":"2024-04-25T12:22:54.616693+0000","last_fullsized":"2024-04-25T12:22:54.616693+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:54.616498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:54.616498+0000","last_clean_scrub_stamp":"2024-04-25T12:22:54.616498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:50:32.550807+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:45.589398+0000","last_change":"2024-04-25T12:22:45.589450+0000","last_active":"2024-04-25T12:22:45.589398+0000","last_peered":"2024-04-25T12:22:45.589398+0000","last_clean":"2024-04-25T12:22:45.589398+0000","last_became_active":"2024-04-25T12:21:24.142594+0000","last_became_peered":"2024-04-25T12:21:24.142594+0000","last_unstale":"2024-04-25T12:22:45.589398+0000","last_undegraded":"2024-04-25T12:22:45.589398+0000","last_fullsized":"2024-04-25T12:22:45.589398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:45.589233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:45.589233+0000","last_clean_scrub_stamp":"2024-04-25T12:22:45.589233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:02:27.020455+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'9","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:43.636741+0000","last_change":"2024-04-25T12:22:43.636817+0000","last_active":"2024-04-25T12:22:43.636741+0000","last_peered":"2024-04-25T12:22:43.636741+0000","last_clean":"2024-04-25T12:22:43.636741+0000","last_became_active":"2024-04-25T12:21:23.124836+0000","last_became_peered":"2024-04-25T12:21:23.124836+0000","last_unstale":"2024-04-25T12:22:43.636741+0000","last_undegraded":"2024-04-25T12:22:43.636741+0000","last_fullsized":"2024-04-25T12:22:43.636741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9","last_scrub_stamp":"2024-04-25T12:22:43.636577+0000","last_deep_scrub":"26'9","last_deep_scrub_stamp":"2024-04-25T12:22:43.636577+0000","last_clean_scrub_stamp":"2024-04-25T12:22:43.636577+0000","objects_scrubbed":4,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:09:11.255222+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:48.577911+0000","last_change":"2024-04-25T12:22:48.577969+0000","last_active":"2024-04-25T12:22:48.577911+0000","last_peered":"2024-04-25T12:22:48.577911+0000","last_clean":"2024-04-25T12:22:48.577911+0000","last_became_active":"2024-04-25T12:21:28.193277+0000","last_became_peered":"2024-04-25T12:21:28.193277+0000","last_unstale":"2024-04-25T12:22:48.577911+0000","last_undegraded":"2024-04-25T12:22:48.577911+0000","last_fullsized":"2024-04-25T12:22:48.577911+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:48.577715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:48.577715+0000","last_clean_scrub_stamp":"2024-04-25T12:22:48.577715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:04:13.132465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:44.294893+0000","last_change":"2024-04-25T12:22:44.294946+0000","last_active":"2024-04-25T12:22:44.294893+0000","last_peered":"2024-04-25T12:22:44.294893+0000","last_clean":"2024-04-25T12:22:44.294893+0000","last_became_active":"2024-04-25T12:21:24.114367+0000","last_became_peered":"2024-04-25T12:21:24.114367+0000","last_unstale":"2024-04-25T12:22:44.294893+0000","last_undegraded":"2024-04-25T12:22:44.294893+0000","last_fullsized":"2024-04-25T12:22:44.294893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:44.294718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:44.294718+0000","last_clean_scrub_stamp":"2024-04-25T12:22:44.294718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:49:33.310264+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'6","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:46.908963+0000","last_change":"2024-04-25T12:22:46.909034+0000","last_active":"2024-04-25T12:22:46.908963+0000","last_peered":"2024-04-25T12:22:46.908963+0000","last_clean":"2024-04-25T12:22:46.908963+0000","last_became_active":"2024-04-25T12:21:23.132223+0000","last_became_peered":"2024-04-25T12:21:23.132223+0000","last_unstale":"2024-04-25T12:22:46.908963+0000","last_undegraded":"2024-04-25T12:22:46.908963+0000","last_fullsized":"2024-04-25T12:22:46.908963+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-04-25T12:22:46.908795+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-04-25T12:22:46.908795+0000","last_clean_scrub_stamp":"2024-04-25T12:22:46.908795+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:47:33.375032+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:53.468422+0000","last_change":"2024-04-25T12:22:53.468480+0000","last_active":"2024-04-25T12:22:53.468422+0000","last_peered":"2024-04-25T12:22:53.468422+0000","last_clean":"2024-04-25T12:22:53.468422+0000","last_became_active":"2024-04-25T12:21:28.202800+0000","last_became_peered":"2024-04-25T12:21:28.202800+0000","last_unstale":"2024-04-25T12:22:53.468422+0000","last_undegraded":"2024-04-25T12:22:53.468422+0000","last_fullsized":"2024-04-25T12:22:53.468422+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:53.468247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:53.468247+0000","last_clean_scrub_stamp":"2024-04-25T12:22:53.468247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:56:55.897561+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:48.737762+0000","last_change":"2024-04-25T12:22:48.737859+0000","last_active":"2024-04-25T12:22:48.737762+0000","last_peered":"2024-04-25T12:22:48.737762+0000","last_clean":"2024-04-25T12:22:48.737762+0000","last_became_active":"2024-04-25T12:22:04.921770+0000","last_became_peered":"2024-04-25T12:22:04.921770+0000","last_unstale":"2024-04-25T12:22:48.737762+0000","last_undegraded":"2024-04-25T12:22:48.737762+0000","last_fullsized":"2024-04-25T12:22:48.737762+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:48.737528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:48.737528+0000","last_clean_scrub_stamp":"2024-04-25T12:22:48.737528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:17:15.417072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"26'7","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:43.287635+0000","last_change":"2024-04-25T12:22:43.287762+0000","last_active":"2024-04-25T12:22:43.287635+0000","last_peered":"2024-04-25T12:22:43.287635+0000","last_clean":"2024-04-25T12:22:43.287635+0000","last_became_active":"2024-04-25T12:21:23.129967+0000","last_became_peered":"2024-04-25T12:21:23.129967+0000","last_unstale":"2024-04-25T12:22:43.287635+0000","last_undegraded":"2024-04-25T12:22:43.287635+0000","last_fullsized":"2024-04-25T12:22:43.287635+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-04-25T12:22:43.287430+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-04-25T12:22:43.287430+0000","last_clean_scrub_stamp":"2024-04-25T12:22:43.287430+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:49:39.607710+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.886089+0000","last_change":"2024-04-25T12:21:28.384082+0000","last_active":"2024-04-25T12:22:04.886089+0000","last_peered":"2024-04-25T12:22:04.886089+0000","last_clean":"2024-04-25T12:22:04.886089+0000","last_became_active":"2024-04-25T12:21:28.383228+0000","last_became_peered":"2024-04-25T12:21:28.383228+0000","last_unstale":"2024-04-25T12:22:04.886089+0000","last_undegraded":"2024-04-25T12:22:04.886089+0000","last_fullsized":"2024-04-25T12:22:04.886089+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:54.301832+0000","last_change":"2024-04-25T12:22:54.301892+0000","last_active":"2024-04-25T12:22:54.301832+0000","last_peered":"2024-04-25T12:22:54.301832+0000","last_clean":"2024-04-25T12:22:54.301832+0000","last_became_active":"2024-04-25T12:21:28.377742+0000","last_became_peered":"2024-04-25T12:21:28.377742+0000","last_unstale":"2024-04-25T12:22:54.301832+0000","last_undegraded":"2024-04-25T12:22:54.301832+0000","last_fullsized":"2024-04-25T12:22:54.301832+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:54.301655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:54.301655+0000","last_clean_scrub_stamp":"2024-04-25T12:22:54.301655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:44:08.100517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:48.631149+0000","last_change":"2024-04-25T12:22:48.631214+0000","last_active":"2024-04-25T12:22:48.631149+0000","last_peered":"2024-04-25T12:22:48.631149+0000","last_clean":"2024-04-25T12:22:48.631149+0000","last_became_active":"2024-04-25T12:21:24.125448+0000","last_became_peered":"2024-04-25T12:21:24.125448+0000","last_unstale":"2024-04-25T12:22:48.631149+0000","last_undegraded":"2024-04-25T12:22:48.631149+0000","last_fullsized":"2024-04-25T12:22:48.631149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:48.630976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:48.630976+0000","last_clean_scrub_stamp":"2024-04-25T12:22:48.630976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:17:28.649363+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'4","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:44.922249+0000","last_change":"2024-04-25T12:22:44.922314+0000","last_active":"2024-04-25T12:22:44.922249+0000","last_peered":"2024-04-25T12:22:44.922249+0000","last_clean":"2024-04-25T12:22:44.922249+0000","last_became_active":"2024-04-25T12:21:23.115911+0000","last_became_peered":"2024-04-25T12:21:23.115911+0000","last_unstale":"2024-04-25T12:22:44.922249+0000","last_undegraded":"2024-04-25T12:22:44.922249+0000","last_fullsized":"2024-04-25T12:22:44.922249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2024-04-25T12:22:44.922077+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2024-04-25T12:22:44.922077+0000","last_clean_scrub_stamp":"2024-04-25T12:22:44.922077+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:10.783741+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:56.224860+0000","last_change":"2024-04-25T12:22:56.224928+0000","last_active":"2024-04-25T12:22:56.224860+0000","last_peered":"2024-04-25T12:22:56.224860+0000","last_clean":"2024-04-25T12:22:56.224860+0000","last_became_active":"2024-04-25T12:22:04.899300+0000","last_became_peered":"2024-04-25T12:22:04.899300+0000","last_unstale":"2024-04-25T12:22:56.224860+0000","last_undegraded":"2024-04-25T12:22:56.224860+0000","last_fullsized":"2024-04-25T12:22:56.224860+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:56.224662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:56.224662+0000","last_clean_scrub_stamp":"2024-04-25T12:22:56.224662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:31:15.422833+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,0],"acting":[6,5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:41.528318+0000","last_change":"2024-04-25T12:22:41.528337+0000","last_active":"2024-04-25T12:22:41.528318+0000","last_peered":"2024-04-25T12:22:41.528318+0000","last_clean":"2024-04-25T12:22:41.528318+0000","last_became_active":"2024-04-25T12:21:24.137078+0000","last_became_peered":"2024-04-25T12:21:24.137078+0000","last_unstale":"2024-04-25T12:22:41.528318+0000","last_undegraded":"2024-04-25T12:22:41.528318+0000","last_fullsized":"2024-04-25T12:22:41.528318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:41.528245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:41.528245+0000","last_clean_scrub_stamp":"2024-04-25T12:22:41.528245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:38.348046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'5","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:46.615701+0000","last_change":"2024-04-25T12:22:46.615770+0000","last_active":"2024-04-25T12:22:46.615701+0000","last_peered":"2024-04-25T12:22:46.615701+0000","last_clean":"2024-04-25T12:22:46.615701+0000","last_became_active":"2024-04-25T12:21:23.129779+0000","last_became_peered":"2024-04-25T12:21:23.129779+0000","last_unstale":"2024-04-25T12:22:46.615701+0000","last_undegraded":"2024-04-25T12:22:46.615701+0000","last_fullsized":"2024-04-25T12:22:46.615701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-04-25T12:22:46.615541+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-04-25T12:22:46.615541+0000","last_clean_scrub_stamp":"2024-04-25T12:22:46.615541+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:13:06.000377+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'10","reported_seq":45,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:45.294330+0000","last_change":"2024-04-25T12:22:45.294411+0000","last_active":"2024-04-25T12:22:45.294330+0000","last_peered":"2024-04-25T12:22:45.294330+0000","last_clean":"2024-04-25T12:22:45.294330+0000","last_became_active":"2024-04-25T12:21:23.137393+0000","last_became_peered":"2024-04-25T12:21:23.137393+0000","last_unstale":"2024-04-25T12:22:45.294330+0000","last_undegraded":"2024-04-25T12:22:45.294330+0000","last_fullsized":"2024-04-25T12:22:45.294330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'10","last_scrub_stamp":"2024-04-25T12:22:45.294130+0000","last_deep_scrub":"26'10","last_deep_scrub_stamp":"2024-04-25T12:22:45.294130+0000","last_clean_scrub_stamp":"2024-04-25T12:22:45.294130+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:53:45.931622+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:45.337417+0000","last_change":"2024-04-25T12:22:45.337480+0000","last_active":"2024-04-25T12:22:45.337417+0000","last_peered":"2024-04-25T12:22:45.337417+0000","last_clean":"2024-04-25T12:22:45.337417+0000","last_became_active":"2024-04-25T12:21:24.121480+0000","last_became_peered":"2024-04-25T12:21:24.121480+0000","last_unstale":"2024-04-25T12:22:45.337417+0000","last_undegraded":"2024-04-25T12:22:45.337417+0000","last_fullsized":"2024-04-25T12:22:45.337417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:45.337245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:45.337245+0000","last_clean_scrub_stamp":"2024-04-25T12:22:45.337245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:58:53.298839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:46.738864+0000","last_change":"2024-04-25T12:22:46.738928+0000","last_active":"2024-04-25T12:22:46.738864+0000","last_peered":"2024-04-25T12:22:46.738864+0000","last_clean":"2024-04-25T12:22:46.738864+0000","last_became_active":"2024-04-25T12:22:04.900006+0000","last_became_peered":"2024-04-25T12:22:04.900006+0000","last_unstale":"2024-04-25T12:22:46.738864+0000","last_undegraded":"2024-04-25T12:22:46.738864+0000","last_fullsized":"2024-04-25T12:22:46.738864+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:46.738686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:46.738686+0000","last_clean_scrub_stamp":"2024-04-25T12:22:46.738686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:40:14.671005+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,5],"acting":[2,0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'8","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:44.538390+0000","last_change":"2024-04-25T12:22:44.538461+0000","last_active":"2024-04-25T12:22:44.538390+0000","last_peered":"2024-04-25T12:22:44.538390+0000","last_clean":"2024-04-25T12:22:44.538390+0000","last_became_active":"2024-04-25T12:21:23.112721+0000","last_became_peered":"2024-04-25T12:21:23.112721+0000","last_unstale":"2024-04-25T12:22:44.538390+0000","last_undegraded":"2024-04-25T12:22:44.538390+0000","last_fullsized":"2024-04-25T12:22:44.538390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-04-25T12:22:44.538196+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-04-25T12:22:44.538196+0000","last_clean_scrub_stamp":"2024-04-25T12:22:44.538196+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:54:27.496935+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:44.550832+0000","last_change":"2024-04-25T12:22:44.550893+0000","last_active":"2024-04-25T12:22:44.550832+0000","last_peered":"2024-04-25T12:22:44.550832+0000","last_clean":"2024-04-25T12:22:44.550832+0000","last_became_active":"2024-04-25T12:21:24.133493+0000","last_became_peered":"2024-04-25T12:21:24.133493+0000","last_unstale":"2024-04-25T12:22:44.550832+0000","last_undegraded":"2024-04-25T12:22:44.550832+0000","last_fullsized":"2024-04-25T12:22:44.550832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:44.550645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:44.550645+0000","last_clean_scrub_stamp":"2024-04-25T12:22:44.550645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:28.124602+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.899649+0000","last_change":"2024-04-25T12:22:04.896184+0000","last_active":"2024-04-25T12:22:04.899649+0000","last_peered":"2024-04-25T12:22:04.899649+0000","last_clean":"2024-04-25T12:22:04.899649+0000","last_became_active":"2024-04-25T12:22:04.895198+0000","last_became_peered":"2024-04-25T12:22:04.895198+0000","last_unstale":"2024-04-25T12:22:04.899649+0000","last_undegraded":"2024-04-25T12:22:04.899649+0000","last_fullsized":"2024-04-25T12:22:04.899649+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:27.142878+0000","last_clean_scrub_stamp":"2024-04-25T12:21:27.142878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,2],"acting":[3,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:50.273511+0000","last_change":"2024-04-25T12:22:50.273620+0000","last_active":"2024-04-25T12:22:50.273511+0000","last_peered":"2024-04-25T12:22:50.273511+0000","last_clean":"2024-04-25T12:22:50.273511+0000","last_became_active":"2024-04-25T12:21:24.125831+0000","last_became_peered":"2024-04-25T12:21:24.125831+0000","last_unstale":"2024-04-25T12:22:50.273511+0000","last_undegraded":"2024-04-25T12:22:50.273511+0000","last_fullsized":"2024-04-25T12:22:50.273511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:50.273277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:50.273277+0000","last_clean_scrub_stamp":"2024-04-25T12:22:50.273277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:22.528596+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:43.749334+0000","last_change":"2024-04-25T12:22:43.749390+0000","last_active":"2024-04-25T12:22:43.749334+0000","last_peered":"2024-04-25T12:22:43.749334+0000","last_clean":"2024-04-25T12:22:43.749334+0000","last_became_active":"2024-04-25T12:21:24.116498+0000","last_became_peered":"2024-04-25T12:21:24.116498+0000","last_unstale":"2024-04-25T12:22:43.749334+0000","last_undegraded":"2024-04-25T12:22:43.749334+0000","last_fullsized":"2024-04-25T12:22:43.749334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:43.749138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:43.749138+0000","last_clean_scrub_stamp":"2024-04-25T12:22:43.749138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:09:38.265708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:49.888242+0000","last_change":"2024-04-25T12:22:49.888296+0000","last_active":"2024-04-25T12:22:49.888242+0000","last_peered":"2024-04-25T12:22:49.888242+0000","last_clean":"2024-04-25T12:22:49.888242+0000","last_became_active":"2024-04-25T12:21:24.114742+0000","last_became_peered":"2024-04-25T12:21:24.114742+0000","last_unstale":"2024-04-25T12:22:49.888242+0000","last_undegraded":"2024-04-25T12:22:49.888242+0000","last_fullsized":"2024-04-25T12:22:49.888242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:49.888062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:49.888062+0000","last_clean_scrub_stamp":"2024-04-25T12:22:49.888062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:22:38.966943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:39.312095+0000","last_change":"2024-04-25T12:22:39.312116+0000","last_active":"2024-04-25T12:22:39.312095+0000","last_peered":"2024-04-25T12:22:39.312095+0000","last_clean":"2024-04-25T12:22:39.312095+0000","last_became_active":"2024-04-25T12:21:24.126476+0000","last_became_peered":"2024-04-25T12:21:24.126476+0000","last_unstale":"2024-04-25T12:22:39.312095+0000","last_undegraded":"2024-04-25T12:22:39.312095+0000","last_fullsized":"2024-04-25T12:22:39.312095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:39.312022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:39.312022+0000","last_clean_scrub_stamp":"2024-04-25T12:22:39.312022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:51:21.997970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:50.466901+0000","last_change":"2024-04-25T12:22:50.466953+0000","last_active":"2024-04-25T12:22:50.466901+0000","last_peered":"2024-04-25T12:22:50.466901+0000","last_clean":"2024-04-25T12:22:50.466901+0000","last_became_active":"2024-04-25T12:21:24.135257+0000","last_became_peered":"2024-04-25T12:21:24.135257+0000","last_unstale":"2024-04-25T12:22:50.466901+0000","last_undegraded":"2024-04-25T12:22:50.466901+0000","last_fullsized":"2024-04-25T12:22:50.466901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:50.466729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:50.466729+0000","last_clean_scrub_stamp":"2024-04-25T12:22:50.466729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:48:55.728765+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:49.608604+0000","last_change":"2024-04-25T12:22:49.608657+0000","last_active":"2024-04-25T12:22:49.608604+0000","last_peered":"2024-04-25T12:22:49.608604+0000","last_clean":"2024-04-25T12:22:49.608604+0000","last_became_active":"2024-04-25T12:21:24.132225+0000","last_became_peered":"2024-04-25T12:21:24.132225+0000","last_unstale":"2024-04-25T12:22:49.608604+0000","last_undegraded":"2024-04-25T12:22:49.608604+0000","last_fullsized":"2024-04-25T12:22:49.608604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:49.608438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:49.608438+0000","last_clean_scrub_stamp":"2024-04-25T12:22:49.608438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:37:28.257485+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:53.250977+0000","last_change":"2024-04-25T12:22:53.251078+0000","last_active":"2024-04-25T12:22:53.250977+0000","last_peered":"2024-04-25T12:22:53.250977+0000","last_clean":"2024-04-25T12:22:53.250977+0000","last_became_active":"2024-04-25T12:21:24.148025+0000","last_became_peered":"2024-04-25T12:21:24.148025+0000","last_unstale":"2024-04-25T12:22:53.250977+0000","last_undegraded":"2024-04-25T12:22:53.250977+0000","last_fullsized":"2024-04-25T12:22:53.250977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:53.250708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:53.250708+0000","last_clean_scrub_stamp":"2024-04-25T12:22:53.250708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:38:22.955695+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:51.490621+0000","last_change":"2024-04-25T12:22:51.490679+0000","last_active":"2024-04-25T12:22:51.490621+0000","last_peered":"2024-04-25T12:22:51.490621+0000","last_clean":"2024-04-25T12:22:51.490621+0000","last_became_active":"2024-04-25T12:21:24.135310+0000","last_became_peered":"2024-04-25T12:21:24.135310+0000","last_unstale":"2024-04-25T12:22:51.490621+0000","last_undegraded":"2024-04-25T12:22:51.490621+0000","last_fullsized":"2024-04-25T12:22:51.490621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:51.490395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:51.490395+0000","last_clean_scrub_stamp":"2024-04-25T12:22:51.490395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:48:50.493825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:41.917893+0000","last_change":"2024-04-25T12:22:41.917946+0000","last_active":"2024-04-25T12:22:41.917893+0000","last_peered":"2024-04-25T12:22:41.917893+0000","last_clean":"2024-04-25T12:22:41.917893+0000","last_became_active":"2024-04-25T12:21:24.112992+0000","last_became_peered":"2024-04-25T12:21:24.112992+0000","last_unstale":"2024-04-25T12:22:41.917893+0000","last_undegraded":"2024-04-25T12:22:41.917893+0000","last_fullsized":"2024-04-25T12:22:41.917893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:41.917701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:41.917701+0000","last_clean_scrub_stamp":"2024-04-25T12:22:41.917701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:24.707441+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:47.570465+0000","last_change":"2024-04-25T12:22:47.570518+0000","last_active":"2024-04-25T12:22:47.570465+0000","last_peered":"2024-04-25T12:22:47.570465+0000","last_clean":"2024-04-25T12:22:47.570465+0000","last_became_active":"2024-04-25T12:21:24.117412+0000","last_became_peered":"2024-04-25T12:21:24.117412+0000","last_unstale":"2024-04-25T12:22:47.570465+0000","last_undegraded":"2024-04-25T12:22:47.570465+0000","last_fullsized":"2024-04-25T12:22:47.570465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:47.570276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:47.570276+0000","last_clean_scrub_stamp":"2024-04-25T12:22:47.570276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:56:48.278054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:54.991323+0000","last_change":"2024-04-25T12:22:54.991377+0000","last_active":"2024-04-25T12:22:54.991323+0000","last_peered":"2024-04-25T12:22:54.991323+0000","last_clean":"2024-04-25T12:22:54.991323+0000","last_became_active":"2024-04-25T12:21:24.137937+0000","last_became_peered":"2024-04-25T12:21:24.137937+0000","last_unstale":"2024-04-25T12:22:54.991323+0000","last_undegraded":"2024-04-25T12:22:54.991323+0000","last_fullsized":"2024-04-25T12:22:54.991323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:54.991141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:54.991141+0000","last_clean_scrub_stamp":"2024-04-25T12:22:54.991141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:33:22.660757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:48.399193+0000","last_change":"2024-04-25T12:22:48.399247+0000","last_active":"2024-04-25T12:22:48.399193+0000","last_peered":"2024-04-25T12:22:48.399193+0000","last_clean":"2024-04-25T12:22:48.399193+0000","last_became_active":"2024-04-25T12:21:24.137431+0000","last_became_peered":"2024-04-25T12:21:24.137431+0000","last_unstale":"2024-04-25T12:22:48.399193+0000","last_undegraded":"2024-04-25T12:22:48.399193+0000","last_fullsized":"2024-04-25T12:22:48.399193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:48.399017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:48.399017+0000","last_clean_scrub_stamp":"2024-04-25T12:22:48.399017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:46:28.074342+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:52.250356+0000","last_change":"2024-04-25T12:22:52.250408+0000","last_active":"2024-04-25T12:22:52.250356+0000","last_peered":"2024-04-25T12:22:52.250356+0000","last_clean":"2024-04-25T12:22:52.250356+0000","last_became_active":"2024-04-25T12:21:24.128125+0000","last_became_peered":"2024-04-25T12:21:24.128125+0000","last_unstale":"2024-04-25T12:22:52.250356+0000","last_undegraded":"2024-04-25T12:22:52.250356+0000","last_fullsized":"2024-04-25T12:22:52.250356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:52.250178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:52.250178+0000","last_clean_scrub_stamp":"2024-04-25T12:22:52.250178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:23:59.580098+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.921995+0000","last_change":"2024-04-25T12:21:24.149001+0000","last_active":"2024-04-25T12:22:04.921995+0000","last_peered":"2024-04-25T12:22:04.921995+0000","last_clean":"2024-04-25T12:22:04.921995+0000","last_became_active":"2024-04-25T12:21:24.147230+0000","last_became_peered":"2024-04-25T12:21:24.147230+0000","last_unstale":"2024-04-25T12:22:04.921995+0000","last_undegraded":"2024-04-25T12:22:04.921995+0000","last_fullsized":"2024-04-25T12:22:04.921995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:44.757430+0000","last_change":"2024-04-25T12:22:44.757488+0000","last_active":"2024-04-25T12:22:44.757430+0000","last_peered":"2024-04-25T12:22:44.757430+0000","last_clean":"2024-04-25T12:22:44.757430+0000","last_became_active":"2024-04-25T12:21:24.118761+0000","last_became_peered":"2024-04-25T12:21:24.118761+0000","last_unstale":"2024-04-25T12:22:44.757430+0000","last_undegraded":"2024-04-25T12:22:44.757430+0000","last_fullsized":"2024-04-25T12:22:44.757430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:44.757254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:44.757254+0000","last_clean_scrub_stamp":"2024-04-25T12:22:44.757254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:13:14.408951+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:55.955032+0000","last_change":"2024-04-25T12:22:55.955084+0000","last_active":"2024-04-25T12:22:55.955032+0000","last_peered":"2024-04-25T12:22:55.955032+0000","last_clean":"2024-04-25T12:22:55.955032+0000","last_became_active":"2024-04-25T12:21:24.143786+0000","last_became_peered":"2024-04-25T12:21:24.143786+0000","last_unstale":"2024-04-25T12:22:55.955032+0000","last_undegraded":"2024-04-25T12:22:55.955032+0000","last_fullsized":"2024-04-25T12:22:55.955032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:55.954859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:55.954859+0000","last_clean_scrub_stamp":"2024-04-25T12:22:55.954859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:26:34.758073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:47.871958+0000","last_change":"2024-04-25T12:22:47.872009+0000","last_active":"2024-04-25T12:22:47.871958+0000","last_peered":"2024-04-25T12:22:47.871958+0000","last_clean":"2024-04-25T12:22:47.871958+0000","last_became_active":"2024-04-25T12:21:24.106818+0000","last_became_peered":"2024-04-25T12:21:24.106818+0000","last_unstale":"2024-04-25T12:22:47.871958+0000","last_undegraded":"2024-04-25T12:22:47.871958+0000","last_fullsized":"2024-04-25T12:22:47.871958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:47.871786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:47.871786+0000","last_clean_scrub_stamp":"2024-04-25T12:22:47.871786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:46:10.598717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:39.601413+0000","last_change":"2024-04-25T12:22:39.601443+0000","last_active":"2024-04-25T12:22:39.601413+0000","last_peered":"2024-04-25T12:22:39.601413+0000","last_clean":"2024-04-25T12:22:39.601413+0000","last_became_active":"2024-04-25T12:21:24.114237+0000","last_became_peered":"2024-04-25T12:21:24.114237+0000","last_unstale":"2024-04-25T12:22:39.601413+0000","last_undegraded":"2024-04-25T12:22:39.601413+0000","last_fullsized":"2024-04-25T12:22:39.601413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:39.601308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:39.601308+0000","last_clean_scrub_stamp":"2024-04-25T12:22:39.601308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:19:29.408055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:46.379532+0000","last_change":"2024-04-25T12:22:46.379584+0000","last_active":"2024-04-25T12:22:46.379532+0000","last_peered":"2024-04-25T12:22:46.379532+0000","last_clean":"2024-04-25T12:22:46.379532+0000","last_became_active":"2024-04-25T12:21:24.132094+0000","last_became_peered":"2024-04-25T12:21:24.132094+0000","last_unstale":"2024-04-25T12:22:46.379532+0000","last_undegraded":"2024-04-25T12:22:46.379532+0000","last_fullsized":"2024-04-25T12:22:46.379532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:46.379355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:46.379355+0000","last_clean_scrub_stamp":"2024-04-25T12:22:46.379355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:06:59.865601+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:45.712738+0000","last_change":"2024-04-25T12:22:45.712794+0000","last_active":"2024-04-25T12:22:45.712738+0000","last_peered":"2024-04-25T12:22:45.712738+0000","last_clean":"2024-04-25T12:22:45.712738+0000","last_became_active":"2024-04-25T12:22:04.896529+0000","last_became_peered":"2024-04-25T12:22:04.896529+0000","last_unstale":"2024-04-25T12:22:45.712738+0000","last_undegraded":"2024-04-25T12:22:45.712738+0000","last_fullsized":"2024-04-25T12:22:45.712738+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:45.712571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:45.712571+0000","last_clean_scrub_stamp":"2024-04-25T12:22:45.712571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:00:51.963656+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:41.499727+0000","last_change":"2024-04-25T12:22:41.499778+0000","last_active":"2024-04-25T12:22:41.499727+0000","last_peered":"2024-04-25T12:22:41.499727+0000","last_clean":"2024-04-25T12:22:41.499727+0000","last_became_active":"2024-04-25T12:21:24.116973+0000","last_became_peered":"2024-04-25T12:21:24.116973+0000","last_unstale":"2024-04-25T12:22:41.499727+0000","last_undegraded":"2024-04-25T12:22:41.499727+0000","last_fullsized":"2024-04-25T12:22:41.499727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:41.499543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:41.499543+0000","last_clean_scrub_stamp":"2024-04-25T12:22:41.499543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:42.552692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:47.293315+0000","last_change":"2024-04-25T12:22:47.293370+0000","last_active":"2024-04-25T12:22:47.293315+0000","last_peered":"2024-04-25T12:22:47.293315+0000","last_clean":"2024-04-25T12:22:47.293315+0000","last_became_active":"2024-04-25T12:21:24.114829+0000","last_became_peered":"2024-04-25T12:21:24.114829+0000","last_unstale":"2024-04-25T12:22:47.293315+0000","last_undegraded":"2024-04-25T12:22:47.293315+0000","last_fullsized":"2024-04-25T12:22:47.293315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:47.293125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:47.293125+0000","last_clean_scrub_stamp":"2024-04-25T12:22:47.293125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:25.590252+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:48.258055+0000","last_change":"2024-04-25T12:22:48.258108+0000","last_active":"2024-04-25T12:22:48.258055+0000","last_peered":"2024-04-25T12:22:48.258055+0000","last_clean":"2024-04-25T12:22:48.258055+0000","last_became_active":"2024-04-25T12:21:24.116359+0000","last_became_peered":"2024-04-25T12:21:24.116359+0000","last_unstale":"2024-04-25T12:22:48.258055+0000","last_undegraded":"2024-04-25T12:22:48.258055+0000","last_fullsized":"2024-04-25T12:22:48.258055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:48.257870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:48.257870+0000","last_clean_scrub_stamp":"2024-04-25T12:22:48.257870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:33.003708+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:53.735915+0000","last_change":"2024-04-25T12:22:53.735969+0000","last_active":"2024-04-25T12:22:53.735915+0000","last_peered":"2024-04-25T12:22:53.735915+0000","last_clean":"2024-04-25T12:22:53.735915+0000","last_became_active":"2024-04-25T12:21:24.142353+0000","last_became_peered":"2024-04-25T12:21:24.142353+0000","last_unstale":"2024-04-25T12:22:53.735915+0000","last_undegraded":"2024-04-25T12:22:53.735915+0000","last_fullsized":"2024-04-25T12:22:53.735915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:53.735744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:53.735744+0000","last_clean_scrub_stamp":"2024-04-25T12:22:53.735744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:13:31.630981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:49.507812+0000","last_change":"2024-04-25T12:22:49.507868+0000","last_active":"2024-04-25T12:22:49.507812+0000","last_peered":"2024-04-25T12:22:49.507812+0000","last_clean":"2024-04-25T12:22:49.507812+0000","last_became_active":"2024-04-25T12:21:24.127315+0000","last_became_peered":"2024-04-25T12:21:24.127315+0000","last_unstale":"2024-04-25T12:22:49.507812+0000","last_undegraded":"2024-04-25T12:22:49.507812+0000","last_fullsized":"2024-04-25T12:22:49.507812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:49.507632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:49.507632+0000","last_clean_scrub_stamp":"2024-04-25T12:22:49.507632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:10.218511+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:50.756320+0000","last_change":"2024-04-25T12:22:50.756372+0000","last_active":"2024-04-25T12:22:50.756320+0000","last_peered":"2024-04-25T12:22:50.756320+0000","last_clean":"2024-04-25T12:22:50.756320+0000","last_became_active":"2024-04-25T12:21:24.142029+0000","last_became_peered":"2024-04-25T12:21:24.142029+0000","last_unstale":"2024-04-25T12:22:50.756320+0000","last_undegraded":"2024-04-25T12:22:50.756320+0000","last_fullsized":"2024-04-25T12:22:50.756320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:50.756116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:50.756116+0000","last_clean_scrub_stamp":"2024-04-25T12:22:50.756116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:02.121258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:48.892661+0000","last_change":"2024-04-25T12:22:48.892713+0000","last_active":"2024-04-25T12:22:48.892661+0000","last_peered":"2024-04-25T12:22:48.892661+0000","last_clean":"2024-04-25T12:22:48.892661+0000","last_became_active":"2024-04-25T12:21:24.112339+0000","last_became_peered":"2024-04-25T12:21:24.112339+0000","last_unstale":"2024-04-25T12:22:48.892661+0000","last_undegraded":"2024-04-25T12:22:48.892661+0000","last_fullsized":"2024-04-25T12:22:48.892661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:48.892484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:48.892484+0000","last_clean_scrub_stamp":"2024-04-25T12:22:48.892484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:23:35.476381+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:51.755388+0000","last_change":"2024-04-25T12:22:51.755441+0000","last_active":"2024-04-25T12:22:51.755388+0000","last_peered":"2024-04-25T12:22:51.755388+0000","last_clean":"2024-04-25T12:22:51.755388+0000","last_became_active":"2024-04-25T12:21:24.142422+0000","last_became_peered":"2024-04-25T12:21:24.142422+0000","last_unstale":"2024-04-25T12:22:51.755388+0000","last_undegraded":"2024-04-25T12:22:51.755388+0000","last_fullsized":"2024-04-25T12:22:51.755388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:51.755212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:51.755212+0000","last_clean_scrub_stamp":"2024-04-25T12:22:51.755212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:24:12.450196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:53.956434+0000","last_change":"2024-04-25T12:22:53.956489+0000","last_active":"2024-04-25T12:22:53.956434+0000","last_peered":"2024-04-25T12:22:53.956434+0000","last_clean":"2024-04-25T12:22:53.956434+0000","last_became_active":"2024-04-25T12:21:24.131746+0000","last_became_peered":"2024-04-25T12:21:24.131746+0000","last_unstale":"2024-04-25T12:22:53.956434+0000","last_undegraded":"2024-04-25T12:22:53.956434+0000","last_fullsized":"2024-04-25T12:22:53.956434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:53.956223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:53.956223+0000","last_clean_scrub_stamp":"2024-04-25T12:22:53.956223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:26:56.168126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:43.280979+0000","last_change":"2024-04-25T12:22:43.281032+0000","last_active":"2024-04-25T12:22:43.280979+0000","last_peered":"2024-04-25T12:22:43.280979+0000","last_clean":"2024-04-25T12:22:43.280979+0000","last_became_active":"2024-04-25T12:21:24.111154+0000","last_became_peered":"2024-04-25T12:21:24.111154+0000","last_unstale":"2024-04-25T12:22:43.280979+0000","last_undegraded":"2024-04-25T12:22:43.280979+0000","last_fullsized":"2024-04-25T12:22:43.280979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:43.280798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:43.280798+0000","last_clean_scrub_stamp":"2024-04-25T12:22:43.280798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:14:23.899323+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:50.611352+0000","last_change":"2024-04-25T12:22:50.611413+0000","last_active":"2024-04-25T12:22:50.611352+0000","last_peered":"2024-04-25T12:22:50.611352+0000","last_clean":"2024-04-25T12:22:50.611352+0000","last_became_active":"2024-04-25T12:21:24.133839+0000","last_became_peered":"2024-04-25T12:21:24.133839+0000","last_unstale":"2024-04-25T12:22:50.611352+0000","last_undegraded":"2024-04-25T12:22:50.611352+0000","last_fullsized":"2024-04-25T12:22:50.611352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:50.611146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:50.611146+0000","last_clean_scrub_stamp":"2024-04-25T12:22:50.611146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:12.272952+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:04.921451+0000","last_change":"2024-04-25T12:21:24.147519+0000","last_active":"2024-04-25T12:22:04.921451+0000","last_peered":"2024-04-25T12:22:04.921451+0000","last_clean":"2024-04-25T12:22:04.921451+0000","last_became_active":"2024-04-25T12:21:24.146805+0000","last_became_peered":"2024-04-25T12:21:24.146805+0000","last_unstale":"2024-04-25T12:22:04.921451+0000","last_undegraded":"2024-04-25T12:22:04.921451+0000","last_fullsized":"2024-04-25T12:22:04.921451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:23.073559+0000","last_clean_scrub_stamp":"2024-04-25T12:21:23.073559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":12592,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":25184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":272,"ondisk_log_size":272,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32064,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339776,"statfs":{"total":96636764160,"available":96603930624,"internally_reserved":0,"allocated":909312,"data_stored":707411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":120157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":327680,"data_stored":118875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":116273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":120191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":116405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":115893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574874,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":901120,"data_stored":705603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":5796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T12:23:02.516 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-25T12:21:27.142878+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=27, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:23:02.516 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-25T12:21:27.142878+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=27, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:23:02.516 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-25T12:21:27.142878+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=27, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:23:02.517 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-25T12:21:27.142878+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=27, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:23:02.517 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-25T12:21:27.142878+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=27, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:23:02.517 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-25T12:21:23.073559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:23:02.518 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-25T12:21:23.073559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=22, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:23:02.518 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-25T12:23:22.519 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T12:23:22.650 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.645+0000 7fdec40f7640 1 Processor -- start 2024-04-25T12:23:22.650 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.645+0000 7fdec40f7640 1 -- start start 2024-04-25T12:23:22.651 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.649+0000 7fdec40f7640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fdebc14ffa0 0x7fdebc06f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:23:22.652 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.649+0000 7fdec40f7640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdebc0c5d70 con 0x7fdebc14fbc0 2024-04-25T12:23:22.652 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.649+0000 7fdec40f7640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdebc0c6050 con 0x7fdebc074100 2024-04-25T12:23:22.652 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.649+0000 7fdec40f7640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7fdebc0c6330 con 0x7fdebc14ffa0 2024-04-25T12:23:22.652 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.649+0000 7fdec1692640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fdebc14ffa0 0x7fdebc06f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:23:22.652 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.649+0000 7fdec1e93640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fdebc14fbc0 0x7fdebc0c8220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:60030/0 (socket says 172.21.15.86:60030) 2024-04-25T12:23:22.652 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.649+0000 7fdec1e93640 1 -- 172.21.15.86:0/3494834164 learned_addr learned my addr 172.21.15.86:0/3494834164 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-04-25T12:23:22.652 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.649+0000 7fdec1692640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fdebc14ffa0 0x7fdebc06f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38262/0 (socket says 172.21.15.86:38262) 2024-04-25T12:23:22.652 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.649+0000 7fdec1692640 1 -- 172.21.15.86:0/3494834164 >> v1:172.21.15.134:6789/0 conn(0x7fdebc074100 legacy=0x7fdebc0c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:23:22.653 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.649+0000 7fdec1692640 1 -- 172.21.15.86:0/3494834164 >> v1:172.21.15.86:6789/0 conn(0x7fdebc14fbc0 legacy=0x7fdebc0c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:23:22.653 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.649+0000 7fdec0e91640 1 -- 172.21.15.86:0/3494834164 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1777920616 0 0) 0x7fdebc0c5d70 con 0x7fdebc14fbc0 2024-04-25T12:23:22.653 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.649+0000 7fdec1692640 1 -- 172.21.15.86:0/3494834164 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdebc0c6610 con 0x7fdebc14ffa0 2024-04-25T12:23:22.654 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.649+0000 7fdec1692640 1 --2- 172.21.15.86:0/3494834164 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdebc14ffa0 0x7fdebc06f700 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fdeb00097f0 tx=0x7fdeb001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89149480a7f306cc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:23:22.654 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.649+0000 7fdec0e91640 1 -- 172.21.15.86:0/3494834164 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeb00ab680 con 0x7fdebc14ffa0 2024-04-25T12:23:22.654 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.649+0000 7fdec0e91640 1 -- 172.21.15.86:0/3494834164 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdeb00b0070 con 0x7fdebc14ffa0 2024-04-25T12:23:22.655 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.649+0000 7fdec0e91640 1 -- 172.21.15.86:0/3494834164 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeb00aba40 con 0x7fdebc14ffa0 2024-04-25T12:23:22.656 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.653+0000 7fdec40f7640 1 -- 172.21.15.86:0/3494834164 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdebc14ffa0 msgr2=0x7fdebc06f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:23:22.656 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.653+0000 7fdec40f7640 1 --2- 172.21.15.86:0/3494834164 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdebc14ffa0 0x7fdebc06f700 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fdeb00097f0 tx=0x7fdeb001c460 comp rx=0 tx=0).stop 2024-04-25T12:23:22.656 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.653+0000 7fdec40f7640 1 -- 172.21.15.86:0/3494834164 shutdown_connections 2024-04-25T12:23:22.656 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.653+0000 7fdec40f7640 1 --2- 172.21.15.86:0/3494834164 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdebc14ffa0 0x7fdebc06f700 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:22.656 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.653+0000 7fdec40f7640 1 -- 172.21.15.86:0/3494834164 >> 172.21.15.86:0/3494834164 conn(0x7fdebc06b9d0 msgr2=0x7fdebc06bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:23:22.656 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.653+0000 7fdec40f7640 1 -- 172.21.15.86:0/3494834164 shutdown_connections 2024-04-25T12:23:22.656 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.653+0000 7fdec40f7640 1 -- 172.21.15.86:0/3494834164 wait complete. 2024-04-25T12:23:22.659 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.653+0000 7fdec40f7640 1 Processor -- start 2024-04-25T12:23:22.659 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.653+0000 7fdec40f7640 1 -- start start 2024-04-25T12:23:22.659 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.653+0000 7fdec40f7640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdebc074100 0x7fdebc0c4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:23:22.659 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.653+0000 7fdec40f7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdebc14fbc0 0x7fdebc152350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:23:22.659 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.653+0000 7fdec40f7640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdebc14ffa0 0x7fdebc152890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:23:22.659 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.653+0000 7fdec40f7640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fdebc167630 con 0x7fdebc14ffa0 2024-04-25T12:23:22.659 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.653+0000 7fdec40f7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdebc1674b0 con 0x7fdebc14fbc0 2024-04-25T12:23:22.660 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.653+0000 7fdec40f7640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fdebc1677b0 con 0x7fdebc074100 2024-04-25T12:23:22.660 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.653+0000 7fdec2694640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdebc14ffa0 0x7fdebc152890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:23:22.660 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.653+0000 7fdec2694640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdebc14ffa0 0x7fdebc152890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38274/0 (socket says 172.21.15.86:38274) 2024-04-25T12:23:22.660 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.653+0000 7fdec2694640 1 -- 172.21.15.86:0/420415141 learned_addr learned my addr 172.21.15.86:0/420415141 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:23:22.660 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.653+0000 7fdec1e93640 1 --2- 172.21.15.86:0/420415141 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdebc074100 0x7fdebc0c4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:23:22.660 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.653+0000 7fdec2694640 1 -- 172.21.15.86:0/420415141 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdebc074100 msgr2=0x7fdebc0c4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:23:22.660 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.653+0000 7fdec1692640 1 --2- 172.21.15.86:0/420415141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdebc14fbc0 0x7fdebc152350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:23:22.660 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.653+0000 7fdec2694640 1 --2- 172.21.15.86:0/420415141 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdebc074100 0x7fdebc0c4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:22.661 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.653+0000 7fdec2694640 1 -- 172.21.15.86:0/420415141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdebc14fbc0 msgr2=0x7fdebc152350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:23:22.661 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.653+0000 7fdec2694640 1 --2- 172.21.15.86:0/420415141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdebc14fbc0 0x7fdebc152350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:22.661 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.653+0000 7fdec2694640 1 -- 172.21.15.86:0/420415141 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdebc1516e0 con 0x7fdebc14ffa0 2024-04-25T12:23:22.661 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.653+0000 7fdec1e93640 1 --2- 172.21.15.86:0/420415141 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdebc074100 0x7fdebc0c4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:23:22.661 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.653+0000 7fdec2694640 1 --2- 172.21.15.86:0/420415141 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdebc14ffa0 0x7fdebc152890 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fdeb400c750 tx=0x7fdeb400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:23:22.661 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.653+0000 7fdeba7fc640 1 -- 172.21.15.86:0/420415141 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeb4017070 con 0x7fdebc14ffa0 2024-04-25T12:23:22.661 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.653+0000 7fdeba7fc640 1 -- 172.21.15.86:0/420415141 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdeb4003b90 con 0x7fdebc14ffa0 2024-04-25T12:23:22.661 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.653+0000 7fdec40f7640 1 -- 172.21.15.86:0/420415141 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdebc1f7860 con 0x7fdebc14ffa0 2024-04-25T12:23:22.661 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.653+0000 7fdeba7fc640 1 -- 172.21.15.86:0/420415141 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeb4005070 con 0x7fdebc14ffa0 2024-04-25T12:23:22.662 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.653+0000 7fdec40f7640 1 -- 172.21.15.86:0/420415141 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdebc1f7e00 con 0x7fdebc14ffa0 2024-04-25T12:23:22.663 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.657+0000 7fdec40f7640 1 -- 172.21.15.86:0/420415141 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdebc075df0 con 0x7fdebc14ffa0 2024-04-25T12:23:22.663 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.657+0000 7fdeba7fc640 1 -- 172.21.15.86:0/420415141 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fdeb401a070 con 0x7fdebc14ffa0 2024-04-25T12:23:22.663 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.657+0000 7fdeba7fc640 1 --2- 172.21.15.86:0/420415141 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fdea80683b0 0x7fdea806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:23:22.663 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.657+0000 7fdeba7fc640 1 -- 172.21.15.86:0/420415141 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fdeb40862d0 con 0x7fdebc14ffa0 2024-04-25T12:23:22.663 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.657+0000 7fdec1e93640 1 --2- 172.21.15.86:0/420415141 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fdea80683b0 0x7fdea806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:23:22.663 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.657+0000 7fdec1e93640 1 --2- 172.21.15.86:0/420415141 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fdea80683b0 0x7fdea806a870 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fdeac000f70 tx=0x7fdeac009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:23:22.665 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.661+0000 7fdeba7fc640 1 -- 172.21.15.86:0/420415141 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fdeb4056520 con 0x7fdebc14ffa0 2024-04-25T12:23:22.822 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.817+0000 7fdec40f7640 1 -- 172.21.15.86:0/420415141 --> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdebc0c7df0 con 0x7fdea80683b0 2024-04-25T12:23:22.834 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.829+0000 7fdeba7fc640 1 -- 172.21.15.86:0/420415141 <== mgr.4107 v2:172.21.15.86:6832/3708662606 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332771 (secure 0 0 0) 0x7fdebc0c7df0 con 0x7fdea80683b0 2024-04-25T12:23:22.837 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:23:22.839 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2024-04-25T12:23:22.840 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.833+0000 7fdec40f7640 1 -- 172.21.15.86:0/420415141 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fdea80683b0 msgr2=0x7fdea806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:23:22.840 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.833+0000 7fdec40f7640 1 --2- 172.21.15.86:0/420415141 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fdea80683b0 0x7fdea806a870 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fdeac000f70 tx=0x7fdeac009040 comp rx=0 tx=0).stop 2024-04-25T12:23:22.840 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.833+0000 7fdec40f7640 1 -- 172.21.15.86:0/420415141 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdebc14ffa0 msgr2=0x7fdebc152890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:23:22.840 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.833+0000 7fdec40f7640 1 --2- 172.21.15.86:0/420415141 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdebc14ffa0 0x7fdebc152890 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fdeb400c750 tx=0x7fdeb400cc10 comp rx=0 tx=0).stop 2024-04-25T12:23:22.840 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.833+0000 7fdec40f7640 1 -- 172.21.15.86:0/420415141 shutdown_connections 2024-04-25T12:23:22.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.833+0000 7fdec40f7640 1 --2- 172.21.15.86:0/420415141 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fdea80683b0 0x7fdea806a870 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:22.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.833+0000 7fdec40f7640 1 --2- 172.21.15.86:0/420415141 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdebc14ffa0 0x7fdebc152890 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:22.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.833+0000 7fdec40f7640 1 --2- 172.21.15.86:0/420415141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdebc14fbc0 0x7fdebc152350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:22.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.833+0000 7fdec40f7640 1 --2- 172.21.15.86:0/420415141 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdebc074100 0x7fdebc0c4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:22.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.833+0000 7fdec40f7640 1 -- 172.21.15.86:0/420415141 >> 172.21.15.86:0/420415141 conn(0x7fdebc06b9d0 msgr2=0x7fdebc14d3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:23:22.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.833+0000 7fdec40f7640 1 -- 172.21.15.86:0/420415141 shutdown_connections 2024-04-25T12:23:22.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:22.833+0000 7fdec40f7640 1 -- 172.21.15.86:0/420415141 wait complete. 2024-04-25T12:23:22.854 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":84,"stamp":"2024-04-25T12:23:21.841608+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":602960,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":379,"num_write_kb":2494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":391,"ondisk_log_size":391,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223880,"kb_used_data":3592,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750840,"statfs":{"total":773094113280,"available":772864860160,"internally_reserved":0,"allocated":3678208,"data_stored":2120808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004978"},"pg_stats":[{"pgid":"2.1f","version":"26'18","reported_seq":53,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:40.336349+0000","last_change":"2024-04-25T12:22:40.336380+0000","last_active":"2024-04-25T12:22:40.336349+0000","last_peered":"2024-04-25T12:22:40.336349+0000","last_clean":"2024-04-25T12:22:40.336349+0000","last_became_active":"2024-04-25T12:21:23.123863+0000","last_became_peered":"2024-04-25T12:21:23.123863+0000","last_unstale":"2024-04-25T12:22:40.336349+0000","last_undegraded":"2024-04-25T12:22:40.336349+0000","last_fullsized":"2024-04-25T12:22:40.336349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'18","last_scrub_stamp":"2024-04-25T12:22:40.336281+0000","last_deep_scrub":"26'18","last_deep_scrub_stamp":"2024-04-25T12:22:40.336281+0000","last_clean_scrub_stamp":"2024-04-25T12:22:40.336281+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:20.470268+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:42.562674+0000","last_change":"2024-04-25T12:22:42.562727+0000","last_active":"2024-04-25T12:22:42.562674+0000","last_peered":"2024-04-25T12:22:42.562674+0000","last_clean":"2024-04-25T12:22:42.562674+0000","last_became_active":"2024-04-25T12:21:24.141482+0000","last_became_peered":"2024-04-25T12:21:24.141482+0000","last_unstale":"2024-04-25T12:22:42.562674+0000","last_undegraded":"2024-04-25T12:22:42.562674+0000","last_fullsized":"2024-04-25T12:22:42.562674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:42.562478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:42.562478+0000","last_clean_scrub_stamp":"2024-04-25T12:22:42.562478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:46:56.890508+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:56.529910+0000","last_change":"2024-04-25T12:22:56.529973+0000","last_active":"2024-04-25T12:22:56.529910+0000","last_peered":"2024-04-25T12:22:56.529910+0000","last_clean":"2024-04-25T12:22:56.529910+0000","last_became_active":"2024-04-25T12:21:28.376966+0000","last_became_peered":"2024-04-25T12:21:28.376966+0000","last_unstale":"2024-04-25T12:22:56.529910+0000","last_undegraded":"2024-04-25T12:22:56.529910+0000","last_fullsized":"2024-04-25T12:22:56.529910+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:56.529733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:56.529733+0000","last_clean_scrub_stamp":"2024-04-25T12:22:56.529733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:31:35.817338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'2","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:45.583873+0000","last_change":"2024-04-25T12:22:45.583935+0000","last_active":"2024-04-25T12:22:45.583873+0000","last_peered":"2024-04-25T12:22:45.583873+0000","last_clean":"2024-04-25T12:22:45.583873+0000","last_became_active":"2024-04-25T12:21:23.113605+0000","last_became_peered":"2024-04-25T12:21:23.113605+0000","last_unstale":"2024-04-25T12:22:45.583873+0000","last_undegraded":"2024-04-25T12:22:45.583873+0000","last_fullsized":"2024-04-25T12:22:45.583873+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'2","last_scrub_stamp":"2024-04-25T12:22:45.583695+0000","last_deep_scrub":"24'2","last_deep_scrub_stamp":"2024-04-25T12:22:45.583695+0000","last_clean_scrub_stamp":"2024-04-25T12:22:45.583695+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:01:51.656276+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:55.319539+0000","last_change":"2024-04-25T12:22:55.319638+0000","last_active":"2024-04-25T12:22:55.319539+0000","last_peered":"2024-04-25T12:22:55.319539+0000","last_clean":"2024-04-25T12:22:55.319539+0000","last_became_active":"2024-04-25T12:22:04.925895+0000","last_became_peered":"2024-04-25T12:22:04.925895+0000","last_unstale":"2024-04-25T12:22:55.319539+0000","last_undegraded":"2024-04-25T12:22:55.319539+0000","last_fullsized":"2024-04-25T12:22:55.319539+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:55.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:55.319253+0000","last_clean_scrub_stamp":"2024-04-25T12:22:55.319253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:00:05.379516+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:53.537851+0000","last_change":"2024-04-25T12:22:53.537958+0000","last_active":"2024-04-25T12:22:53.537851+0000","last_peered":"2024-04-25T12:22:53.537851+0000","last_clean":"2024-04-25T12:22:53.537851+0000","last_became_active":"2024-04-25T12:21:28.204404+0000","last_became_peered":"2024-04-25T12:21:28.204404+0000","last_unstale":"2024-04-25T12:22:53.537851+0000","last_undegraded":"2024-04-25T12:22:53.537851+0000","last_fullsized":"2024-04-25T12:22:53.537851+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:53.537585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:53.537585+0000","last_clean_scrub_stamp":"2024-04-25T12:22:53.537585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:51:32.614692+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'18","reported_seq":53,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:48.744798+0000","last_change":"2024-04-25T12:22:48.744876+0000","last_active":"2024-04-25T12:22:48.744798+0000","last_peered":"2024-04-25T12:22:48.744798+0000","last_clean":"2024-04-25T12:22:48.744798+0000","last_became_active":"2024-04-25T12:21:23.131566+0000","last_became_peered":"2024-04-25T12:21:23.131566+0000","last_unstale":"2024-04-25T12:22:48.744798+0000","last_undegraded":"2024-04-25T12:22:48.744798+0000","last_fullsized":"2024-04-25T12:22:48.744798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'18","last_scrub_stamp":"2024-04-25T12:22:48.744628+0000","last_deep_scrub":"26'18","last_deep_scrub_stamp":"2024-04-25T12:22:48.744628+0000","last_clean_scrub_stamp":"2024-04-25T12:22:48.744628+0000","objects_scrubbed":7,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:01:02.447634+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:50.930135+0000","last_change":"2024-04-25T12:22:50.930188+0000","last_active":"2024-04-25T12:22:50.930135+0000","last_peered":"2024-04-25T12:22:50.930135+0000","last_clean":"2024-04-25T12:22:50.930135+0000","last_became_active":"2024-04-25T12:21:24.128027+0000","last_became_peered":"2024-04-25T12:21:24.128027+0000","last_unstale":"2024-04-25T12:22:50.930135+0000","last_undegraded":"2024-04-25T12:22:50.930135+0000","last_fullsized":"2024-04-25T12:22:50.930135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:50.929953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:50.929953+0000","last_clean_scrub_stamp":"2024-04-25T12:22:50.929953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:19.337434+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:52.575801+0000","last_change":"2024-04-25T12:22:52.575860+0000","last_active":"2024-04-25T12:22:52.575801+0000","last_peered":"2024-04-25T12:22:52.575801+0000","last_clean":"2024-04-25T12:22:52.575801+0000","last_became_active":"2024-04-25T12:21:28.201228+0000","last_became_peered":"2024-04-25T12:21:28.201228+0000","last_unstale":"2024-04-25T12:22:52.575801+0000","last_undegraded":"2024-04-25T12:22:52.575801+0000","last_fullsized":"2024-04-25T12:22:52.575801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:52.575605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:52.575605+0000","last_clean_scrub_stamp":"2024-04-25T12:22:52.575605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:00.104515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'8","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:47.713281+0000","last_change":"2024-04-25T12:22:47.713353+0000","last_active":"2024-04-25T12:22:47.713281+0000","last_peered":"2024-04-25T12:22:47.713281+0000","last_clean":"2024-04-25T12:22:47.713281+0000","last_became_active":"2024-04-25T12:21:23.127717+0000","last_became_peered":"2024-04-25T12:21:23.127717+0000","last_unstale":"2024-04-25T12:22:47.713281+0000","last_undegraded":"2024-04-25T12:22:47.713281+0000","last_fullsized":"2024-04-25T12:22:47.713281+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-04-25T12:22:47.713102+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-04-25T12:22:47.713102+0000","last_clean_scrub_stamp":"2024-04-25T12:22:47.713102+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:51:02.373171+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:40.919651+0000","last_change":"2024-04-25T12:22:40.919705+0000","last_active":"2024-04-25T12:22:40.919651+0000","last_peered":"2024-04-25T12:22:40.919651+0000","last_clean":"2024-04-25T12:22:40.919651+0000","last_became_active":"2024-04-25T12:21:24.121392+0000","last_became_peered":"2024-04-25T12:21:24.121392+0000","last_unstale":"2024-04-25T12:22:40.919651+0000","last_undegraded":"2024-04-25T12:22:40.919651+0000","last_fullsized":"2024-04-25T12:22:40.919651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:40.919449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:40.919449+0000","last_clean_scrub_stamp":"2024-04-25T12:22:40.919449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:54:31.674064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:47.626532+0000","last_change":"2024-04-25T12:22:47.626593+0000","last_active":"2024-04-25T12:22:47.626532+0000","last_peered":"2024-04-25T12:22:47.626532+0000","last_clean":"2024-04-25T12:22:47.626532+0000","last_became_active":"2024-04-25T12:21:28.187340+0000","last_became_peered":"2024-04-25T12:21:28.187340+0000","last_unstale":"2024-04-25T12:22:47.626532+0000","last_undegraded":"2024-04-25T12:22:47.626532+0000","last_fullsized":"2024-04-25T12:22:47.626532+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:47.626350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:47.626350+0000","last_clean_scrub_stamp":"2024-04-25T12:22:47.626350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:39:57.411515+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:49.303087+0000","last_change":"2024-04-25T12:22:49.303142+0000","last_active":"2024-04-25T12:22:49.303087+0000","last_peered":"2024-04-25T12:22:49.303087+0000","last_clean":"2024-04-25T12:22:49.303087+0000","last_became_active":"2024-04-25T12:21:24.123695+0000","last_became_peered":"2024-04-25T12:21:24.123695+0000","last_unstale":"2024-04-25T12:22:49.303087+0000","last_undegraded":"2024-04-25T12:22:49.303087+0000","last_fullsized":"2024-04-25T12:22:49.303087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:49.302901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:49.302901+0000","last_clean_scrub_stamp":"2024-04-25T12:22:49.302901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:25:22.812559+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'6","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:49.719112+0000","last_change":"2024-04-25T12:22:49.719183+0000","last_active":"2024-04-25T12:22:49.719112+0000","last_peered":"2024-04-25T12:22:49.719112+0000","last_clean":"2024-04-25T12:22:49.719112+0000","last_became_active":"2024-04-25T12:21:23.139025+0000","last_became_peered":"2024-04-25T12:21:23.139025+0000","last_unstale":"2024-04-25T12:22:49.719112+0000","last_undegraded":"2024-04-25T12:22:49.719112+0000","last_fullsized":"2024-04-25T12:22:49.719112+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-04-25T12:22:49.718945+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-04-25T12:22:49.718945+0000","last_clean_scrub_stamp":"2024-04-25T12:22:49.718945+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:58.946427+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:46.632102+0000","last_change":"2024-04-25T12:22:46.632185+0000","last_active":"2024-04-25T12:22:46.632102+0000","last_peered":"2024-04-25T12:22:46.632102+0000","last_clean":"2024-04-25T12:22:46.632102+0000","last_became_active":"2024-04-25T12:21:28.187619+0000","last_became_peered":"2024-04-25T12:21:28.187619+0000","last_unstale":"2024-04-25T12:22:46.632102+0000","last_undegraded":"2024-04-25T12:22:46.632102+0000","last_fullsized":"2024-04-25T12:22:46.632102+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:46.631911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:46.631911+0000","last_clean_scrub_stamp":"2024-04-25T12:22:46.631911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:45:46.230182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:43.541177+0000","last_change":"2024-04-25T12:22:43.541235+0000","last_active":"2024-04-25T12:22:43.541177+0000","last_peered":"2024-04-25T12:22:43.541177+0000","last_clean":"2024-04-25T12:22:43.541177+0000","last_became_active":"2024-04-25T12:21:24.136535+0000","last_became_peered":"2024-04-25T12:21:24.136535+0000","last_unstale":"2024-04-25T12:22:43.541177+0000","last_undegraded":"2024-04-25T12:22:43.541177+0000","last_fullsized":"2024-04-25T12:22:43.541177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:43.540978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:43.540978+0000","last_clean_scrub_stamp":"2024-04-25T12:22:43.540978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:36:03.693964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'4","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:40.605728+0000","last_change":"2024-04-25T12:22:40.605784+0000","last_active":"2024-04-25T12:22:40.605728+0000","last_peered":"2024-04-25T12:22:40.605728+0000","last_clean":"2024-04-25T12:22:40.605728+0000","last_became_active":"2024-04-25T12:21:23.105051+0000","last_became_peered":"2024-04-25T12:21:23.105051+0000","last_unstale":"2024-04-25T12:22:40.605728+0000","last_undegraded":"2024-04-25T12:22:40.605728+0000","last_fullsized":"2024-04-25T12:22:40.605728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2024-04-25T12:22:40.605629+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2024-04-25T12:22:40.605629+0000","last_clean_scrub_stamp":"2024-04-25T12:22:40.605629+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:30.162807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:51.546419+0000","last_change":"2024-04-25T12:22:51.546481+0000","last_active":"2024-04-25T12:22:51.546419+0000","last_peered":"2024-04-25T12:22:51.546419+0000","last_clean":"2024-04-25T12:22:51.546419+0000","last_became_active":"2024-04-25T12:21:28.201389+0000","last_became_peered":"2024-04-25T12:21:28.201389+0000","last_unstale":"2024-04-25T12:22:51.546419+0000","last_undegraded":"2024-04-25T12:22:51.546419+0000","last_fullsized":"2024-04-25T12:22:51.546419+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:51.546228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:51.546228+0000","last_clean_scrub_stamp":"2024-04-25T12:22:51.546228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:51:02.870030+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:40.533252+0000","last_change":"2024-04-25T12:22:40.533278+0000","last_active":"2024-04-25T12:22:40.533252+0000","last_peered":"2024-04-25T12:22:40.533252+0000","last_clean":"2024-04-25T12:22:40.533252+0000","last_became_active":"2024-04-25T12:21:24.138446+0000","last_became_peered":"2024-04-25T12:21:24.138446+0000","last_unstale":"2024-04-25T12:22:40.533252+0000","last_undegraded":"2024-04-25T12:22:40.533252+0000","last_fullsized":"2024-04-25T12:22:40.533252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:40.533171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:40.533171+0000","last_clean_scrub_stamp":"2024-04-25T12:22:40.533171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:42.709007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'10","reported_seq":45,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:44.663914+0000","last_change":"2024-04-25T12:22:44.663987+0000","last_active":"2024-04-25T12:22:44.663914+0000","last_peered":"2024-04-25T12:22:44.663914+0000","last_clean":"2024-04-25T12:22:44.663914+0000","last_became_active":"2024-04-25T12:21:23.126521+0000","last_became_peered":"2024-04-25T12:21:23.126521+0000","last_unstale":"2024-04-25T12:22:44.663914+0000","last_undegraded":"2024-04-25T12:22:44.663914+0000","last_fullsized":"2024-04-25T12:22:44.663914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'10","last_scrub_stamp":"2024-04-25T12:22:44.663739+0000","last_deep_scrub":"26'10","last_deep_scrub_stamp":"2024-04-25T12:22:44.663739+0000","last_clean_scrub_stamp":"2024-04-25T12:22:44.663739+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:16:39.942970+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:55.660274+0000","last_change":"2024-04-25T12:22:55.660336+0000","last_active":"2024-04-25T12:22:55.660274+0000","last_peered":"2024-04-25T12:22:55.660274+0000","last_clean":"2024-04-25T12:22:55.660274+0000","last_became_active":"2024-04-25T12:21:28.383568+0000","last_became_peered":"2024-04-25T12:21:28.383568+0000","last_unstale":"2024-04-25T12:22:55.660274+0000","last_undegraded":"2024-04-25T12:22:55.660274+0000","last_fullsized":"2024-04-25T12:22:55.660274+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:55.660066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:55.660066+0000","last_clean_scrub_stamp":"2024-04-25T12:22:55.660066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:56:56.367844+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:42.498716+0000","last_change":"2024-04-25T12:22:42.498819+0000","last_active":"2024-04-25T12:22:42.498716+0000","last_peered":"2024-04-25T12:22:42.498716+0000","last_clean":"2024-04-25T12:22:42.498716+0000","last_became_active":"2024-04-25T12:21:24.121963+0000","last_became_peered":"2024-04-25T12:21:24.121963+0000","last_unstale":"2024-04-25T12:22:42.498716+0000","last_undegraded":"2024-04-25T12:22:42.498716+0000","last_fullsized":"2024-04-25T12:22:42.498716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:42.498481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:42.498481+0000","last_clean_scrub_stamp":"2024-04-25T12:22:42.498481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:24:53.367814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'3","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:45.759053+0000","last_change":"2024-04-25T12:22:45.759118+0000","last_active":"2024-04-25T12:22:45.759053+0000","last_peered":"2024-04-25T12:22:45.759053+0000","last_clean":"2024-04-25T12:22:45.759053+0000","last_became_active":"2024-04-25T12:21:23.115571+0000","last_became_peered":"2024-04-25T12:21:23.115571+0000","last_unstale":"2024-04-25T12:22:45.759053+0000","last_undegraded":"2024-04-25T12:22:45.759053+0000","last_fullsized":"2024-04-25T12:22:45.759053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-04-25T12:22:45.758887+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-04-25T12:22:45.758887+0000","last_clean_scrub_stamp":"2024-04-25T12:22:45.758887+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:58:25.859480+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:49.566845+0000","last_change":"2024-04-25T12:22:49.566915+0000","last_active":"2024-04-25T12:22:49.566845+0000","last_peered":"2024-04-25T12:22:49.566845+0000","last_clean":"2024-04-25T12:22:49.566845+0000","last_became_active":"2024-04-25T12:21:28.201297+0000","last_became_peered":"2024-04-25T12:21:28.201297+0000","last_unstale":"2024-04-25T12:22:49.566845+0000","last_undegraded":"2024-04-25T12:22:49.566845+0000","last_fullsized":"2024-04-25T12:22:49.566845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:49.566642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:49.566642+0000","last_clean_scrub_stamp":"2024-04-25T12:22:49.566642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:29:28.595245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:47.380267+0000","last_change":"2024-04-25T12:22:47.380324+0000","last_active":"2024-04-25T12:22:47.380267+0000","last_peered":"2024-04-25T12:22:47.380267+0000","last_clean":"2024-04-25T12:22:47.380267+0000","last_became_active":"2024-04-25T12:21:24.132703+0000","last_became_peered":"2024-04-25T12:21:24.132703+0000","last_unstale":"2024-04-25T12:22:47.380267+0000","last_undegraded":"2024-04-25T12:22:47.380267+0000","last_fullsized":"2024-04-25T12:22:47.380267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:47.380093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:47.380093+0000","last_clean_scrub_stamp":"2024-04-25T12:22:47.380093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:33:55.596755+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'10","reported_seq":45,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:44.300030+0000","last_change":"2024-04-25T12:22:44.300114+0000","last_active":"2024-04-25T12:22:44.300030+0000","last_peered":"2024-04-25T12:22:44.300030+0000","last_clean":"2024-04-25T12:22:44.300030+0000","last_became_active":"2024-04-25T12:21:23.131628+0000","last_became_peered":"2024-04-25T12:21:23.131628+0000","last_unstale":"2024-04-25T12:22:44.300030+0000","last_undegraded":"2024-04-25T12:22:44.300030+0000","last_fullsized":"2024-04-25T12:22:44.300030+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'10","last_scrub_stamp":"2024-04-25T12:22:44.299858+0000","last_deep_scrub":"26'10","last_deep_scrub_stamp":"2024-04-25T12:22:44.299858+0000","last_clean_scrub_stamp":"2024-04-25T12:22:44.299858+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:49:40.204289+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:54.537749+0000","last_change":"2024-04-25T12:22:54.537806+0000","last_active":"2024-04-25T12:22:54.537749+0000","last_peered":"2024-04-25T12:22:54.537749+0000","last_clean":"2024-04-25T12:22:54.537749+0000","last_became_active":"2024-04-25T12:21:28.376224+0000","last_became_peered":"2024-04-25T12:21:28.376224+0000","last_unstale":"2024-04-25T12:22:54.537749+0000","last_undegraded":"2024-04-25T12:22:54.537749+0000","last_fullsized":"2024-04-25T12:22:54.537749+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:54.537567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:54.537567+0000","last_clean_scrub_stamp":"2024-04-25T12:22:54.537567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:43:05.193650+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:52.517434+0000","last_change":"2024-04-25T12:22:52.517491+0000","last_active":"2024-04-25T12:22:52.517434+0000","last_peered":"2024-04-25T12:22:52.517434+0000","last_clean":"2024-04-25T12:22:52.517434+0000","last_became_active":"2024-04-25T12:21:24.145132+0000","last_became_peered":"2024-04-25T12:21:24.145132+0000","last_unstale":"2024-04-25T12:22:52.517434+0000","last_undegraded":"2024-04-25T12:22:52.517434+0000","last_fullsized":"2024-04-25T12:22:52.517434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:52.517264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:52.517264+0000","last_clean_scrub_stamp":"2024-04-25T12:22:52.517264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:16:44.554002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'11","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:45.633511+0000","last_change":"2024-04-25T12:22:45.633592+0000","last_active":"2024-04-25T12:22:45.633511+0000","last_peered":"2024-04-25T12:22:45.633511+0000","last_clean":"2024-04-25T12:22:45.633511+0000","last_became_active":"2024-04-25T12:21:23.130612+0000","last_became_peered":"2024-04-25T12:21:23.130612+0000","last_unstale":"2024-04-25T12:22:45.633511+0000","last_undegraded":"2024-04-25T12:22:45.633511+0000","last_fullsized":"2024-04-25T12:22:45.633511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'11","last_scrub_stamp":"2024-04-25T12:22:45.633339+0000","last_deep_scrub":"26'11","last_deep_scrub_stamp":"2024-04-25T12:22:45.633339+0000","last_clean_scrub_stamp":"2024-04-25T12:22:45.633339+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:16:53.089405+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:54.497643+0000","last_change":"2024-04-25T12:22:54.497699+0000","last_active":"2024-04-25T12:22:54.497643+0000","last_peered":"2024-04-25T12:22:54.497643+0000","last_clean":"2024-04-25T12:22:54.497643+0000","last_became_active":"2024-04-25T12:21:28.374813+0000","last_became_peered":"2024-04-25T12:21:28.374813+0000","last_unstale":"2024-04-25T12:22:54.497643+0000","last_undegraded":"2024-04-25T12:22:54.497643+0000","last_fullsized":"2024-04-25T12:22:54.497643+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:54.497470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:54.497470+0000","last_clean_scrub_stamp":"2024-04-25T12:22:54.497470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:04:33.119936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:46.666467+0000","last_change":"2024-04-25T12:22:46.666527+0000","last_active":"2024-04-25T12:22:46.666467+0000","last_peered":"2024-04-25T12:22:46.666467+0000","last_clean":"2024-04-25T12:22:46.666467+0000","last_became_active":"2024-04-25T12:21:24.111430+0000","last_became_peered":"2024-04-25T12:21:24.111430+0000","last_unstale":"2024-04-25T12:22:46.666467+0000","last_undegraded":"2024-04-25T12:22:46.666467+0000","last_fullsized":"2024-04-25T12:22:46.666467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:46.666218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:46.666218+0000","last_clean_scrub_stamp":"2024-04-25T12:22:46.666218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:29.071242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'7","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:46.743538+0000","last_change":"2024-04-25T12:22:46.743610+0000","last_active":"2024-04-25T12:22:46.743538+0000","last_peered":"2024-04-25T12:22:46.743538+0000","last_clean":"2024-04-25T12:22:46.743538+0000","last_became_active":"2024-04-25T12:21:23.123492+0000","last_became_peered":"2024-04-25T12:21:23.123492+0000","last_unstale":"2024-04-25T12:22:46.743538+0000","last_undegraded":"2024-04-25T12:22:46.743538+0000","last_fullsized":"2024-04-25T12:22:46.743538+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-04-25T12:22:46.743372+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-04-25T12:22:46.743372+0000","last_clean_scrub_stamp":"2024-04-25T12:22:46.743372+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:50:20.215243+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:52.320294+0000","last_change":"2024-04-25T12:22:52.320357+0000","last_active":"2024-04-25T12:22:52.320294+0000","last_peered":"2024-04-25T12:22:52.320294+0000","last_clean":"2024-04-25T12:22:52.320294+0000","last_became_active":"2024-04-25T12:21:28.375119+0000","last_became_peered":"2024-04-25T12:21:28.375119+0000","last_unstale":"2024-04-25T12:22:52.320294+0000","last_undegraded":"2024-04-25T12:22:52.320294+0000","last_fullsized":"2024-04-25T12:22:52.320294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:52.320113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:52.320113+0000","last_clean_scrub_stamp":"2024-04-25T12:22:52.320113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:06.167567+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:52.941569+0000","last_change":"2024-04-25T12:22:52.941620+0000","last_active":"2024-04-25T12:22:52.941569+0000","last_peered":"2024-04-25T12:22:52.941569+0000","last_clean":"2024-04-25T12:22:52.941569+0000","last_became_active":"2024-04-25T12:21:24.130866+0000","last_became_peered":"2024-04-25T12:21:24.130866+0000","last_unstale":"2024-04-25T12:22:52.941569+0000","last_undegraded":"2024-04-25T12:22:52.941569+0000","last_fullsized":"2024-04-25T12:22:52.941569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:52.941395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:52.941395+0000","last_clean_scrub_stamp":"2024-04-25T12:22:52.941395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:07:58.027149+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"26'1","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:41.601999+0000","last_change":"2024-04-25T12:22:41.602024+0000","last_active":"2024-04-25T12:22:41.601999+0000","last_peered":"2024-04-25T12:22:41.601999+0000","last_clean":"2024-04-25T12:22:41.601999+0000","last_became_active":"2024-04-25T12:21:23.105809+0000","last_became_peered":"2024-04-25T12:21:23.105809+0000","last_unstale":"2024-04-25T12:22:41.601999+0000","last_undegraded":"2024-04-25T12:22:41.601999+0000","last_fullsized":"2024-04-25T12:22:41.601999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1","last_scrub_stamp":"2024-04-25T12:22:41.601927+0000","last_deep_scrub":"26'1","last_deep_scrub_stamp":"2024-04-25T12:22:41.601927+0000","last_clean_scrub_stamp":"2024-04-25T12:22:41.601927+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:15.506966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:52.643491+0000","last_change":"2024-04-25T12:22:52.643560+0000","last_active":"2024-04-25T12:22:52.643491+0000","last_peered":"2024-04-25T12:22:52.643491+0000","last_clean":"2024-04-25T12:22:52.643491+0000","last_became_active":"2024-04-25T12:21:28.192835+0000","last_became_peered":"2024-04-25T12:21:28.192835+0000","last_unstale":"2024-04-25T12:22:52.643491+0000","last_undegraded":"2024-04-25T12:22:52.643491+0000","last_fullsized":"2024-04-25T12:22:52.643491+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:52.643313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:52.643313+0000","last_clean_scrub_stamp":"2024-04-25T12:22:52.643313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:05:32.459029+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:43.506245+0000","last_change":"2024-04-25T12:22:43.506297+0000","last_active":"2024-04-25T12:22:43.506245+0000","last_peered":"2024-04-25T12:22:43.506245+0000","last_clean":"2024-04-25T12:22:43.506245+0000","last_became_active":"2024-04-25T12:21:24.124563+0000","last_became_peered":"2024-04-25T12:21:24.124563+0000","last_unstale":"2024-04-25T12:22:43.506245+0000","last_undegraded":"2024-04-25T12:22:43.506245+0000","last_fullsized":"2024-04-25T12:22:43.506245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:43.506083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:43.506083+0000","last_clean_scrub_stamp":"2024-04-25T12:22:43.506083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:36:29.972364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'5","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:43.930933+0000","last_change":"2024-04-25T12:22:43.930999+0000","last_active":"2024-04-25T12:22:43.930933+0000","last_peered":"2024-04-25T12:22:43.930933+0000","last_clean":"2024-04-25T12:22:43.930933+0000","last_became_active":"2024-04-25T12:21:23.113504+0000","last_became_peered":"2024-04-25T12:21:23.113504+0000","last_unstale":"2024-04-25T12:22:43.930933+0000","last_undegraded":"2024-04-25T12:22:43.930933+0000","last_fullsized":"2024-04-25T12:22:43.930933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-04-25T12:22:43.930764+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-04-25T12:22:43.930764+0000","last_clean_scrub_stamp":"2024-04-25T12:22:43.930764+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:24:04.507696+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:53.638361+0000","last_change":"2024-04-25T12:22:53.638480+0000","last_active":"2024-04-25T12:22:53.638361+0000","last_peered":"2024-04-25T12:22:53.638361+0000","last_clean":"2024-04-25T12:22:53.638361+0000","last_became_active":"2024-04-25T12:21:28.200082+0000","last_became_peered":"2024-04-25T12:21:28.200082+0000","last_unstale":"2024-04-25T12:22:53.638361+0000","last_undegraded":"2024-04-25T12:22:53.638361+0000","last_fullsized":"2024-04-25T12:22:53.638361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:53.638117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:53.638117+0000","last_clean_scrub_stamp":"2024-04-25T12:22:53.638117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:50.858381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:47.625138+0000","last_change":"2024-04-25T12:22:47.625192+0000","last_active":"2024-04-25T12:22:47.625138+0000","last_peered":"2024-04-25T12:22:47.625138+0000","last_clean":"2024-04-25T12:22:47.625138+0000","last_became_active":"2024-04-25T12:21:24.111503+0000","last_became_peered":"2024-04-25T12:21:24.111503+0000","last_unstale":"2024-04-25T12:22:47.625138+0000","last_undegraded":"2024-04-25T12:22:47.625138+0000","last_fullsized":"2024-04-25T12:22:47.625138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:47.624933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:47.624933+0000","last_clean_scrub_stamp":"2024-04-25T12:22:47.624933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:56:32.673946+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'7","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:41.722905+0000","last_change":"2024-04-25T12:22:41.722951+0000","last_active":"2024-04-25T12:22:41.722905+0000","last_peered":"2024-04-25T12:22:41.722905+0000","last_clean":"2024-04-25T12:22:41.722905+0000","last_became_active":"2024-04-25T12:21:23.108051+0000","last_became_peered":"2024-04-25T12:21:23.108051+0000","last_unstale":"2024-04-25T12:22:41.722905+0000","last_undegraded":"2024-04-25T12:22:41.722905+0000","last_fullsized":"2024-04-25T12:22:41.722905+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-04-25T12:22:41.722809+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-04-25T12:22:41.722809+0000","last_clean_scrub_stamp":"2024-04-25T12:22:41.722809+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:03:55.630408+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:51.625153+0000","last_change":"2024-04-25T12:22:51.625212+0000","last_active":"2024-04-25T12:22:51.625153+0000","last_peered":"2024-04-25T12:22:51.625153+0000","last_clean":"2024-04-25T12:22:51.625153+0000","last_became_active":"2024-04-25T12:21:28.189247+0000","last_became_peered":"2024-04-25T12:21:28.189247+0000","last_unstale":"2024-04-25T12:22:51.625153+0000","last_undegraded":"2024-04-25T12:22:51.625153+0000","last_fullsized":"2024-04-25T12:22:51.625153+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:51.624983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:51.624983+0000","last_clean_scrub_stamp":"2024-04-25T12:22:51.624983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:32.033636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:42.270331+0000","last_change":"2024-04-25T12:22:42.270402+0000","last_active":"2024-04-25T12:22:42.270331+0000","last_peered":"2024-04-25T12:22:42.270331+0000","last_clean":"2024-04-25T12:22:42.270331+0000","last_became_active":"2024-04-25T12:21:24.104947+0000","last_became_peered":"2024-04-25T12:21:24.104947+0000","last_unstale":"2024-04-25T12:22:42.270331+0000","last_undegraded":"2024-04-25T12:22:42.270331+0000","last_fullsized":"2024-04-25T12:22:42.270331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:42.270167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:42.270167+0000","last_clean_scrub_stamp":"2024-04-25T12:22:42.270167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:39:32.940827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'5","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:44.788078+0000","last_change":"2024-04-25T12:22:44.788214+0000","last_active":"2024-04-25T12:22:44.788078+0000","last_peered":"2024-04-25T12:22:44.788078+0000","last_clean":"2024-04-25T12:22:44.788078+0000","last_became_active":"2024-04-25T12:21:23.113829+0000","last_became_peered":"2024-04-25T12:21:23.113829+0000","last_unstale":"2024-04-25T12:22:44.788078+0000","last_undegraded":"2024-04-25T12:22:44.788078+0000","last_fullsized":"2024-04-25T12:22:44.788078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-04-25T12:22:44.787871+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-04-25T12:22:44.787871+0000","last_clean_scrub_stamp":"2024-04-25T12:22:44.787871+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:38:32.317606+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:53.280209+0000","last_change":"2024-04-25T12:22:53.280324+0000","last_active":"2024-04-25T12:22:53.280209+0000","last_peered":"2024-04-25T12:22:53.280209+0000","last_clean":"2024-04-25T12:22:53.280209+0000","last_became_active":"2024-04-25T12:21:28.377639+0000","last_became_peered":"2024-04-25T12:21:28.377639+0000","last_unstale":"2024-04-25T12:22:53.280209+0000","last_undegraded":"2024-04-25T12:22:53.280209+0000","last_fullsized":"2024-04-25T12:22:53.280209+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:53.279906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:53.279906+0000","last_clean_scrub_stamp":"2024-04-25T12:22:53.279906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:38:22.557301+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:48.522529+0000","last_change":"2024-04-25T12:22:48.522583+0000","last_active":"2024-04-25T12:22:48.522529+0000","last_peered":"2024-04-25T12:22:48.522529+0000","last_clean":"2024-04-25T12:22:48.522529+0000","last_became_active":"2024-04-25T12:21:24.119870+0000","last_became_peered":"2024-04-25T12:21:24.119870+0000","last_unstale":"2024-04-25T12:22:48.522529+0000","last_undegraded":"2024-04-25T12:22:48.522529+0000","last_fullsized":"2024-04-25T12:22:48.522529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:48.522310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:48.522310+0000","last_clean_scrub_stamp":"2024-04-25T12:22:48.522310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:30:41.405379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'10","reported_seq":45,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:42.913680+0000","last_change":"2024-04-25T12:22:42.913751+0000","last_active":"2024-04-25T12:22:42.913680+0000","last_peered":"2024-04-25T12:22:42.913680+0000","last_clean":"2024-04-25T12:22:42.913680+0000","last_became_active":"2024-04-25T12:21:23.102790+0000","last_became_peered":"2024-04-25T12:21:23.102790+0000","last_unstale":"2024-04-25T12:22:42.913680+0000","last_undegraded":"2024-04-25T12:22:42.913680+0000","last_fullsized":"2024-04-25T12:22:42.913680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'10","last_scrub_stamp":"2024-04-25T12:22:42.913494+0000","last_deep_scrub":"26'10","last_deep_scrub_stamp":"2024-04-25T12:22:42.913494+0000","last_clean_scrub_stamp":"2024-04-25T12:22:42.913494+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:05:14.748931+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"26'119","reported_seq":194,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:43.772619+0000","last_change":"2024-04-25T12:22:43.772619+0000","last_active":"2024-04-25T12:22:43.772619+0000","last_peered":"2024-04-25T12:22:43.772619+0000","last_clean":"2024-04-25T12:22:43.772619+0000","last_became_active":"2024-04-25T12:21:13.076753+0000","last_became_peered":"2024-04-25T12:21:13.076753+0000","last_unstale":"2024-04-25T12:22:43.772619+0000","last_undegraded":"2024-04-25T12:22:43.772619+0000","last_fullsized":"2024-04-25T12:22:43.772619+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'119","last_scrub_stamp":"2024-04-25T12:22:43.772358+0000","last_deep_scrub":"26'119","last_deep_scrub_stamp":"2024-04-25T12:22:43.772358+0000","last_clean_scrub_stamp":"2024-04-25T12:22:43.772358+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:31:39.406183+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:54.267849+0000","last_change":"2024-04-25T12:22:54.267910+0000","last_active":"2024-04-25T12:22:54.267849+0000","last_peered":"2024-04-25T12:22:54.267849+0000","last_clean":"2024-04-25T12:22:54.267849+0000","last_became_active":"2024-04-25T12:21:28.378522+0000","last_became_peered":"2024-04-25T12:21:28.378522+0000","last_unstale":"2024-04-25T12:22:54.267849+0000","last_undegraded":"2024-04-25T12:22:54.267849+0000","last_fullsized":"2024-04-25T12:22:54.267849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:54.267658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:54.267658+0000","last_clean_scrub_stamp":"2024-04-25T12:22:54.267658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:42:43.305144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:42.734909+0000","last_change":"2024-04-25T12:22:42.734968+0000","last_active":"2024-04-25T12:22:42.734909+0000","last_peered":"2024-04-25T12:22:42.734909+0000","last_clean":"2024-04-25T12:22:42.734909+0000","last_became_active":"2024-04-25T12:21:24.142085+0000","last_became_peered":"2024-04-25T12:21:24.142085+0000","last_unstale":"2024-04-25T12:22:42.734909+0000","last_undegraded":"2024-04-25T12:22:42.734909+0000","last_fullsized":"2024-04-25T12:22:42.734909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:42.734718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:42.734718+0000","last_clean_scrub_stamp":"2024-04-25T12:22:42.734718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:05.088499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'9","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:42.742303+0000","last_change":"2024-04-25T12:22:42.742404+0000","last_active":"2024-04-25T12:22:42.742303+0000","last_peered":"2024-04-25T12:22:42.742303+0000","last_clean":"2024-04-25T12:22:42.742303+0000","last_became_active":"2024-04-25T12:21:23.126103+0000","last_became_peered":"2024-04-25T12:21:23.126103+0000","last_unstale":"2024-04-25T12:22:42.742303+0000","last_undegraded":"2024-04-25T12:22:42.742303+0000","last_fullsized":"2024-04-25T12:22:42.742303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9","last_scrub_stamp":"2024-04-25T12:22:42.742133+0000","last_deep_scrub":"26'9","last_deep_scrub_stamp":"2024-04-25T12:22:42.742133+0000","last_clean_scrub_stamp":"2024-04-25T12:22:42.742133+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:03:16.734072+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:55.273673+0000","last_change":"2024-04-25T12:22:55.273730+0000","last_active":"2024-04-25T12:22:55.273673+0000","last_peered":"2024-04-25T12:22:55.273673+0000","last_clean":"2024-04-25T12:22:55.273673+0000","last_became_active":"2024-04-25T12:21:28.378559+0000","last_became_peered":"2024-04-25T12:21:28.378559+0000","last_unstale":"2024-04-25T12:22:55.273673+0000","last_undegraded":"2024-04-25T12:22:55.273673+0000","last_fullsized":"2024-04-25T12:22:55.273673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:55.273480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:55.273480+0000","last_clean_scrub_stamp":"2024-04-25T12:22:55.273480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:49:43.112798+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:51.901975+0000","last_change":"2024-04-25T12:22:51.902028+0000","last_active":"2024-04-25T12:22:51.901975+0000","last_peered":"2024-04-25T12:22:51.901975+0000","last_clean":"2024-04-25T12:22:51.901975+0000","last_became_active":"2024-04-25T12:21:24.126968+0000","last_became_peered":"2024-04-25T12:21:24.126968+0000","last_unstale":"2024-04-25T12:22:51.901975+0000","last_undegraded":"2024-04-25T12:22:51.901975+0000","last_fullsized":"2024-04-25T12:22:51.901975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:51.901794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:51.901794+0000","last_clean_scrub_stamp":"2024-04-25T12:22:51.901794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:30:12.830987+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'4","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:42.623813+0000","last_change":"2024-04-25T12:22:42.623875+0000","last_active":"2024-04-25T12:22:42.623813+0000","last_peered":"2024-04-25T12:22:42.623813+0000","last_clean":"2024-04-25T12:22:42.623813+0000","last_became_active":"2024-04-25T12:21:23.116148+0000","last_became_peered":"2024-04-25T12:21:23.116148+0000","last_unstale":"2024-04-25T12:22:42.623813+0000","last_undegraded":"2024-04-25T12:22:42.623813+0000","last_fullsized":"2024-04-25T12:22:42.623813+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2024-04-25T12:22:42.623644+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2024-04-25T12:22:42.623644+0000","last_clean_scrub_stamp":"2024-04-25T12:22:42.623644+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:51:20.933906+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:50.355744+0000","last_change":"2024-04-25T12:22:50.355857+0000","last_active":"2024-04-25T12:22:50.355744+0000","last_peered":"2024-04-25T12:22:50.355744+0000","last_clean":"2024-04-25T12:22:50.355744+0000","last_became_active":"2024-04-25T12:21:28.194191+0000","last_became_peered":"2024-04-25T12:21:28.194191+0000","last_unstale":"2024-04-25T12:22:50.355744+0000","last_undegraded":"2024-04-25T12:22:50.355744+0000","last_fullsized":"2024-04-25T12:22:50.355744+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:50.355517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:50.355517+0000","last_clean_scrub_stamp":"2024-04-25T12:22:50.355517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:04:03.685699+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:56.839544+0000","last_change":"2024-04-25T12:22:56.839599+0000","last_active":"2024-04-25T12:22:56.839544+0000","last_peered":"2024-04-25T12:22:56.839544+0000","last_clean":"2024-04-25T12:22:56.839544+0000","last_became_active":"2024-04-25T12:21:24.145807+0000","last_became_peered":"2024-04-25T12:21:24.145807+0000","last_unstale":"2024-04-25T12:22:56.839544+0000","last_undegraded":"2024-04-25T12:22:56.839544+0000","last_fullsized":"2024-04-25T12:22:56.839544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:56.839367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:56.839367+0000","last_clean_scrub_stamp":"2024-04-25T12:22:56.839367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:55:33.939386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"26'6","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:39.715610+0000","last_change":"2024-04-25T12:22:39.715636+0000","last_active":"2024-04-25T12:22:39.715610+0000","last_peered":"2024-04-25T12:22:39.715610+0000","last_clean":"2024-04-25T12:22:39.715610+0000","last_became_active":"2024-04-25T12:21:23.102997+0000","last_became_peered":"2024-04-25T12:21:23.102997+0000","last_unstale":"2024-04-25T12:22:39.715610+0000","last_undegraded":"2024-04-25T12:22:39.715610+0000","last_fullsized":"2024-04-25T12:22:39.715610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-04-25T12:22:39.715546+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-04-25T12:22:39.715546+0000","last_clean_scrub_stamp":"2024-04-25T12:22:39.715546+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:42:33.033467+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:58.005027+0000","last_change":"2024-04-25T12:22:58.005087+0000","last_active":"2024-04-25T12:22:58.005027+0000","last_peered":"2024-04-25T12:22:58.005027+0000","last_clean":"2024-04-25T12:22:58.005027+0000","last_became_active":"2024-04-25T12:21:28.382953+0000","last_became_peered":"2024-04-25T12:21:28.382953+0000","last_unstale":"2024-04-25T12:22:58.005027+0000","last_undegraded":"2024-04-25T12:22:58.005027+0000","last_fullsized":"2024-04-25T12:22:58.005027+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:58.004841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:58.004841+0000","last_clean_scrub_stamp":"2024-04-25T12:22:58.004841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:56:13.390059+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:55.802735+0000","last_change":"2024-04-25T12:22:55.802795+0000","last_active":"2024-04-25T12:22:55.802735+0000","last_peered":"2024-04-25T12:22:55.802735+0000","last_clean":"2024-04-25T12:22:55.802735+0000","last_became_active":"2024-04-25T12:21:24.146162+0000","last_became_peered":"2024-04-25T12:21:24.146162+0000","last_unstale":"2024-04-25T12:22:55.802735+0000","last_undegraded":"2024-04-25T12:22:55.802735+0000","last_fullsized":"2024-04-25T12:22:55.802735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:55.802570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:55.802570+0000","last_clean_scrub_stamp":"2024-04-25T12:22:55.802570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:24:49.531292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'4","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:40.493640+0000","last_change":"2024-04-25T12:22:40.493708+0000","last_active":"2024-04-25T12:22:40.493640+0000","last_peered":"2024-04-25T12:22:40.493640+0000","last_clean":"2024-04-25T12:22:40.493640+0000","last_became_active":"2024-04-25T12:21:23.134441+0000","last_became_peered":"2024-04-25T12:21:23.134441+0000","last_unstale":"2024-04-25T12:22:40.493640+0000","last_undegraded":"2024-04-25T12:22:40.493640+0000","last_fullsized":"2024-04-25T12:22:40.493640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2024-04-25T12:22:40.493462+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2024-04-25T12:22:40.493462+0000","last_clean_scrub_stamp":"2024-04-25T12:22:40.493462+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:25:53.259898+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:50.583457+0000","last_change":"2024-04-25T12:22:50.583569+0000","last_active":"2024-04-25T12:22:50.583457+0000","last_peered":"2024-04-25T12:22:50.583457+0000","last_clean":"2024-04-25T12:22:50.583457+0000","last_became_active":"2024-04-25T12:21:28.201479+0000","last_became_peered":"2024-04-25T12:21:28.201479+0000","last_unstale":"2024-04-25T12:22:50.583457+0000","last_undegraded":"2024-04-25T12:22:50.583457+0000","last_fullsized":"2024-04-25T12:22:50.583457+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:50.583184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:50.583184+0000","last_clean_scrub_stamp":"2024-04-25T12:22:50.583184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:37:16.402593+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:52.732417+0000","last_change":"2024-04-25T12:22:52.732473+0000","last_active":"2024-04-25T12:22:52.732417+0000","last_peered":"2024-04-25T12:22:52.732417+0000","last_clean":"2024-04-25T12:22:52.732417+0000","last_became_active":"2024-04-25T12:21:24.142422+0000","last_became_peered":"2024-04-25T12:21:24.142422+0000","last_unstale":"2024-04-25T12:22:52.732417+0000","last_undegraded":"2024-04-25T12:22:52.732417+0000","last_fullsized":"2024-04-25T12:22:52.732417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:52.732235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:52.732235+0000","last_clean_scrub_stamp":"2024-04-25T12:22:52.732235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:36.605844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'25","reported_seq":60,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:40.679884+0000","last_change":"2024-04-25T12:22:40.679918+0000","last_active":"2024-04-25T12:22:40.679884+0000","last_peered":"2024-04-25T12:22:40.679884+0000","last_clean":"2024-04-25T12:22:40.679884+0000","last_became_active":"2024-04-25T12:21:23.103680+0000","last_became_peered":"2024-04-25T12:21:23.103680+0000","last_unstale":"2024-04-25T12:22:40.679884+0000","last_undegraded":"2024-04-25T12:22:40.679884+0000","last_fullsized":"2024-04-25T12:22:40.679884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'25","last_scrub_stamp":"2024-04-25T12:22:40.679824+0000","last_deep_scrub":"26'25","last_deep_scrub_stamp":"2024-04-25T12:22:40.679824+0000","last_clean_scrub_stamp":"2024-04-25T12:22:40.679824+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:38:04.661304+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:51.370321+0000","last_change":"2024-04-25T12:22:51.370400+0000","last_active":"2024-04-25T12:22:51.370321+0000","last_peered":"2024-04-25T12:22:51.370321+0000","last_clean":"2024-04-25T12:22:51.370321+0000","last_became_active":"2024-04-25T12:21:28.199411+0000","last_became_peered":"2024-04-25T12:21:28.199411+0000","last_unstale":"2024-04-25T12:22:51.370321+0000","last_undegraded":"2024-04-25T12:22:51.370321+0000","last_fullsized":"2024-04-25T12:22:51.370321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:51.370136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:51.370136+0000","last_clean_scrub_stamp":"2024-04-25T12:22:51.370136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:58.327026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:51.228947+0000","last_change":"2024-04-25T12:22:51.229004+0000","last_active":"2024-04-25T12:22:51.228947+0000","last_peered":"2024-04-25T12:22:51.228947+0000","last_clean":"2024-04-25T12:22:51.228947+0000","last_became_active":"2024-04-25T12:21:24.126721+0000","last_became_peered":"2024-04-25T12:21:24.126721+0000","last_unstale":"2024-04-25T12:22:51.228947+0000","last_undegraded":"2024-04-25T12:22:51.228947+0000","last_fullsized":"2024-04-25T12:22:51.228947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:51.228765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:51.228765+0000","last_clean_scrub_stamp":"2024-04-25T12:22:51.228765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:21:29.009058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'9","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:46.288790+0000","last_change":"2024-04-25T12:22:46.288860+0000","last_active":"2024-04-25T12:22:46.288790+0000","last_peered":"2024-04-25T12:22:46.288790+0000","last_clean":"2024-04-25T12:22:46.288790+0000","last_became_active":"2024-04-25T12:21:23.138837+0000","last_became_peered":"2024-04-25T12:21:23.138837+0000","last_unstale":"2024-04-25T12:22:46.288790+0000","last_undegraded":"2024-04-25T12:22:46.288790+0000","last_fullsized":"2024-04-25T12:22:46.288790+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9","last_scrub_stamp":"2024-04-25T12:22:46.288597+0000","last_deep_scrub":"26'9","last_deep_scrub_stamp":"2024-04-25T12:22:46.288597+0000","last_clean_scrub_stamp":"2024-04-25T12:22:46.288597+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:29:04.825565+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:57.563671+0000","last_change":"2024-04-25T12:22:57.563729+0000","last_active":"2024-04-25T12:22:57.563671+0000","last_peered":"2024-04-25T12:22:57.563671+0000","last_clean":"2024-04-25T12:22:57.563671+0000","last_became_active":"2024-04-25T12:21:28.383298+0000","last_became_peered":"2024-04-25T12:21:28.383298+0000","last_unstale":"2024-04-25T12:22:57.563671+0000","last_undegraded":"2024-04-25T12:22:57.563671+0000","last_fullsized":"2024-04-25T12:22:57.563671+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:57.563477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:57.563477+0000","last_clean_scrub_stamp":"2024-04-25T12:22:57.563477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:15:22.710115+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:54.785279+0000","last_change":"2024-04-25T12:22:54.785333+0000","last_active":"2024-04-25T12:22:54.785279+0000","last_peered":"2024-04-25T12:22:54.785279+0000","last_clean":"2024-04-25T12:22:54.785279+0000","last_became_active":"2024-04-25T12:21:24.145931+0000","last_became_peered":"2024-04-25T12:21:24.145931+0000","last_unstale":"2024-04-25T12:22:54.785279+0000","last_undegraded":"2024-04-25T12:22:54.785279+0000","last_fullsized":"2024-04-25T12:22:54.785279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:54.785105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:54.785105+0000","last_clean_scrub_stamp":"2024-04-25T12:22:54.785105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:17:24.635481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'8","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:45.898347+0000","last_change":"2024-04-25T12:22:45.898418+0000","last_active":"2024-04-25T12:22:45.898347+0000","last_peered":"2024-04-25T12:22:45.898347+0000","last_clean":"2024-04-25T12:22:45.898347+0000","last_became_active":"2024-04-25T12:21:23.121429+0000","last_became_peered":"2024-04-25T12:21:23.121429+0000","last_unstale":"2024-04-25T12:22:45.898347+0000","last_undegraded":"2024-04-25T12:22:45.898347+0000","last_fullsized":"2024-04-25T12:22:45.898347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-04-25T12:22:45.898153+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-04-25T12:22:45.898153+0000","last_clean_scrub_stamp":"2024-04-25T12:22:45.898153+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:39:39.691310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:55.536451+0000","last_change":"2024-04-25T12:22:55.536510+0000","last_active":"2024-04-25T12:22:55.536451+0000","last_peered":"2024-04-25T12:22:55.536451+0000","last_clean":"2024-04-25T12:22:55.536451+0000","last_became_active":"2024-04-25T12:21:28.375013+0000","last_became_peered":"2024-04-25T12:21:28.375013+0000","last_unstale":"2024-04-25T12:22:55.536451+0000","last_undegraded":"2024-04-25T12:22:55.536451+0000","last_fullsized":"2024-04-25T12:22:55.536451+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:55.536268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:55.536268+0000","last_clean_scrub_stamp":"2024-04-25T12:22:55.536268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:00:31.541096+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:49.380724+0000","last_change":"2024-04-25T12:22:49.380774+0000","last_active":"2024-04-25T12:22:49.380724+0000","last_peered":"2024-04-25T12:22:49.380724+0000","last_clean":"2024-04-25T12:22:49.380724+0000","last_became_active":"2024-04-25T12:21:24.138016+0000","last_became_peered":"2024-04-25T12:21:24.138016+0000","last_unstale":"2024-04-25T12:22:49.380724+0000","last_undegraded":"2024-04-25T12:22:49.380724+0000","last_fullsized":"2024-04-25T12:22:49.380724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:49.380551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:49.380551+0000","last_clean_scrub_stamp":"2024-04-25T12:22:49.380551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:33:03.357242+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'14","reported_seq":49,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:41.315760+0000","last_change":"2024-04-25T12:22:41.315835+0000","last_active":"2024-04-25T12:22:41.315760+0000","last_peered":"2024-04-25T12:22:41.315760+0000","last_clean":"2024-04-25T12:22:41.315760+0000","last_became_active":"2024-04-25T12:21:23.135947+0000","last_became_peered":"2024-04-25T12:21:23.135947+0000","last_unstale":"2024-04-25T12:22:41.315760+0000","last_undegraded":"2024-04-25T12:22:41.315760+0000","last_fullsized":"2024-04-25T12:22:41.315760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'14","last_scrub_stamp":"2024-04-25T12:22:41.315592+0000","last_deep_scrub":"26'14","last_deep_scrub_stamp":"2024-04-25T12:22:41.315592+0000","last_clean_scrub_stamp":"2024-04-25T12:22:41.315592+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:01:51.690230+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:56.989323+0000","last_change":"2024-04-25T12:22:56.989384+0000","last_active":"2024-04-25T12:22:56.989323+0000","last_peered":"2024-04-25T12:22:56.989323+0000","last_clean":"2024-04-25T12:22:56.989323+0000","last_became_active":"2024-04-25T12:21:28.377532+0000","last_became_peered":"2024-04-25T12:21:28.377532+0000","last_unstale":"2024-04-25T12:22:56.989323+0000","last_undegraded":"2024-04-25T12:22:56.989323+0000","last_fullsized":"2024-04-25T12:22:56.989323+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:56.989126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:56.989126+0000","last_clean_scrub_stamp":"2024-04-25T12:22:56.989126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:42:26.504276+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:47.729667+0000","last_change":"2024-04-25T12:22:47.729722+0000","last_active":"2024-04-25T12:22:47.729667+0000","last_peered":"2024-04-25T12:22:47.729667+0000","last_clean":"2024-04-25T12:22:47.729667+0000","last_became_active":"2024-04-25T12:22:04.899942+0000","last_became_peered":"2024-04-25T12:22:04.899942+0000","last_unstale":"2024-04-25T12:22:47.729667+0000","last_undegraded":"2024-04-25T12:22:47.729667+0000","last_fullsized":"2024-04-25T12:22:47.729667+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:47.729505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:47.729505+0000","last_clean_scrub_stamp":"2024-04-25T12:22:47.729505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:01:52.006419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.14","version":"26'19","reported_seq":54,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:42.334269+0000","last_change":"2024-04-25T12:22:42.334404+0000","last_active":"2024-04-25T12:22:42.334269+0000","last_peered":"2024-04-25T12:22:42.334269+0000","last_clean":"2024-04-25T12:22:42.334269+0000","last_became_active":"2024-04-25T12:21:23.129474+0000","last_became_peered":"2024-04-25T12:21:23.129474+0000","last_unstale":"2024-04-25T12:22:42.334269+0000","last_undegraded":"2024-04-25T12:22:42.334269+0000","last_fullsized":"2024-04-25T12:22:42.334269+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'19","last_scrub_stamp":"2024-04-25T12:22:42.334069+0000","last_deep_scrub":"26'19","last_deep_scrub_stamp":"2024-04-25T12:22:42.334069+0000","last_clean_scrub_stamp":"2024-04-25T12:22:42.334069+0000","objects_scrubbed":6,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:03:30.466348+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4424,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:54.616693+0000","last_change":"2024-04-25T12:22:54.616755+0000","last_active":"2024-04-25T12:22:54.616693+0000","last_peered":"2024-04-25T12:22:54.616693+0000","last_clean":"2024-04-25T12:22:54.616693+0000","last_became_active":"2024-04-25T12:21:28.200152+0000","last_became_peered":"2024-04-25T12:21:28.200152+0000","last_unstale":"2024-04-25T12:22:54.616693+0000","last_undegraded":"2024-04-25T12:22:54.616693+0000","last_fullsized":"2024-04-25T12:22:54.616693+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:54.616498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:54.616498+0000","last_clean_scrub_stamp":"2024-04-25T12:22:54.616498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:50:32.550807+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:45.589398+0000","last_change":"2024-04-25T12:22:45.589450+0000","last_active":"2024-04-25T12:22:45.589398+0000","last_peered":"2024-04-25T12:22:45.589398+0000","last_clean":"2024-04-25T12:22:45.589398+0000","last_became_active":"2024-04-25T12:21:24.142594+0000","last_became_peered":"2024-04-25T12:21:24.142594+0000","last_unstale":"2024-04-25T12:22:45.589398+0000","last_undegraded":"2024-04-25T12:22:45.589398+0000","last_fullsized":"2024-04-25T12:22:45.589398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:45.589233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:45.589233+0000","last_clean_scrub_stamp":"2024-04-25T12:22:45.589233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:02:27.020455+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'9","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:43.636741+0000","last_change":"2024-04-25T12:22:43.636817+0000","last_active":"2024-04-25T12:22:43.636741+0000","last_peered":"2024-04-25T12:22:43.636741+0000","last_clean":"2024-04-25T12:22:43.636741+0000","last_became_active":"2024-04-25T12:21:23.124836+0000","last_became_peered":"2024-04-25T12:21:23.124836+0000","last_unstale":"2024-04-25T12:22:43.636741+0000","last_undegraded":"2024-04-25T12:22:43.636741+0000","last_fullsized":"2024-04-25T12:22:43.636741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9","last_scrub_stamp":"2024-04-25T12:22:43.636577+0000","last_deep_scrub":"26'9","last_deep_scrub_stamp":"2024-04-25T12:22:43.636577+0000","last_clean_scrub_stamp":"2024-04-25T12:22:43.636577+0000","objects_scrubbed":4,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:09:11.255222+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:48.577911+0000","last_change":"2024-04-25T12:22:48.577969+0000","last_active":"2024-04-25T12:22:48.577911+0000","last_peered":"2024-04-25T12:22:48.577911+0000","last_clean":"2024-04-25T12:22:48.577911+0000","last_became_active":"2024-04-25T12:21:28.193277+0000","last_became_peered":"2024-04-25T12:21:28.193277+0000","last_unstale":"2024-04-25T12:22:48.577911+0000","last_undegraded":"2024-04-25T12:22:48.577911+0000","last_fullsized":"2024-04-25T12:22:48.577911+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:48.577715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:48.577715+0000","last_clean_scrub_stamp":"2024-04-25T12:22:48.577715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:04:13.132465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:44.294893+0000","last_change":"2024-04-25T12:22:44.294946+0000","last_active":"2024-04-25T12:22:44.294893+0000","last_peered":"2024-04-25T12:22:44.294893+0000","last_clean":"2024-04-25T12:22:44.294893+0000","last_became_active":"2024-04-25T12:21:24.114367+0000","last_became_peered":"2024-04-25T12:21:24.114367+0000","last_unstale":"2024-04-25T12:22:44.294893+0000","last_undegraded":"2024-04-25T12:22:44.294893+0000","last_fullsized":"2024-04-25T12:22:44.294893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:44.294718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:44.294718+0000","last_clean_scrub_stamp":"2024-04-25T12:22:44.294718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:49:33.310264+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'6","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:46.908963+0000","last_change":"2024-04-25T12:22:46.909034+0000","last_active":"2024-04-25T12:22:46.908963+0000","last_peered":"2024-04-25T12:22:46.908963+0000","last_clean":"2024-04-25T12:22:46.908963+0000","last_became_active":"2024-04-25T12:21:23.132223+0000","last_became_peered":"2024-04-25T12:21:23.132223+0000","last_unstale":"2024-04-25T12:22:46.908963+0000","last_undegraded":"2024-04-25T12:22:46.908963+0000","last_fullsized":"2024-04-25T12:22:46.908963+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-04-25T12:22:46.908795+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-04-25T12:22:46.908795+0000","last_clean_scrub_stamp":"2024-04-25T12:22:46.908795+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:47:33.375032+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:53.468422+0000","last_change":"2024-04-25T12:22:53.468480+0000","last_active":"2024-04-25T12:22:53.468422+0000","last_peered":"2024-04-25T12:22:53.468422+0000","last_clean":"2024-04-25T12:22:53.468422+0000","last_became_active":"2024-04-25T12:21:28.202800+0000","last_became_peered":"2024-04-25T12:21:28.202800+0000","last_unstale":"2024-04-25T12:22:53.468422+0000","last_undegraded":"2024-04-25T12:22:53.468422+0000","last_fullsized":"2024-04-25T12:22:53.468422+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:53.468247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:53.468247+0000","last_clean_scrub_stamp":"2024-04-25T12:22:53.468247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:56:55.897561+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:48.737762+0000","last_change":"2024-04-25T12:22:48.737859+0000","last_active":"2024-04-25T12:22:48.737762+0000","last_peered":"2024-04-25T12:22:48.737762+0000","last_clean":"2024-04-25T12:22:48.737762+0000","last_became_active":"2024-04-25T12:22:04.921770+0000","last_became_peered":"2024-04-25T12:22:04.921770+0000","last_unstale":"2024-04-25T12:22:48.737762+0000","last_undegraded":"2024-04-25T12:22:48.737762+0000","last_fullsized":"2024-04-25T12:22:48.737762+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:48.737528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:48.737528+0000","last_clean_scrub_stamp":"2024-04-25T12:22:48.737528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:17:15.417072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"26'7","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:43.287635+0000","last_change":"2024-04-25T12:22:43.287762+0000","last_active":"2024-04-25T12:22:43.287635+0000","last_peered":"2024-04-25T12:22:43.287635+0000","last_clean":"2024-04-25T12:22:43.287635+0000","last_became_active":"2024-04-25T12:21:23.129967+0000","last_became_peered":"2024-04-25T12:21:23.129967+0000","last_unstale":"2024-04-25T12:22:43.287635+0000","last_undegraded":"2024-04-25T12:22:43.287635+0000","last_fullsized":"2024-04-25T12:22:43.287635+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-04-25T12:22:43.287430+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-04-25T12:22:43.287430+0000","last_clean_scrub_stamp":"2024-04-25T12:22:43.287430+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:49:39.607710+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:58.571587+0000","last_change":"2024-04-25T12:22:58.571651+0000","last_active":"2024-04-25T12:22:58.571587+0000","last_peered":"2024-04-25T12:22:58.571587+0000","last_clean":"2024-04-25T12:22:58.571587+0000","last_became_active":"2024-04-25T12:21:28.383228+0000","last_became_peered":"2024-04-25T12:21:28.383228+0000","last_unstale":"2024-04-25T12:22:58.571587+0000","last_undegraded":"2024-04-25T12:22:58.571587+0000","last_fullsized":"2024-04-25T12:22:58.571587+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:58.571391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:58.571391+0000","last_clean_scrub_stamp":"2024-04-25T12:22:58.571391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:29:41.403446+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:54.301832+0000","last_change":"2024-04-25T12:22:54.301892+0000","last_active":"2024-04-25T12:22:54.301832+0000","last_peered":"2024-04-25T12:22:54.301832+0000","last_clean":"2024-04-25T12:22:54.301832+0000","last_became_active":"2024-04-25T12:21:28.377742+0000","last_became_peered":"2024-04-25T12:21:28.377742+0000","last_unstale":"2024-04-25T12:22:54.301832+0000","last_undegraded":"2024-04-25T12:22:54.301832+0000","last_fullsized":"2024-04-25T12:22:54.301832+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:54.301655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:54.301655+0000","last_clean_scrub_stamp":"2024-04-25T12:22:54.301655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:44:08.100517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:48.631149+0000","last_change":"2024-04-25T12:22:48.631214+0000","last_active":"2024-04-25T12:22:48.631149+0000","last_peered":"2024-04-25T12:22:48.631149+0000","last_clean":"2024-04-25T12:22:48.631149+0000","last_became_active":"2024-04-25T12:21:24.125448+0000","last_became_peered":"2024-04-25T12:21:24.125448+0000","last_unstale":"2024-04-25T12:22:48.631149+0000","last_undegraded":"2024-04-25T12:22:48.631149+0000","last_fullsized":"2024-04-25T12:22:48.631149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:48.630976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:48.630976+0000","last_clean_scrub_stamp":"2024-04-25T12:22:48.630976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:17:28.649363+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'4","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:44.922249+0000","last_change":"2024-04-25T12:22:44.922314+0000","last_active":"2024-04-25T12:22:44.922249+0000","last_peered":"2024-04-25T12:22:44.922249+0000","last_clean":"2024-04-25T12:22:44.922249+0000","last_became_active":"2024-04-25T12:21:23.115911+0000","last_became_peered":"2024-04-25T12:21:23.115911+0000","last_unstale":"2024-04-25T12:22:44.922249+0000","last_undegraded":"2024-04-25T12:22:44.922249+0000","last_fullsized":"2024-04-25T12:22:44.922249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2024-04-25T12:22:44.922077+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2024-04-25T12:22:44.922077+0000","last_clean_scrub_stamp":"2024-04-25T12:22:44.922077+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:10.783741+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:56.224860+0000","last_change":"2024-04-25T12:22:56.224928+0000","last_active":"2024-04-25T12:22:56.224860+0000","last_peered":"2024-04-25T12:22:56.224860+0000","last_clean":"2024-04-25T12:22:56.224860+0000","last_became_active":"2024-04-25T12:22:04.899300+0000","last_became_peered":"2024-04-25T12:22:04.899300+0000","last_unstale":"2024-04-25T12:22:56.224860+0000","last_undegraded":"2024-04-25T12:22:56.224860+0000","last_fullsized":"2024-04-25T12:22:56.224860+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:56.224662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:56.224662+0000","last_clean_scrub_stamp":"2024-04-25T12:22:56.224662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:31:15.422833+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,0],"acting":[6,5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:41.528318+0000","last_change":"2024-04-25T12:22:41.528337+0000","last_active":"2024-04-25T12:22:41.528318+0000","last_peered":"2024-04-25T12:22:41.528318+0000","last_clean":"2024-04-25T12:22:41.528318+0000","last_became_active":"2024-04-25T12:21:24.137078+0000","last_became_peered":"2024-04-25T12:21:24.137078+0000","last_unstale":"2024-04-25T12:22:41.528318+0000","last_undegraded":"2024-04-25T12:22:41.528318+0000","last_fullsized":"2024-04-25T12:22:41.528318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:41.528245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:41.528245+0000","last_clean_scrub_stamp":"2024-04-25T12:22:41.528245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:38.348046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'5","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:46.615701+0000","last_change":"2024-04-25T12:22:46.615770+0000","last_active":"2024-04-25T12:22:46.615701+0000","last_peered":"2024-04-25T12:22:46.615701+0000","last_clean":"2024-04-25T12:22:46.615701+0000","last_became_active":"2024-04-25T12:21:23.129779+0000","last_became_peered":"2024-04-25T12:21:23.129779+0000","last_unstale":"2024-04-25T12:22:46.615701+0000","last_undegraded":"2024-04-25T12:22:46.615701+0000","last_fullsized":"2024-04-25T12:22:46.615701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-04-25T12:22:46.615541+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-04-25T12:22:46.615541+0000","last_clean_scrub_stamp":"2024-04-25T12:22:46.615541+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:13:06.000377+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'10","reported_seq":45,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:45.294330+0000","last_change":"2024-04-25T12:22:45.294411+0000","last_active":"2024-04-25T12:22:45.294330+0000","last_peered":"2024-04-25T12:22:45.294330+0000","last_clean":"2024-04-25T12:22:45.294330+0000","last_became_active":"2024-04-25T12:21:23.137393+0000","last_became_peered":"2024-04-25T12:21:23.137393+0000","last_unstale":"2024-04-25T12:22:45.294330+0000","last_undegraded":"2024-04-25T12:22:45.294330+0000","last_fullsized":"2024-04-25T12:22:45.294330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'10","last_scrub_stamp":"2024-04-25T12:22:45.294130+0000","last_deep_scrub":"26'10","last_deep_scrub_stamp":"2024-04-25T12:22:45.294130+0000","last_clean_scrub_stamp":"2024-04-25T12:22:45.294130+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:53:45.931622+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:45.337417+0000","last_change":"2024-04-25T12:22:45.337480+0000","last_active":"2024-04-25T12:22:45.337417+0000","last_peered":"2024-04-25T12:22:45.337417+0000","last_clean":"2024-04-25T12:22:45.337417+0000","last_became_active":"2024-04-25T12:21:24.121480+0000","last_became_peered":"2024-04-25T12:21:24.121480+0000","last_unstale":"2024-04-25T12:22:45.337417+0000","last_undegraded":"2024-04-25T12:22:45.337417+0000","last_fullsized":"2024-04-25T12:22:45.337417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:45.337245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:45.337245+0000","last_clean_scrub_stamp":"2024-04-25T12:22:45.337245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:58:53.298839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:46.738864+0000","last_change":"2024-04-25T12:22:46.738928+0000","last_active":"2024-04-25T12:22:46.738864+0000","last_peered":"2024-04-25T12:22:46.738864+0000","last_clean":"2024-04-25T12:22:46.738864+0000","last_became_active":"2024-04-25T12:22:04.900006+0000","last_became_peered":"2024-04-25T12:22:04.900006+0000","last_unstale":"2024-04-25T12:22:46.738864+0000","last_undegraded":"2024-04-25T12:22:46.738864+0000","last_fullsized":"2024-04-25T12:22:46.738864+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:46.738686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:46.738686+0000","last_clean_scrub_stamp":"2024-04-25T12:22:46.738686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:40:14.671005+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,5],"acting":[2,0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'8","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:44.538390+0000","last_change":"2024-04-25T12:22:44.538461+0000","last_active":"2024-04-25T12:22:44.538390+0000","last_peered":"2024-04-25T12:22:44.538390+0000","last_clean":"2024-04-25T12:22:44.538390+0000","last_became_active":"2024-04-25T12:21:23.112721+0000","last_became_peered":"2024-04-25T12:21:23.112721+0000","last_unstale":"2024-04-25T12:22:44.538390+0000","last_undegraded":"2024-04-25T12:22:44.538390+0000","last_fullsized":"2024-04-25T12:22:44.538390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-04-25T12:22:44.538196+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-04-25T12:22:44.538196+0000","last_clean_scrub_stamp":"2024-04-25T12:22:44.538196+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:54:27.496935+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:44.550832+0000","last_change":"2024-04-25T12:22:44.550893+0000","last_active":"2024-04-25T12:22:44.550832+0000","last_peered":"2024-04-25T12:22:44.550832+0000","last_clean":"2024-04-25T12:22:44.550832+0000","last_became_active":"2024-04-25T12:21:24.133493+0000","last_became_peered":"2024-04-25T12:21:24.133493+0000","last_unstale":"2024-04-25T12:22:44.550832+0000","last_undegraded":"2024-04-25T12:22:44.550832+0000","last_fullsized":"2024-04-25T12:22:44.550832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:44.550645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:44.550645+0000","last_clean_scrub_stamp":"2024-04-25T12:22:44.550645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:28.124602+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:59.584674+0000","last_change":"2024-04-25T12:22:59.584741+0000","last_active":"2024-04-25T12:22:59.584674+0000","last_peered":"2024-04-25T12:22:59.584674+0000","last_clean":"2024-04-25T12:22:59.584674+0000","last_became_active":"2024-04-25T12:22:04.895198+0000","last_became_peered":"2024-04-25T12:22:04.895198+0000","last_unstale":"2024-04-25T12:22:59.584674+0000","last_undegraded":"2024-04-25T12:22:59.584674+0000","last_fullsized":"2024-04-25T12:22:59.584674+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:59.584493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:59.584493+0000","last_clean_scrub_stamp":"2024-04-25T12:22:59.584493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:00:09.575898+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,2],"acting":[3,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:50.273511+0000","last_change":"2024-04-25T12:22:50.273620+0000","last_active":"2024-04-25T12:22:50.273511+0000","last_peered":"2024-04-25T12:22:50.273511+0000","last_clean":"2024-04-25T12:22:50.273511+0000","last_became_active":"2024-04-25T12:21:24.125831+0000","last_became_peered":"2024-04-25T12:21:24.125831+0000","last_unstale":"2024-04-25T12:22:50.273511+0000","last_undegraded":"2024-04-25T12:22:50.273511+0000","last_fullsized":"2024-04-25T12:22:50.273511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:50.273277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:50.273277+0000","last_clean_scrub_stamp":"2024-04-25T12:22:50.273277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:22.528596+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:43.749334+0000","last_change":"2024-04-25T12:22:43.749390+0000","last_active":"2024-04-25T12:22:43.749334+0000","last_peered":"2024-04-25T12:22:43.749334+0000","last_clean":"2024-04-25T12:22:43.749334+0000","last_became_active":"2024-04-25T12:21:24.116498+0000","last_became_peered":"2024-04-25T12:21:24.116498+0000","last_unstale":"2024-04-25T12:22:43.749334+0000","last_undegraded":"2024-04-25T12:22:43.749334+0000","last_fullsized":"2024-04-25T12:22:43.749334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:43.749138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:43.749138+0000","last_clean_scrub_stamp":"2024-04-25T12:22:43.749138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:09:38.265708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:49.888242+0000","last_change":"2024-04-25T12:22:49.888296+0000","last_active":"2024-04-25T12:22:49.888242+0000","last_peered":"2024-04-25T12:22:49.888242+0000","last_clean":"2024-04-25T12:22:49.888242+0000","last_became_active":"2024-04-25T12:21:24.114742+0000","last_became_peered":"2024-04-25T12:21:24.114742+0000","last_unstale":"2024-04-25T12:22:49.888242+0000","last_undegraded":"2024-04-25T12:22:49.888242+0000","last_fullsized":"2024-04-25T12:22:49.888242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:49.888062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:49.888062+0000","last_clean_scrub_stamp":"2024-04-25T12:22:49.888062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:22:38.966943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:39.312095+0000","last_change":"2024-04-25T12:22:39.312116+0000","last_active":"2024-04-25T12:22:39.312095+0000","last_peered":"2024-04-25T12:22:39.312095+0000","last_clean":"2024-04-25T12:22:39.312095+0000","last_became_active":"2024-04-25T12:21:24.126476+0000","last_became_peered":"2024-04-25T12:21:24.126476+0000","last_unstale":"2024-04-25T12:22:39.312095+0000","last_undegraded":"2024-04-25T12:22:39.312095+0000","last_fullsized":"2024-04-25T12:22:39.312095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:39.312022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:39.312022+0000","last_clean_scrub_stamp":"2024-04-25T12:22:39.312022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:51:21.997970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:50.466901+0000","last_change":"2024-04-25T12:22:50.466953+0000","last_active":"2024-04-25T12:22:50.466901+0000","last_peered":"2024-04-25T12:22:50.466901+0000","last_clean":"2024-04-25T12:22:50.466901+0000","last_became_active":"2024-04-25T12:21:24.135257+0000","last_became_peered":"2024-04-25T12:21:24.135257+0000","last_unstale":"2024-04-25T12:22:50.466901+0000","last_undegraded":"2024-04-25T12:22:50.466901+0000","last_fullsized":"2024-04-25T12:22:50.466901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:50.466729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:50.466729+0000","last_clean_scrub_stamp":"2024-04-25T12:22:50.466729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:48:55.728765+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:49.608604+0000","last_change":"2024-04-25T12:22:49.608657+0000","last_active":"2024-04-25T12:22:49.608604+0000","last_peered":"2024-04-25T12:22:49.608604+0000","last_clean":"2024-04-25T12:22:49.608604+0000","last_became_active":"2024-04-25T12:21:24.132225+0000","last_became_peered":"2024-04-25T12:21:24.132225+0000","last_unstale":"2024-04-25T12:22:49.608604+0000","last_undegraded":"2024-04-25T12:22:49.608604+0000","last_fullsized":"2024-04-25T12:22:49.608604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:49.608438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:49.608438+0000","last_clean_scrub_stamp":"2024-04-25T12:22:49.608438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:37:28.257485+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:53.250977+0000","last_change":"2024-04-25T12:22:53.251078+0000","last_active":"2024-04-25T12:22:53.250977+0000","last_peered":"2024-04-25T12:22:53.250977+0000","last_clean":"2024-04-25T12:22:53.250977+0000","last_became_active":"2024-04-25T12:21:24.148025+0000","last_became_peered":"2024-04-25T12:21:24.148025+0000","last_unstale":"2024-04-25T12:22:53.250977+0000","last_undegraded":"2024-04-25T12:22:53.250977+0000","last_fullsized":"2024-04-25T12:22:53.250977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:53.250708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:53.250708+0000","last_clean_scrub_stamp":"2024-04-25T12:22:53.250708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:38:22.955695+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:51.490621+0000","last_change":"2024-04-25T12:22:51.490679+0000","last_active":"2024-04-25T12:22:51.490621+0000","last_peered":"2024-04-25T12:22:51.490621+0000","last_clean":"2024-04-25T12:22:51.490621+0000","last_became_active":"2024-04-25T12:21:24.135310+0000","last_became_peered":"2024-04-25T12:21:24.135310+0000","last_unstale":"2024-04-25T12:22:51.490621+0000","last_undegraded":"2024-04-25T12:22:51.490621+0000","last_fullsized":"2024-04-25T12:22:51.490621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:51.490395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:51.490395+0000","last_clean_scrub_stamp":"2024-04-25T12:22:51.490395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:48:50.493825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:41.917893+0000","last_change":"2024-04-25T12:22:41.917946+0000","last_active":"2024-04-25T12:22:41.917893+0000","last_peered":"2024-04-25T12:22:41.917893+0000","last_clean":"2024-04-25T12:22:41.917893+0000","last_became_active":"2024-04-25T12:21:24.112992+0000","last_became_peered":"2024-04-25T12:21:24.112992+0000","last_unstale":"2024-04-25T12:22:41.917893+0000","last_undegraded":"2024-04-25T12:22:41.917893+0000","last_fullsized":"2024-04-25T12:22:41.917893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:41.917701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:41.917701+0000","last_clean_scrub_stamp":"2024-04-25T12:22:41.917701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:24.707441+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:47.570465+0000","last_change":"2024-04-25T12:22:47.570518+0000","last_active":"2024-04-25T12:22:47.570465+0000","last_peered":"2024-04-25T12:22:47.570465+0000","last_clean":"2024-04-25T12:22:47.570465+0000","last_became_active":"2024-04-25T12:21:24.117412+0000","last_became_peered":"2024-04-25T12:21:24.117412+0000","last_unstale":"2024-04-25T12:22:47.570465+0000","last_undegraded":"2024-04-25T12:22:47.570465+0000","last_fullsized":"2024-04-25T12:22:47.570465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:47.570276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:47.570276+0000","last_clean_scrub_stamp":"2024-04-25T12:22:47.570276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:56:48.278054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:54.991323+0000","last_change":"2024-04-25T12:22:54.991377+0000","last_active":"2024-04-25T12:22:54.991323+0000","last_peered":"2024-04-25T12:22:54.991323+0000","last_clean":"2024-04-25T12:22:54.991323+0000","last_became_active":"2024-04-25T12:21:24.137937+0000","last_became_peered":"2024-04-25T12:21:24.137937+0000","last_unstale":"2024-04-25T12:22:54.991323+0000","last_undegraded":"2024-04-25T12:22:54.991323+0000","last_fullsized":"2024-04-25T12:22:54.991323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:54.991141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:54.991141+0000","last_clean_scrub_stamp":"2024-04-25T12:22:54.991141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:33:22.660757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:48.399193+0000","last_change":"2024-04-25T12:22:48.399247+0000","last_active":"2024-04-25T12:22:48.399193+0000","last_peered":"2024-04-25T12:22:48.399193+0000","last_clean":"2024-04-25T12:22:48.399193+0000","last_became_active":"2024-04-25T12:21:24.137431+0000","last_became_peered":"2024-04-25T12:21:24.137431+0000","last_unstale":"2024-04-25T12:22:48.399193+0000","last_undegraded":"2024-04-25T12:22:48.399193+0000","last_fullsized":"2024-04-25T12:22:48.399193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:48.399017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:48.399017+0000","last_clean_scrub_stamp":"2024-04-25T12:22:48.399017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:46:28.074342+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:52.250356+0000","last_change":"2024-04-25T12:22:52.250408+0000","last_active":"2024-04-25T12:22:52.250356+0000","last_peered":"2024-04-25T12:22:52.250356+0000","last_clean":"2024-04-25T12:22:52.250356+0000","last_became_active":"2024-04-25T12:21:24.128125+0000","last_became_peered":"2024-04-25T12:21:24.128125+0000","last_unstale":"2024-04-25T12:22:52.250356+0000","last_undegraded":"2024-04-25T12:22:52.250356+0000","last_fullsized":"2024-04-25T12:22:52.250356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:52.250178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:52.250178+0000","last_clean_scrub_stamp":"2024-04-25T12:22:52.250178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:23:59.580098+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:58.840704+0000","last_change":"2024-04-25T12:22:58.840760+0000","last_active":"2024-04-25T12:22:58.840704+0000","last_peered":"2024-04-25T12:22:58.840704+0000","last_clean":"2024-04-25T12:22:58.840704+0000","last_became_active":"2024-04-25T12:21:24.147230+0000","last_became_peered":"2024-04-25T12:21:24.147230+0000","last_unstale":"2024-04-25T12:22:58.840704+0000","last_undegraded":"2024-04-25T12:22:58.840704+0000","last_fullsized":"2024-04-25T12:22:58.840704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:58.840525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:58.840525+0000","last_clean_scrub_stamp":"2024-04-25T12:22:58.840525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:02:01.670657+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:44.757430+0000","last_change":"2024-04-25T12:22:44.757488+0000","last_active":"2024-04-25T12:22:44.757430+0000","last_peered":"2024-04-25T12:22:44.757430+0000","last_clean":"2024-04-25T12:22:44.757430+0000","last_became_active":"2024-04-25T12:21:24.118761+0000","last_became_peered":"2024-04-25T12:21:24.118761+0000","last_unstale":"2024-04-25T12:22:44.757430+0000","last_undegraded":"2024-04-25T12:22:44.757430+0000","last_fullsized":"2024-04-25T12:22:44.757430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:44.757254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:44.757254+0000","last_clean_scrub_stamp":"2024-04-25T12:22:44.757254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:13:14.408951+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:55.955032+0000","last_change":"2024-04-25T12:22:55.955084+0000","last_active":"2024-04-25T12:22:55.955032+0000","last_peered":"2024-04-25T12:22:55.955032+0000","last_clean":"2024-04-25T12:22:55.955032+0000","last_became_active":"2024-04-25T12:21:24.143786+0000","last_became_peered":"2024-04-25T12:21:24.143786+0000","last_unstale":"2024-04-25T12:22:55.955032+0000","last_undegraded":"2024-04-25T12:22:55.955032+0000","last_fullsized":"2024-04-25T12:22:55.955032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:55.954859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:55.954859+0000","last_clean_scrub_stamp":"2024-04-25T12:22:55.954859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:26:34.758073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:47.871958+0000","last_change":"2024-04-25T12:22:47.872009+0000","last_active":"2024-04-25T12:22:47.871958+0000","last_peered":"2024-04-25T12:22:47.871958+0000","last_clean":"2024-04-25T12:22:47.871958+0000","last_became_active":"2024-04-25T12:21:24.106818+0000","last_became_peered":"2024-04-25T12:21:24.106818+0000","last_unstale":"2024-04-25T12:22:47.871958+0000","last_undegraded":"2024-04-25T12:22:47.871958+0000","last_fullsized":"2024-04-25T12:22:47.871958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:47.871786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:47.871786+0000","last_clean_scrub_stamp":"2024-04-25T12:22:47.871786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:46:10.598717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:39.601413+0000","last_change":"2024-04-25T12:22:39.601443+0000","last_active":"2024-04-25T12:22:39.601413+0000","last_peered":"2024-04-25T12:22:39.601413+0000","last_clean":"2024-04-25T12:22:39.601413+0000","last_became_active":"2024-04-25T12:21:24.114237+0000","last_became_peered":"2024-04-25T12:21:24.114237+0000","last_unstale":"2024-04-25T12:22:39.601413+0000","last_undegraded":"2024-04-25T12:22:39.601413+0000","last_fullsized":"2024-04-25T12:22:39.601413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:39.601308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:39.601308+0000","last_clean_scrub_stamp":"2024-04-25T12:22:39.601308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:19:29.408055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:46.379532+0000","last_change":"2024-04-25T12:22:46.379584+0000","last_active":"2024-04-25T12:22:46.379532+0000","last_peered":"2024-04-25T12:22:46.379532+0000","last_clean":"2024-04-25T12:22:46.379532+0000","last_became_active":"2024-04-25T12:21:24.132094+0000","last_became_peered":"2024-04-25T12:21:24.132094+0000","last_unstale":"2024-04-25T12:22:46.379532+0000","last_undegraded":"2024-04-25T12:22:46.379532+0000","last_fullsized":"2024-04-25T12:22:46.379532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:46.379355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:46.379355+0000","last_clean_scrub_stamp":"2024-04-25T12:22:46.379355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:06:59.865601+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:45.712738+0000","last_change":"2024-04-25T12:22:45.712794+0000","last_active":"2024-04-25T12:22:45.712738+0000","last_peered":"2024-04-25T12:22:45.712738+0000","last_clean":"2024-04-25T12:22:45.712738+0000","last_became_active":"2024-04-25T12:22:04.896529+0000","last_became_peered":"2024-04-25T12:22:04.896529+0000","last_unstale":"2024-04-25T12:22:45.712738+0000","last_undegraded":"2024-04-25T12:22:45.712738+0000","last_fullsized":"2024-04-25T12:22:45.712738+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:45.712571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:45.712571+0000","last_clean_scrub_stamp":"2024-04-25T12:22:45.712571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:00:51.963656+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:41.499727+0000","last_change":"2024-04-25T12:22:41.499778+0000","last_active":"2024-04-25T12:22:41.499727+0000","last_peered":"2024-04-25T12:22:41.499727+0000","last_clean":"2024-04-25T12:22:41.499727+0000","last_became_active":"2024-04-25T12:21:24.116973+0000","last_became_peered":"2024-04-25T12:21:24.116973+0000","last_unstale":"2024-04-25T12:22:41.499727+0000","last_undegraded":"2024-04-25T12:22:41.499727+0000","last_fullsized":"2024-04-25T12:22:41.499727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:41.499543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:41.499543+0000","last_clean_scrub_stamp":"2024-04-25T12:22:41.499543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:42.552692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:47.293315+0000","last_change":"2024-04-25T12:22:47.293370+0000","last_active":"2024-04-25T12:22:47.293315+0000","last_peered":"2024-04-25T12:22:47.293315+0000","last_clean":"2024-04-25T12:22:47.293315+0000","last_became_active":"2024-04-25T12:21:24.114829+0000","last_became_peered":"2024-04-25T12:21:24.114829+0000","last_unstale":"2024-04-25T12:22:47.293315+0000","last_undegraded":"2024-04-25T12:22:47.293315+0000","last_fullsized":"2024-04-25T12:22:47.293315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:47.293125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:47.293125+0000","last_clean_scrub_stamp":"2024-04-25T12:22:47.293125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:25.590252+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:48.258055+0000","last_change":"2024-04-25T12:22:48.258108+0000","last_active":"2024-04-25T12:22:48.258055+0000","last_peered":"2024-04-25T12:22:48.258055+0000","last_clean":"2024-04-25T12:22:48.258055+0000","last_became_active":"2024-04-25T12:21:24.116359+0000","last_became_peered":"2024-04-25T12:21:24.116359+0000","last_unstale":"2024-04-25T12:22:48.258055+0000","last_undegraded":"2024-04-25T12:22:48.258055+0000","last_fullsized":"2024-04-25T12:22:48.258055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:48.257870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:48.257870+0000","last_clean_scrub_stamp":"2024-04-25T12:22:48.257870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:33.003708+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:53.735915+0000","last_change":"2024-04-25T12:22:53.735969+0000","last_active":"2024-04-25T12:22:53.735915+0000","last_peered":"2024-04-25T12:22:53.735915+0000","last_clean":"2024-04-25T12:22:53.735915+0000","last_became_active":"2024-04-25T12:21:24.142353+0000","last_became_peered":"2024-04-25T12:21:24.142353+0000","last_unstale":"2024-04-25T12:22:53.735915+0000","last_undegraded":"2024-04-25T12:22:53.735915+0000","last_fullsized":"2024-04-25T12:22:53.735915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:53.735744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:53.735744+0000","last_clean_scrub_stamp":"2024-04-25T12:22:53.735744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:13:31.630981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:49.507812+0000","last_change":"2024-04-25T12:22:49.507868+0000","last_active":"2024-04-25T12:22:49.507812+0000","last_peered":"2024-04-25T12:22:49.507812+0000","last_clean":"2024-04-25T12:22:49.507812+0000","last_became_active":"2024-04-25T12:21:24.127315+0000","last_became_peered":"2024-04-25T12:21:24.127315+0000","last_unstale":"2024-04-25T12:22:49.507812+0000","last_undegraded":"2024-04-25T12:22:49.507812+0000","last_fullsized":"2024-04-25T12:22:49.507812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:49.507632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:49.507632+0000","last_clean_scrub_stamp":"2024-04-25T12:22:49.507632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:10.218511+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:50.756320+0000","last_change":"2024-04-25T12:22:50.756372+0000","last_active":"2024-04-25T12:22:50.756320+0000","last_peered":"2024-04-25T12:22:50.756320+0000","last_clean":"2024-04-25T12:22:50.756320+0000","last_became_active":"2024-04-25T12:21:24.142029+0000","last_became_peered":"2024-04-25T12:21:24.142029+0000","last_unstale":"2024-04-25T12:22:50.756320+0000","last_undegraded":"2024-04-25T12:22:50.756320+0000","last_fullsized":"2024-04-25T12:22:50.756320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:50.756116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:50.756116+0000","last_clean_scrub_stamp":"2024-04-25T12:22:50.756116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:02.121258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:48.892661+0000","last_change":"2024-04-25T12:22:48.892713+0000","last_active":"2024-04-25T12:22:48.892661+0000","last_peered":"2024-04-25T12:22:48.892661+0000","last_clean":"2024-04-25T12:22:48.892661+0000","last_became_active":"2024-04-25T12:21:24.112339+0000","last_became_peered":"2024-04-25T12:21:24.112339+0000","last_unstale":"2024-04-25T12:22:48.892661+0000","last_undegraded":"2024-04-25T12:22:48.892661+0000","last_fullsized":"2024-04-25T12:22:48.892661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:48.892484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:48.892484+0000","last_clean_scrub_stamp":"2024-04-25T12:22:48.892484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:23:35.476381+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:51.755388+0000","last_change":"2024-04-25T12:22:51.755441+0000","last_active":"2024-04-25T12:22:51.755388+0000","last_peered":"2024-04-25T12:22:51.755388+0000","last_clean":"2024-04-25T12:22:51.755388+0000","last_became_active":"2024-04-25T12:21:24.142422+0000","last_became_peered":"2024-04-25T12:21:24.142422+0000","last_unstale":"2024-04-25T12:22:51.755388+0000","last_undegraded":"2024-04-25T12:22:51.755388+0000","last_fullsized":"2024-04-25T12:22:51.755388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:51.755212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:51.755212+0000","last_clean_scrub_stamp":"2024-04-25T12:22:51.755212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:24:12.450196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:53.956434+0000","last_change":"2024-04-25T12:22:53.956489+0000","last_active":"2024-04-25T12:22:53.956434+0000","last_peered":"2024-04-25T12:22:53.956434+0000","last_clean":"2024-04-25T12:22:53.956434+0000","last_became_active":"2024-04-25T12:21:24.131746+0000","last_became_peered":"2024-04-25T12:21:24.131746+0000","last_unstale":"2024-04-25T12:22:53.956434+0000","last_undegraded":"2024-04-25T12:22:53.956434+0000","last_fullsized":"2024-04-25T12:22:53.956434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:53.956223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:53.956223+0000","last_clean_scrub_stamp":"2024-04-25T12:22:53.956223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:26:56.168126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:43.280979+0000","last_change":"2024-04-25T12:22:43.281032+0000","last_active":"2024-04-25T12:22:43.280979+0000","last_peered":"2024-04-25T12:22:43.280979+0000","last_clean":"2024-04-25T12:22:43.280979+0000","last_became_active":"2024-04-25T12:21:24.111154+0000","last_became_peered":"2024-04-25T12:21:24.111154+0000","last_unstale":"2024-04-25T12:22:43.280979+0000","last_undegraded":"2024-04-25T12:22:43.280979+0000","last_fullsized":"2024-04-25T12:22:43.280979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:43.280798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:43.280798+0000","last_clean_scrub_stamp":"2024-04-25T12:22:43.280798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:14:23.899323+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:50.611352+0000","last_change":"2024-04-25T12:22:50.611413+0000","last_active":"2024-04-25T12:22:50.611352+0000","last_peered":"2024-04-25T12:22:50.611352+0000","last_clean":"2024-04-25T12:22:50.611352+0000","last_became_active":"2024-04-25T12:21:24.133839+0000","last_became_peered":"2024-04-25T12:21:24.133839+0000","last_unstale":"2024-04-25T12:22:50.611352+0000","last_undegraded":"2024-04-25T12:22:50.611352+0000","last_fullsized":"2024-04-25T12:22:50.611352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:50.611146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:50.611146+0000","last_clean_scrub_stamp":"2024-04-25T12:22:50.611146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:12.272952+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T12:22:57.855356+0000","last_change":"2024-04-25T12:22:57.855410+0000","last_active":"2024-04-25T12:22:57.855356+0000","last_peered":"2024-04-25T12:22:57.855356+0000","last_clean":"2024-04-25T12:22:57.855356+0000","last_became_active":"2024-04-25T12:21:24.146805+0000","last_became_peered":"2024-04-25T12:21:24.146805+0000","last_unstale":"2024-04-25T12:22:57.855356+0000","last_undegraded":"2024-04-25T12:22:57.855356+0000","last_fullsized":"2024-04-25T12:22:57.855356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:22:57.855122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:22:57.855122+0000","last_clean_scrub_stamp":"2024-04-25T12:22:57.855122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:57:39.055313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":12592,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":25184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":272,"ondisk_log_size":272,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32064,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339776,"statfs":{"total":96636764160,"available":96603930624,"internally_reserved":0,"allocated":909312,"data_stored":707411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":120157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":327680,"data_stored":118875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":116273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":120191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":116405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":115893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":901120,"data_stored":705603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":5796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T12:23:22.861 DEBUG:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-25T12:23:23.006 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.001+0000 7f5317871640 1 Processor -- start 2024-04-25T12:23:23.006 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.001+0000 7f5317871640 1 -- start start 2024-04-25T12:23:23.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.005+0000 7f5317871640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f53100c8250 0x7f53100c39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:23:23.008 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.005+0000 7f5317871640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f531015b740 con 0x7f53100c8630 2024-04-25T12:23:23.008 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.005+0000 7f5317871640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53100c58c0 con 0x7f53100c8a70 2024-04-25T12:23:23.008 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.005+0000 7f5317871640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f53100c6490 con 0x7f53100c8250 2024-04-25T12:23:23.008 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.005+0000 7f531560d640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f53100c8250 0x7f53100c39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:23:23.008 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.005+0000 7f5314e0c640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f53100c8630 0x7f5310151b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:60042/0 (socket says 172.21.15.86:60042) 2024-04-25T12:23:23.008 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.005+0000 7f5314e0c640 1 -- 172.21.15.86:0/287022904 learned_addr learned my addr 172.21.15.86:0/287022904 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-04-25T12:23:23.008 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.005+0000 7f531560d640 1 -- 172.21.15.86:0/287022904 >> v1:172.21.15.134:6789/0 conn(0x7f53100c8a70 legacy=0x7f5310162790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:23:23.008 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.005+0000 7f531560d640 1 -- 172.21.15.86:0/287022904 >> v1:172.21.15.86:6789/0 conn(0x7f53100c8630 legacy=0x7f5310151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:23:23.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.005+0000 7f5307fff640 1 -- 172.21.15.86:0/287022904 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2461658226 0 0) 0x7f531015b740 con 0x7f53100c8630 2024-04-25T12:23:23.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.005+0000 7f531560d640 1 -- 172.21.15.86:0/287022904 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53100c5b60 con 0x7f53100c8250 2024-04-25T12:23:23.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.005+0000 7f531560d640 1 --2- 172.21.15.86:0/287022904 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f53100c8250 0x7f53100c39e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f53100c8f40 tx=0x7f530c01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d84800bf5d4e00d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:23:23.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.005+0000 7f5307fff640 1 -- 172.21.15.86:0/287022904 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f530c0b0070 con 0x7f53100c8250 2024-04-25T12:23:23.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.005+0000 7f5307fff640 1 -- 172.21.15.86:0/287022904 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f530c0ab600 con 0x7f53100c8250 2024-04-25T12:23:23.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.005+0000 7f5307fff640 1 -- 172.21.15.86:0/287022904 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f530c0a4e60 con 0x7f53100c8250 2024-04-25T12:23:23.011 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.009+0000 7f5317871640 1 -- 172.21.15.86:0/287022904 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f53100c8250 msgr2=0x7f53100c39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:23:23.011 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.009+0000 7f5317871640 1 --2- 172.21.15.86:0/287022904 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f53100c8250 0x7f53100c39e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f53100c8f40 tx=0x7f530c01c3d0 comp rx=0 tx=0).stop 2024-04-25T12:23:23.011 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.009+0000 7f5317871640 1 -- 172.21.15.86:0/287022904 shutdown_connections 2024-04-25T12:23:23.011 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.009+0000 7f5317871640 1 --2- 172.21.15.86:0/287022904 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f53100c8250 0x7f53100c39e0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:23.011 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.009+0000 7f5317871640 1 -- 172.21.15.86:0/287022904 >> 172.21.15.86:0/287022904 conn(0x7f531006b9d0 msgr2=0x7f531006bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:23:23.011 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.009+0000 7f5317871640 1 -- 172.21.15.86:0/287022904 shutdown_connections 2024-04-25T12:23:23.011 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.009+0000 7f5317871640 1 -- 172.21.15.86:0/287022904 wait complete. 2024-04-25T12:23:23.012 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.009+0000 7f5317871640 1 Processor -- start 2024-04-25T12:23:23.012 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.009+0000 7f5317871640 1 -- start start 2024-04-25T12:23:23.014 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.009+0000 7f5317871640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f53100c8250 0x7f53100c7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:23:23.014 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.009+0000 7f5317871640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53100c8630 0x7f531013af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:23:23.014 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.009+0000 7f5317871640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f53100c8a70 0x7f531013a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:23:23.015 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.009+0000 7f5317871640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f53100c6920 con 0x7f53100c8a70 2024-04-25T12:23:23.015 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.009+0000 7f5317871640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f531015b400 con 0x7f53100c8630 2024-04-25T12:23:23.015 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.009+0000 7f5317871640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f53100681d0 con 0x7f53100c8250 2024-04-25T12:23:23.015 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.009+0000 7f5315e0e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f53100c8a70 0x7f531013a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:23:23.015 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.009+0000 7f5315e0e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f53100c8a70 0x7f531013a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38292/0 (socket says 172.21.15.86:38292) 2024-04-25T12:23:23.015 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.009+0000 7f5315e0e640 1 -- 172.21.15.86:0/163740223 learned_addr learned my addr 172.21.15.86:0/163740223 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:23:23.015 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.009+0000 7f531560d640 1 --2- 172.21.15.86:0/163740223 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f53100c8250 0x7f53100c7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:23:23.015 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.009+0000 7f5314e0c640 1 --2- 172.21.15.86:0/163740223 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53100c8630 0x7f531013af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:23:23.015 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.009+0000 7f5315e0e640 1 -- 172.21.15.86:0/163740223 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f53100c8250 msgr2=0x7f53100c7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:23:23.016 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.009+0000 7f5315e0e640 1 --2- 172.21.15.86:0/163740223 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f53100c8250 0x7f53100c7140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:23.016 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.009+0000 7f5315e0e640 1 -- 172.21.15.86:0/163740223 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53100c8630 msgr2=0x7f531013af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:23:23.016 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.009+0000 7f5315e0e640 1 --2- 172.21.15.86:0/163740223 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53100c8630 0x7f531013af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:23.016 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.009+0000 7f5315e0e640 1 -- 172.21.15.86:0/163740223 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f531013b8a0 con 0x7f53100c8a70 2024-04-25T12:23:23.016 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.009+0000 7f5315e0e640 1 --2- 172.21.15.86:0/163740223 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f53100c8a70 0x7f531013a480 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f530800b990 tx=0x7f530800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:23:23.016 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.009+0000 7f5305ffb640 1 -- 172.21.15.86:0/163740223 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5308019070 con 0x7f53100c8a70 2024-04-25T12:23:23.016 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.009+0000 7f5305ffb640 1 -- 172.21.15.86:0/163740223 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f530800cb40 con 0x7f53100c8a70 2024-04-25T12:23:23.016 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.009+0000 7f5317871640 1 -- 172.21.15.86:0/163740223 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53101f58a0 con 0x7f53100c8a70 2024-04-25T12:23:23.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.009+0000 7f5305ffb640 1 -- 172.21.15.86:0/163740223 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5308014440 con 0x7f53100c8a70 2024-04-25T12:23:23.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.009+0000 7f5317871640 1 -- 172.21.15.86:0/163740223 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53101f5e60 con 0x7f53100c8a70 2024-04-25T12:23:23.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.009+0000 7f5317871640 1 -- 172.21.15.86:0/163740223 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5310075df0 con 0x7f53100c8a70 2024-04-25T12:23:23.018 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.013+0000 7f5305ffb640 1 -- 172.21.15.86:0/163740223 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f530801c070 con 0x7f53100c8a70 2024-04-25T12:23:23.018 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.013+0000 7f5305ffb640 1 --2- 172.21.15.86:0/163740223 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f52f4068380 0x7f52f406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:23:23.018 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.013+0000 7f531560d640 1 --2- 172.21.15.86:0/163740223 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f52f4068380 0x7f52f406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:23:23.018 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.013+0000 7f5305ffb640 1 -- 172.21.15.86:0/163740223 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f5308086ba0 con 0x7f53100c8a70 2024-04-25T12:23:23.018 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.013+0000 7f531560d640 1 --2- 172.21.15.86:0/163740223 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f52f4068380 0x7f52f406a840 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f530c0ad000 tx=0x7f530c0a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:23:23.020 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.017+0000 7f5305ffb640 1 -- 172.21.15.86:0/163740223 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5308056cd0 con 0x7f53100c8a70 2024-04-25T12:23:23.172 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T12:23:23.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.169+0000 7f5317871640 1 -- 172.21.15.86:0/163740223 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f5310071e50 con 0x7f53100c8a70 2024-04-25T12:23:23.174 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T12:23:23.178 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.173+0000 7f5305ffb640 1 -- 172.21.15.86:0/163740223 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) ==== 123+0+0 (secure 0 0 0) 0x7f53080565d0 con 0x7f53100c8a70 2024-04-25T12:23:23.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.177+0000 7f5305ffb640 1 -- 172.21.15.86:0/163740223 <== mon.0 v2:172.21.15.86:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f530805a980 con 0x7f53100c8a70 2024-04-25T12:23:23.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.177+0000 7f5317871640 1 -- 172.21.15.86:0/163740223 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f52f4068380 msgr2=0x7f52f406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:23:23.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.177+0000 7f5317871640 1 --2- 172.21.15.86:0/163740223 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f52f4068380 0x7f52f406a840 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f530c0ad000 tx=0x7f530c0a6000 comp rx=0 tx=0).stop 2024-04-25T12:23:23.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.177+0000 7f5317871640 1 -- 172.21.15.86:0/163740223 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f53100c8a70 msgr2=0x7f531013a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:23:23.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.177+0000 7f5317871640 1 --2- 172.21.15.86:0/163740223 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f53100c8a70 0x7f531013a480 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f530800b990 tx=0x7f530800be50 comp rx=0 tx=0).stop 2024-04-25T12:23:23.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.177+0000 7f5317871640 1 -- 172.21.15.86:0/163740223 shutdown_connections 2024-04-25T12:23:23.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.177+0000 7f5317871640 1 --2- 172.21.15.86:0/163740223 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f52f4068380 0x7f52f406a840 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:23.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.177+0000 7f5317871640 1 --2- 172.21.15.86:0/163740223 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f53100c8a70 0x7f531013a480 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:23.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.177+0000 7f5317871640 1 --2- 172.21.15.86:0/163740223 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53100c8630 0x7f531013af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:23.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.177+0000 7f5317871640 1 --2- 172.21.15.86:0/163740223 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f53100c8250 0x7f53100c7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:23.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.177+0000 7f5317871640 1 -- 172.21.15.86:0/163740223 >> 172.21.15.86:0/163740223 conn(0x7f531006b9d0 msgr2=0x7f531014cc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:23:23.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.177+0000 7f5317871640 1 -- 172.21.15.86:0/163740223 shutdown_connections 2024-04-25T12:23:23.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.177+0000 7f5317871640 1 -- 172.21.15.86:0/163740223 wait complete. 2024-04-25T12:23:23.199 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T12:23:23.200 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T12:23:23.359 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.357+0000 7f1b35e36640 1 Processor -- start 2024-04-25T12:23:23.359 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.357+0000 7f1b35e36640 1 -- start start 2024-04-25T12:23:23.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.357+0000 7f1b35e36640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f1b300c8250 0x7f1b300c39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:23:23.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.357+0000 7f1b35e36640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1b300c8630 0x7f1b30151b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:23:23.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.357+0000 7f1b35e36640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b3015b740 con 0x7f1b300c8a70 2024-04-25T12:23:23.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.357+0000 7f1b35e36640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f1b300c6490 con 0x7f1b300c8250 2024-04-25T12:23:23.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.357+0000 7f1b35e36640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f1b300c58c0 con 0x7f1b300c8630 2024-04-25T12:23:23.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.357+0000 7f1b2f7fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f1b300c8250 0x7f1b300c39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:23:23.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.357+0000 7f1b2effd640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1b300c8630 0x7f1b30151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:23:23.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.357+0000 7f1b2effd640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1b300c8630 0x7f1b30151b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.86:51596/0 (socket says 172.21.15.86:51596) 2024-04-25T12:23:23.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.357+0000 7f1b2ffff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f1b300c8a70 0x7f1b30152080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.86:40804/0 (socket says 172.21.15.86:40804) 2024-04-25T12:23:23.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.357+0000 7f1b2effd640 1 -- 172.21.15.86:0/1292618177 learned_addr learned my addr 172.21.15.86:0/1292618177 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:23:23.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.357+0000 7f1b2effd640 1 -- 172.21.15.86:0/1292618177 >> v2:172.21.15.134:3300/0 conn(0x7f1b300c8250 msgr2=0x7f1b300c39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:23:23.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.357+0000 7f1b2effd640 1 --2- 172.21.15.86:0/1292618177 >> v2:172.21.15.134:3300/0 conn(0x7f1b300c8250 0x7f1b300c39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:23.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.357+0000 7f1b2effd640 1 -- 172.21.15.86:0/1292618177 >> v1:172.21.15.134:6789/0 conn(0x7f1b300c8a70 legacy=0x7f1b30152080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:23:23.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.357+0000 7f1b2effd640 1 -- 172.21.15.86:0/1292618177 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b300c5b60 con 0x7f1b300c8630 2024-04-25T12:23:23.363 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.361+0000 7f1b2effd640 1 --2- 172.21.15.86:0/1292618177 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1b300c8630 0x7f1b30151b40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1b180098a0 tx=0x7f1b1801c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=472bfcc41510ac42 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:23:23.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.361+0000 7f1b2e7fc640 1 -- 172.21.15.86:0/1292618177 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b180b1070 con 0x7f1b300c8630 2024-04-25T12:23:23.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.361+0000 7f1b2e7fc640 1 -- 172.21.15.86:0/1292618177 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f1b180ac600 con 0x7f1b300c8630 2024-04-25T12:23:23.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.361+0000 7f1b2e7fc640 1 -- 172.21.15.86:0/1292618177 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b180ac9f0 con 0x7f1b300c8630 2024-04-25T12:23:23.365 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.361+0000 7f1b35e36640 1 -- 172.21.15.86:0/1292618177 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1b300c8630 msgr2=0x7f1b30151b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:23:23.365 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.361+0000 7f1b35e36640 1 --2- 172.21.15.86:0/1292618177 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1b300c8630 0x7f1b30151b40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1b180098a0 tx=0x7f1b1801c4b0 comp rx=0 tx=0).stop 2024-04-25T12:23:23.365 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.361+0000 7f1b35e36640 1 -- 172.21.15.86:0/1292618177 shutdown_connections 2024-04-25T12:23:23.365 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.361+0000 7f1b35e36640 1 --2- 172.21.15.86:0/1292618177 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1b300c8630 0x7f1b30151b40 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:23.365 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.361+0000 7f1b35e36640 1 --2- 172.21.15.86:0/1292618177 >> v2:172.21.15.134:3300/0 conn(0x7f1b300c8250 0x7f1b300c39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:23.365 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.361+0000 7f1b35e36640 1 -- 172.21.15.86:0/1292618177 >> 172.21.15.86:0/1292618177 conn(0x7f1b3006b9d0 msgr2=0x7f1b3006bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:23:23.366 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.361+0000 7f1b35e36640 1 -- 172.21.15.86:0/1292618177 shutdown_connections 2024-04-25T12:23:23.366 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.361+0000 7f1b35e36640 1 -- 172.21.15.86:0/1292618177 wait complete. 2024-04-25T12:23:23.368 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.361+0000 7f1b35e36640 1 Processor -- start 2024-04-25T12:23:23.368 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.361+0000 7f1b35e36640 1 -- start start 2024-04-25T12:23:23.368 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.361+0000 7f1b35e36640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b300c8250 0x7f1b301f58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:23:23.368 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.361+0000 7f1b35e36640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1b300c8630 0x7f1b300c7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:23:23.368 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.361+0000 7f1b35e36640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b300c8a70 0x7f1b30154dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:23:23.368 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.361+0000 7f1b35e36640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1b300c6900 con 0x7f1b300c8a70 2024-04-25T12:23:23.369 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.361+0000 7f1b35e36640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1b3015b400 con 0x7f1b300c8250 2024-04-25T12:23:23.369 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.361+0000 7f1b35e36640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f1b300681d0 con 0x7f1b300c8630 2024-04-25T12:23:23.369 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.365+0000 7f1b2ffff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b300c8a70 0x7f1b30154dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:23:23.369 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.365+0000 7f1b2ffff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b300c8a70 0x7f1b30154dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38300/0 (socket says 172.21.15.86:38300) 2024-04-25T12:23:23.369 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.365+0000 7f1b2ffff640 1 -- 172.21.15.86:0/1949270584 learned_addr learned my addr 172.21.15.86:0/1949270584 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:23:23.369 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.365+0000 7f1b2f7fe640 1 --2- 172.21.15.86:0/1949270584 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b300c8250 0x7f1b301f58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:23:23.369 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.365+0000 7f1b2effd640 1 --2- 172.21.15.86:0/1949270584 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1b300c8630 0x7f1b300c7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:23:23.369 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.365+0000 7f1b2ffff640 1 -- 172.21.15.86:0/1949270584 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1b300c8630 msgr2=0x7f1b300c7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:23:23.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.365+0000 7f1b2ffff640 1 --2- 172.21.15.86:0/1949270584 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1b300c8630 0x7f1b300c7140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:23.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.365+0000 7f1b2ffff640 1 -- 172.21.15.86:0/1949270584 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b300c8250 msgr2=0x7f1b301f58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:23:23.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.365+0000 7f1b2ffff640 1 --2- 172.21.15.86:0/1949270584 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b300c8250 0x7f1b301f58f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:23.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.365+0000 7f1b2ffff640 1 -- 172.21.15.86:0/1949270584 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b301583c0 con 0x7f1b300c8a70 2024-04-25T12:23:23.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.365+0000 7f1b2ffff640 1 --2- 172.21.15.86:0/1949270584 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b300c8a70 0x7f1b30154dd0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f1b2000c730 tx=0x7f1b2000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:23:23.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.365+0000 7f1b27fff640 1 -- 172.21.15.86:0/1949270584 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b20017070 con 0x7f1b300c8a70 2024-04-25T12:23:23.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.365+0000 7f1b27fff640 1 -- 172.21.15.86:0/1949270584 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f1b2000ce40 con 0x7f1b300c8a70 2024-04-25T12:23:23.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.365+0000 7f1b35e36640 1 -- 172.21.15.86:0/1949270584 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b301586a0 con 0x7f1b300c8a70 2024-04-25T12:23:23.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.365+0000 7f1b27fff640 1 -- 172.21.15.86:0/1949270584 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b2000a860 con 0x7f1b300c8a70 2024-04-25T12:23:23.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.365+0000 7f1b35e36640 1 -- 172.21.15.86:0/1949270584 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b301548b0 con 0x7f1b300c8a70 2024-04-25T12:23:23.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.365+0000 7f1b35e36640 1 -- 172.21.15.86:0/1949270584 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b30075df0 con 0x7f1b300c8a70 2024-04-25T12:23:23.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.365+0000 7f1b27fff640 1 -- 172.21.15.86:0/1949270584 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1b2001a070 con 0x7f1b300c8a70 2024-04-25T12:23:23.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.365+0000 7f1b27fff640 1 --2- 172.21.15.86:0/1949270584 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f1b100683b0 0x7f1b1006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:23:23.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.365+0000 7f1b27fff640 1 -- 172.21.15.86:0/1949270584 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f1b20086570 con 0x7f1b300c8a70 2024-04-25T12:23:23.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.365+0000 7f1b2f7fe640 1 --2- 172.21.15.86:0/1949270584 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f1b100683b0 0x7f1b1006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:23:23.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.365+0000 7f1b2f7fe640 1 --2- 172.21.15.86:0/1949270584 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f1b100683b0 0x7f1b1006a870 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1b28009af0 tx=0x7f1b28008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:23:23.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.369+0000 7f1b27fff640 1 -- 172.21.15.86:0/1949270584 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1b20056620 con 0x7f1b300c8a70 2024-04-25T12:23:23.568 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.565+0000 7f1b35e36640 1 -- 172.21.15.86:0/1949270584 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1b300c5370 con 0x7f1b300c8a70 2024-04-25T12:23:23.569 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.565+0000 7f1b27fff640 1 -- 172.21.15.86:0/1949270584 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6921 (secure 0 0 0) 0x7f1b20055f20 con 0x7f1b300c8a70 2024-04-25T12:23:23.570 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:23:23.570 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/1969068022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1969068022},{"type":"v1","addr":"172.21.15.86:6835","nonce":1969068022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T12:21:23.459093+0000","modified":"2024-04-25T12:22:15.953239+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4294,"mds_1":4262,"mds_2":4245,"mds_3":4239,"mds_4":4236},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4236":{"gid":4236,"name":"a","rank":4,"incarnation":18,"state":"up:active","state_seq":16,"addr":"172.21.15.86:6838/3213562806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":3213562806},{"type":"v1","addr":"172.21.15.86:6838","nonce":3213562806}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4239":{"gid":4239,"name":"c","rank":3,"incarnation":16,"state":"up:active","state_seq":14,"addr":"172.21.15.86:6839/4002713597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6837","nonce":4002713597},{"type":"v1","addr":"172.21.15.86:6839","nonce":4002713597}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4245":{"gid":4245,"name":"d","rank":2,"incarnation":14,"state":"up:active","state_seq":13,"addr":"172.21.15.134:6833/3114005030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3114005030},{"type":"v1","addr":"172.21.15.134:6833","nonce":3114005030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4262":{"gid":4262,"name":"b","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.134:6837/1079608447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":1079608447},{"type":"v1","addr":"172.21.15.134:6837","nonce":1079608447}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4294":{"gid":4294,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6836/3044511437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3044511437},{"type":"v1","addr":"172.21.15.134:6836","nonce":3044511437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4236,4262,4239,4245,4294]},"id":1}]} 2024-04-25T12:23:23.570 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 19 2024-04-25T12:23:23.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.569+0000 7f1b35e36640 1 -- 172.21.15.86:0/1949270584 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f1b100683b0 msgr2=0x7f1b1006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:23:23.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.569+0000 7f1b35e36640 1 --2- 172.21.15.86:0/1949270584 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f1b100683b0 0x7f1b1006a870 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1b28009af0 tx=0x7f1b28008040 comp rx=0 tx=0).stop 2024-04-25T12:23:23.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.569+0000 7f1b35e36640 1 -- 172.21.15.86:0/1949270584 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b300c8a70 msgr2=0x7f1b30154dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:23:23.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.569+0000 7f1b35e36640 1 --2- 172.21.15.86:0/1949270584 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b300c8a70 0x7f1b30154dd0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f1b2000c730 tx=0x7f1b2000cbf0 comp rx=0 tx=0).stop 2024-04-25T12:23:23.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.569+0000 7f1b35e36640 1 -- 172.21.15.86:0/1949270584 shutdown_connections 2024-04-25T12:23:23.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.569+0000 7f1b35e36640 1 --2- 172.21.15.86:0/1949270584 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f1b100683b0 0x7f1b1006a870 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:23.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.569+0000 7f1b35e36640 1 --2- 172.21.15.86:0/1949270584 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b300c8a70 0x7f1b30154dd0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:23.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.569+0000 7f1b35e36640 1 --2- 172.21.15.86:0/1949270584 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1b300c8630 0x7f1b300c7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:23.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.569+0000 7f1b35e36640 1 --2- 172.21.15.86:0/1949270584 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b300c8250 0x7f1b301f58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:23.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.569+0000 7f1b35e36640 1 -- 172.21.15.86:0/1949270584 >> 172.21.15.86:0/1949270584 conn(0x7f1b3006b9d0 msgr2=0x7f1b3014e130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:23:23.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.569+0000 7f1b35e36640 1 -- 172.21.15.86:0/1949270584 shutdown_connections 2024-04-25T12:23:23.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.569+0000 7f1b35e36640 1 -- 172.21.15.86:0/1949270584 wait complete. 2024-04-25T12:23:23.588 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T12:23:23.694 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.689+0000 7f0d43af4640 1 Processor -- start 2024-04-25T12:23:23.694 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.689+0000 7f0d43af4640 1 -- start start 2024-04-25T12:23:23.695 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.693+0000 7f0d43af4640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0d3c14ffa0 0x7f0d3c06f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:23:23.695 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.693+0000 7f0d43af4640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0d3c074100 0x7f0d3c0c7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:23:23.695 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.693+0000 7f0d43af4640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d3c0c5d70 con 0x7f0d3c14fbc0 2024-04-25T12:23:23.696 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.693+0000 7f0d43af4640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f0d3c0c6050 con 0x7f0d3c14ffa0 2024-04-25T12:23:23.696 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.693+0000 7f0d43af4640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f0d3c0c6330 con 0x7f0d3c074100 2024-04-25T12:23:23.696 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.693+0000 7f0d4108f640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0d3c14ffa0 0x7f0d3c06f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:23:23.696 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.693+0000 7f0d4108f640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0d3c14ffa0 0x7f0d3c06f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38316/0 (socket says 172.21.15.86:38316) 2024-04-25T12:23:23.696 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.693+0000 7f0d4108f640 1 -- 172.21.15.86:0/3655701873 learned_addr learned my addr 172.21.15.86:0/3655701873 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:23:23.696 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.693+0000 7f0d42091640 1 --2- 172.21.15.86:0/3655701873 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0d3c074100 0x7f0d3c0c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:23:23.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.693+0000 7f0d4108f640 1 -- 172.21.15.86:0/3655701873 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0d3c074100 msgr2=0x7f0d3c0c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:23:23.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.693+0000 7f0d4108f640 1 --2- 172.21.15.86:0/3655701873 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0d3c074100 0x7f0d3c0c7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:23.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.693+0000 7f0d4108f640 1 -- 172.21.15.86:0/3655701873 >> v1:172.21.15.134:6789/0 conn(0x7f0d3c14fbc0 legacy=0x7f0d3c0c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:23:23.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.693+0000 7f0d4108f640 1 -- 172.21.15.86:0/3655701873 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d3c0c6610 con 0x7f0d3c14ffa0 2024-04-25T12:23:23.698 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.693+0000 7f0d4108f640 1 --2- 172.21.15.86:0/3655701873 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d3c14ffa0 0x7f0d3c06f700 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c009870 tx=0x7f0d2c01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea59ba5fa85280a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:23:23.698 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.693+0000 7f0d4088e640 1 -- 172.21.15.86:0/3655701873 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c0a9640 con 0x7f0d3c14ffa0 2024-04-25T12:23:23.699 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.693+0000 7f0d4088e640 1 -- 172.21.15.86:0/3655701873 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f0d2c0a97e0 con 0x7f0d3c14ffa0 2024-04-25T12:23:23.699 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.693+0000 7f0d4088e640 1 -- 172.21.15.86:0/3655701873 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c0a9bd0 con 0x7f0d3c14ffa0 2024-04-25T12:23:23.699 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.697+0000 7f0d43af4640 1 -- 172.21.15.86:0/3655701873 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d3c14ffa0 msgr2=0x7f0d3c06f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:23:23.700 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.697+0000 7f0d43af4640 1 --2- 172.21.15.86:0/3655701873 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d3c14ffa0 0x7f0d3c06f700 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c009870 tx=0x7f0d2c01c560 comp rx=0 tx=0).stop 2024-04-25T12:23:23.700 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.697+0000 7f0d43af4640 1 -- 172.21.15.86:0/3655701873 shutdown_connections 2024-04-25T12:23:23.700 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.697+0000 7f0d43af4640 1 --2- 172.21.15.86:0/3655701873 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0d3c074100 0x7f0d3c0c7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:23.700 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.697+0000 7f0d43af4640 1 --2- 172.21.15.86:0/3655701873 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d3c14ffa0 0x7f0d3c06f700 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:23.700 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.697+0000 7f0d43af4640 1 -- 172.21.15.86:0/3655701873 >> 172.21.15.86:0/3655701873 conn(0x7f0d3c06b9d0 msgr2=0x7f0d3c06bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:23:23.700 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.697+0000 7f0d43af4640 1 -- 172.21.15.86:0/3655701873 shutdown_connections 2024-04-25T12:23:23.700 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.697+0000 7f0d43af4640 1 -- 172.21.15.86:0/3655701873 wait complete. 2024-04-25T12:23:23.701 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.697+0000 7f0d43af4640 1 Processor -- start 2024-04-25T12:23:23.701 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.697+0000 7f0d43af4640 1 -- start start 2024-04-25T12:23:23.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.697+0000 7f0d43af4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d3c074100 0x7f0d3c141b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:23:23.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.697+0000 7f0d43af4640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0d3c14fbc0 0x7f0d3c14af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:23:23.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.697+0000 7f0d43af4640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d3c14ffa0 0x7f0d3c14b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:23:23.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.697+0000 7f0d43af4640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f0d3c0c8ab0 con 0x7f0d3c14ffa0 2024-04-25T12:23:23.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.697+0000 7f0d43af4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0d3c0c8930 con 0x7f0d3c074100 2024-04-25T12:23:23.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.697+0000 7f0d43af4640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f0d3c166090 con 0x7f0d3c14fbc0 2024-04-25T12:23:23.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.697+0000 7f0d42091640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d3c14ffa0 0x7f0d3c14b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:23:23.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.697+0000 7f0d42091640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d3c14ffa0 0x7f0d3c14b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38322/0 (socket says 172.21.15.86:38322) 2024-04-25T12:23:23.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.697+0000 7f0d42091640 1 -- 172.21.15.86:0/2332040107 learned_addr learned my addr 172.21.15.86:0/2332040107 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:23:23.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.697+0000 7f0d4108f640 1 --2- 172.21.15.86:0/2332040107 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0d3c14fbc0 0x7f0d3c14af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:23:23.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.697+0000 7f0d41890640 1 --2- 172.21.15.86:0/2332040107 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d3c074100 0x7f0d3c141b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:23:23.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.697+0000 7f0d42091640 1 -- 172.21.15.86:0/2332040107 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0d3c14fbc0 msgr2=0x7f0d3c14af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:23:23.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.697+0000 7f0d42091640 1 --2- 172.21.15.86:0/2332040107 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0d3c14fbc0 0x7f0d3c14af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:23.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.697+0000 7f0d42091640 1 -- 172.21.15.86:0/2332040107 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d3c074100 msgr2=0x7f0d3c141b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:23:23.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.697+0000 7f0d42091640 1 --2- 172.21.15.86:0/2332040107 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d3c074100 0x7f0d3c141b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:23.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.697+0000 7f0d42091640 1 -- 172.21.15.86:0/2332040107 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d3c0cc330 con 0x7f0d3c14ffa0 2024-04-25T12:23:23.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.697+0000 7f0d42091640 1 --2- 172.21.15.86:0/2332040107 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d3c14ffa0 0x7f0d3c14b4a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f0d34007de0 tx=0x7f0d3400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:23:23.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.697+0000 7f0d327fc640 1 -- 172.21.15.86:0/2332040107 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d34014620 con 0x7f0d3c14ffa0 2024-04-25T12:23:23.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.701+0000 7f0d327fc640 1 -- 172.21.15.86:0/2332040107 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f0d34019070 con 0x7f0d3c14ffa0 2024-04-25T12:23:23.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.701+0000 7f0d327fc640 1 -- 172.21.15.86:0/2332040107 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d34014a40 con 0x7f0d3c14ffa0 2024-04-25T12:23:23.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.701+0000 7f0d43af4640 1 -- 172.21.15.86:0/2332040107 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d3c14e4a0 con 0x7f0d3c14ffa0 2024-04-25T12:23:23.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.701+0000 7f0d43af4640 1 -- 172.21.15.86:0/2332040107 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d3c14a840 con 0x7f0d3c14ffa0 2024-04-25T12:23:23.706 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.701+0000 7f0d43af4640 1 -- 172.21.15.86:0/2332040107 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d3c075df0 con 0x7f0d3c14ffa0 2024-04-25T12:23:23.706 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.701+0000 7f0d327fc640 1 -- 172.21.15.86:0/2332040107 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0d34014be0 con 0x7f0d3c14ffa0 2024-04-25T12:23:23.706 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.701+0000 7f0d327fc640 1 --2- 172.21.15.86:0/2332040107 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f0d20068380 0x7f0d2006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:23:23.707 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.701+0000 7f0d327fc640 1 -- 172.21.15.86:0/2332040107 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f0d34087840 con 0x7f0d3c14ffa0 2024-04-25T12:23:23.707 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.701+0000 7f0d41890640 1 --2- 172.21.15.86:0/2332040107 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f0d20068380 0x7f0d2006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:23:23.707 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.701+0000 7f0d41890640 1 --2- 172.21.15.86:0/2332040107 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f0d20068380 0x7f0d2006a840 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0d38007fd0 tx=0x7f0d38009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:23:23.709 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.705+0000 7f0d327fc640 1 -- 172.21.15.86:0/2332040107 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0d34057970 con 0x7f0d3c14ffa0 2024-04-25T12:23:23.891 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.889+0000 7f0d43af4640 1 -- 172.21.15.86:0/2332040107 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0d3c149c50 con 0x7f0d3c14ffa0 2024-04-25T12:23:23.892 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.889+0000 7f0d327fc640 1 -- 172.21.15.86:0/2332040107 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6921 (secure 0 0 0) 0x7f0d34057270 con 0x7f0d3c14ffa0 2024-04-25T12:23:23.892 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:23:23.892 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/1969068022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1969068022},{"type":"v1","addr":"172.21.15.86:6835","nonce":1969068022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T12:21:23.459093+0000","modified":"2024-04-25T12:22:15.953239+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4294,"mds_1":4262,"mds_2":4245,"mds_3":4239,"mds_4":4236},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4236":{"gid":4236,"name":"a","rank":4,"incarnation":18,"state":"up:active","state_seq":16,"addr":"172.21.15.86:6838/3213562806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":3213562806},{"type":"v1","addr":"172.21.15.86:6838","nonce":3213562806}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4239":{"gid":4239,"name":"c","rank":3,"incarnation":16,"state":"up:active","state_seq":14,"addr":"172.21.15.86:6839/4002713597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6837","nonce":4002713597},{"type":"v1","addr":"172.21.15.86:6839","nonce":4002713597}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4245":{"gid":4245,"name":"d","rank":2,"incarnation":14,"state":"up:active","state_seq":13,"addr":"172.21.15.134:6833/3114005030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3114005030},{"type":"v1","addr":"172.21.15.134:6833","nonce":3114005030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4262":{"gid":4262,"name":"b","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.134:6837/1079608447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":1079608447},{"type":"v1","addr":"172.21.15.134:6837","nonce":1079608447}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4294":{"gid":4294,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6836/3044511437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3044511437},{"type":"v1","addr":"172.21.15.134:6836","nonce":3044511437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4236,4262,4239,4245,4294]},"id":1}]} 2024-04-25T12:23:23.893 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 19 2024-04-25T12:23:23.894 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.889+0000 7f0d43af4640 1 -- 172.21.15.86:0/2332040107 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f0d20068380 msgr2=0x7f0d2006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:23:23.894 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.889+0000 7f0d43af4640 1 --2- 172.21.15.86:0/2332040107 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f0d20068380 0x7f0d2006a840 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0d38007fd0 tx=0x7f0d38009040 comp rx=0 tx=0).stop 2024-04-25T12:23:23.894 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.889+0000 7f0d43af4640 1 -- 172.21.15.86:0/2332040107 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d3c14ffa0 msgr2=0x7f0d3c14b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:23:23.894 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.889+0000 7f0d43af4640 1 --2- 172.21.15.86:0/2332040107 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d3c14ffa0 0x7f0d3c14b4a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f0d34007de0 tx=0x7f0d3400e4b0 comp rx=0 tx=0).stop 2024-04-25T12:23:23.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.889+0000 7f0d43af4640 1 -- 172.21.15.86:0/2332040107 shutdown_connections 2024-04-25T12:23:23.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.889+0000 7f0d43af4640 1 --2- 172.21.15.86:0/2332040107 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f0d20068380 0x7f0d2006a840 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:23.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.889+0000 7f0d43af4640 1 --2- 172.21.15.86:0/2332040107 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d3c14ffa0 0x7f0d3c14b4a0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:23.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.889+0000 7f0d43af4640 1 --2- 172.21.15.86:0/2332040107 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0d3c14fbc0 0x7f0d3c14af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:23.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.889+0000 7f0d43af4640 1 --2- 172.21.15.86:0/2332040107 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d3c074100 0x7f0d3c141b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:23.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.889+0000 7f0d43af4640 1 -- 172.21.15.86:0/2332040107 >> 172.21.15.86:0/2332040107 conn(0x7f0d3c06b9d0 msgr2=0x7f0d3c0cbc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:23:23.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.889+0000 7f0d43af4640 1 -- 172.21.15.86:0/2332040107 shutdown_connections 2024-04-25T12:23:23.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:23.889+0000 7f0d43af4640 1 -- 172.21.15.86:0/2332040107 wait complete. 2024-04-25T12:23:23.909 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T12:23:24.019 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.017+0000 7fa52f23b640 1 Processor -- start 2024-04-25T12:23:24.019 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.017+0000 7fa52f23b640 1 -- start start 2024-04-25T12:23:24.020 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.017+0000 7fa52f23b640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa52814fbc0 0x7fa52806f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:23:24.020 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.017+0000 7fa52f23b640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa52814ffa0 0x7fa5280c8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:23:24.020 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.017+0000 7fa52f23b640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5280c5d70 con 0x7fa528074100 2024-04-25T12:23:24.021 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.017+0000 7fa52f23b640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7fa5280c6050 con 0x7fa52814ffa0 2024-04-25T12:23:24.021 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.017+0000 7fa52f23b640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fa5280c6330 con 0x7fa52814fbc0 2024-04-25T12:23:24.021 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.017+0000 7fa527fff640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa52814ffa0 0x7fa5280c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:23:24.021 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.017+0000 7fa527fff640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa52814ffa0 0x7fa5280c8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38328/0 (socket says 172.21.15.86:38328) 2024-04-25T12:23:24.021 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.017+0000 7fa527fff640 1 -- 172.21.15.86:0/2256660695 learned_addr learned my addr 172.21.15.86:0/2256660695 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:23:24.021 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.017+0000 7fa52cfd7640 1 --2- 172.21.15.86:0/2256660695 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa52814fbc0 0x7fa52806f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:23:24.021 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.017+0000 7fa527fff640 1 -- 172.21.15.86:0/2256660695 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa52814fbc0 msgr2=0x7fa52806f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:23:24.021 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.017+0000 7fa527fff640 1 --2- 172.21.15.86:0/2256660695 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa52814fbc0 0x7fa52806f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:24.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.017+0000 7fa527fff640 1 -- 172.21.15.86:0/2256660695 >> v1:172.21.15.134:6789/0 conn(0x7fa528074100 legacy=0x7fa5280c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:23:24.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.017+0000 7fa527fff640 1 -- 172.21.15.86:0/2256660695 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5280c6610 con 0x7fa52814ffa0 2024-04-25T12:23:24.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.021+0000 7fa527fff640 1 --2- 172.21.15.86:0/2256660695 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa52814ffa0 0x7fa5280c8220 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa514009870 tx=0x7fa51401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ba6d1dffb9efad3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:23:24.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.021+0000 7fa5277fe640 1 -- 172.21.15.86:0/2256660695 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5140aa660 con 0x7fa52814ffa0 2024-04-25T12:23:24.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.021+0000 7fa5277fe640 1 -- 172.21.15.86:0/2256660695 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fa5140af070 con 0x7fa52814ffa0 2024-04-25T12:23:24.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.021+0000 7fa5277fe640 1 -- 172.21.15.86:0/2256660695 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5140aaa40 con 0x7fa52814ffa0 2024-04-25T12:23:24.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.021+0000 7fa52f23b640 1 -- 172.21.15.86:0/2256660695 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa52814ffa0 msgr2=0x7fa5280c8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:23:24.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.021+0000 7fa52f23b640 1 --2- 172.21.15.86:0/2256660695 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa52814ffa0 0x7fa5280c8220 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa514009870 tx=0x7fa51401c520 comp rx=0 tx=0).stop 2024-04-25T12:23:24.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.021+0000 7fa52f23b640 1 -- 172.21.15.86:0/2256660695 shutdown_connections 2024-04-25T12:23:24.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.021+0000 7fa52f23b640 1 --2- 172.21.15.86:0/2256660695 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa52814ffa0 0x7fa5280c8220 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:24.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.021+0000 7fa52f23b640 1 --2- 172.21.15.86:0/2256660695 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa52814fbc0 0x7fa52806f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:24.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.021+0000 7fa52f23b640 1 -- 172.21.15.86:0/2256660695 >> 172.21.15.86:0/2256660695 conn(0x7fa52806b9d0 msgr2=0x7fa52806bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:23:24.025 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.021+0000 7fa52f23b640 1 -- 172.21.15.86:0/2256660695 shutdown_connections 2024-04-25T12:23:24.025 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.021+0000 7fa52f23b640 1 -- 172.21.15.86:0/2256660695 wait complete. 2024-04-25T12:23:24.027 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.021+0000 7fa52f23b640 1 Processor -- start 2024-04-25T12:23:24.028 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.021+0000 7fa52f23b640 1 -- start start 2024-04-25T12:23:24.028 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.021+0000 7fa52f23b640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa528074100 0x7fa52814c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:23:24.028 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.021+0000 7fa52f23b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa52814fbc0 0x7fa5281f3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:23:24.028 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.021+0000 7fa52f23b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa52814ffa0 0x7fa5281f42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:23:24.028 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.021+0000 7fa52f23b640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa528166420 con 0x7fa52814ffa0 2024-04-25T12:23:24.028 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.021+0000 7fa52f23b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa5281662a0 con 0x7fa52814fbc0 2024-04-25T12:23:24.028 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.021+0000 7fa52f23b640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fa5281665a0 con 0x7fa528074100 2024-04-25T12:23:24.028 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.021+0000 7fa52d7d8640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa52814ffa0 0x7fa5281f42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:23:24.029 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.021+0000 7fa52d7d8640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa52814ffa0 0x7fa5281f42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38334/0 (socket says 172.21.15.86:38334) 2024-04-25T12:23:24.029 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.021+0000 7fa52d7d8640 1 -- 172.21.15.86:0/565919162 learned_addr learned my addr 172.21.15.86:0/565919162 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:23:24.029 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.021+0000 7fa52cfd7640 1 --2- 172.21.15.86:0/565919162 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa528074100 0x7fa52814c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:23:24.029 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.021+0000 7fa527fff640 1 --2- 172.21.15.86:0/565919162 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa52814fbc0 0x7fa5281f3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:23:24.029 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.021+0000 7fa52d7d8640 1 -- 172.21.15.86:0/565919162 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa528074100 msgr2=0x7fa52814c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:23:24.029 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.021+0000 7fa52d7d8640 1 --2- 172.21.15.86:0/565919162 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa528074100 0x7fa52814c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:24.029 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.021+0000 7fa52d7d8640 1 -- 172.21.15.86:0/565919162 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa52814fbc0 msgr2=0x7fa5281f3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:23:24.029 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.021+0000 7fa52d7d8640 1 --2- 172.21.15.86:0/565919162 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa52814fbc0 0x7fa5281f3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:24.029 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.021+0000 7fa52d7d8640 1 -- 172.21.15.86:0/565919162 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa52815d380 con 0x7fa52814ffa0 2024-04-25T12:23:24.030 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.021+0000 7fa52d7d8640 1 --2- 172.21.15.86:0/565919162 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa52814ffa0 0x7fa5281f42a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa52000c7b0 tx=0x7fa52000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:23:24.030 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.021+0000 7fa5257fa640 1 -- 172.21.15.86:0/565919162 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa520016020 con 0x7fa52814ffa0 2024-04-25T12:23:24.030 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.021+0000 7fa5257fa640 1 -- 172.21.15.86:0/565919162 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fa52000a9f0 con 0x7fa52814ffa0 2024-04-25T12:23:24.030 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.021+0000 7fa52f23b640 1 -- 172.21.15.86:0/565919162 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5281503c0 con 0x7fa52814ffa0 2024-04-25T12:23:24.030 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.021+0000 7fa5257fa640 1 -- 172.21.15.86:0/565919162 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa52000ae00 con 0x7fa52814ffa0 2024-04-25T12:23:24.030 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.021+0000 7fa52f23b640 1 -- 172.21.15.86:0/565919162 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa528150940 con 0x7fa52814ffa0 2024-04-25T12:23:24.030 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.025+0000 7fa52f23b640 1 -- 172.21.15.86:0/565919162 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa528075df0 con 0x7fa52814ffa0 2024-04-25T12:23:24.030 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.025+0000 7fa5257fa640 1 -- 172.21.15.86:0/565919162 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa520019020 con 0x7fa52814ffa0 2024-04-25T12:23:24.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.025+0000 7fa5257fa640 1 --2- 172.21.15.86:0/565919162 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fa50c0683b0 0x7fa50c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:23:24.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.025+0000 7fa52cfd7640 1 --2- 172.21.15.86:0/565919162 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fa50c0683b0 0x7fa50c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:23:24.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.025+0000 7fa5257fa640 1 -- 172.21.15.86:0/565919162 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fa520086dd0 con 0x7fa52814ffa0 2024-04-25T12:23:24.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.025+0000 7fa52cfd7640 1 --2- 172.21.15.86:0/565919162 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fa50c0683b0 0x7fa50c06a870 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa51c00a970 tx=0x7fa51c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:23:24.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.029+0000 7fa5257fa640 1 -- 172.21.15.86:0/565919162 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa520020030 con 0x7fa52814ffa0 2024-04-25T12:23:24.197 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.193+0000 7fa52f23b640 1 -- 172.21.15.86:0/565919162 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa5280c7df0 con 0x7fa52814ffa0 2024-04-25T12:23:24.199 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.197+0000 7fa5257fa640 1 -- 172.21.15.86:0/565919162 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18905 (secure 0 0 0) 0x7fa520088070 con 0x7fa52814ffa0 2024-04-25T12:23:24.199 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-25T12:23:24.199 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":26,"fsid":"f2ef5c0c-9576-4650-b4f7-6cb14247f62a","created":"2024-04-25T12:20:59.241733+0000","modified":"2024-04-25T12:22:04.877793+0000","last_up_change":"2024-04-25T12:21:10.939617+0000","last_in_change":"2024-04-25T12:21:01.534145+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T12:21:11.839922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T12:21:21.854040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T12:21:22.406060+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T12:21:26.152386+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1f713f00-ef9f-4a6f-a620-38a8a1f8a822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6801","nonce":2812764579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6803","nonce":2812764579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6807","nonce":2812764579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":2812764579},{"type":"v1","addr":"172.21.15.86:6805","nonce":2812764579}]},"public_addr":"172.21.15.86:6801/2812764579","cluster_addr":"172.21.15.86:6803/2812764579","heartbeat_back_addr":"172.21.15.86:6807/2812764579","heartbeat_front_addr":"172.21.15.86:6805/2812764579","state":["exists","up"]},{"osd":1,"uuid":"baf6606d-a556-4fbe-a930-855e04ff1534","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6809","nonce":467966038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6811","nonce":467966038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6815","nonce":467966038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":467966038},{"type":"v1","addr":"172.21.15.86:6813","nonce":467966038}]},"public_addr":"172.21.15.86:6809/467966038","cluster_addr":"172.21.15.86:6811/467966038","heartbeat_back_addr":"172.21.15.86:6815/467966038","heartbeat_front_addr":"172.21.15.86:6813/467966038","state":["exists","up"]},{"osd":2,"uuid":"c983d68e-6d60-434f-aed6-108420c5dd09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6817","nonce":3279762843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6820","nonce":3279762843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6825","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6827","nonce":3279762843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3279762843},{"type":"v1","addr":"172.21.15.86:6824","nonce":3279762843}]},"public_addr":"172.21.15.86:6817/3279762843","cluster_addr":"172.21.15.86:6820/3279762843","heartbeat_back_addr":"172.21.15.86:6827/3279762843","heartbeat_front_addr":"172.21.15.86:6824/3279762843","state":["exists","up"]},{"osd":3,"uuid":"e77657bb-45aa-43bf-ab41-c7377eb495ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6821","nonce":2861354413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6826","nonce":2861354413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6831","nonce":2861354413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":2861354413},{"type":"v1","addr":"172.21.15.86:6829","nonce":2861354413}]},"public_addr":"172.21.15.86:6821/2861354413","cluster_addr":"172.21.15.86:6826/2861354413","heartbeat_back_addr":"172.21.15.86:6831/2861354413","heartbeat_front_addr":"172.21.15.86:6829/2861354413","state":["exists","up"]},{"osd":4,"uuid":"252bd300-d75a-4b00-be4b-27e6b51de4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6802","nonce":1872913602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6805","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6808","nonce":1872913602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6815","nonce":1872913602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1872913602},{"type":"v1","addr":"172.21.15.134:6813","nonce":1872913602}]},"public_addr":"172.21.15.134:6802/1872913602","cluster_addr":"172.21.15.134:6808/1872913602","heartbeat_back_addr":"172.21.15.134:6815/1872913602","heartbeat_front_addr":"172.21.15.134:6813/1872913602","state":["exists","up"]},{"osd":5,"uuid":"4135da3f-7427-4409-a48e-78bd8a7b46ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6801","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6803","nonce":2261413981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6806","nonce":2261413981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6812","nonce":2261413981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":2261413981},{"type":"v1","addr":"172.21.15.134:6809","nonce":2261413981}]},"public_addr":"172.21.15.134:6803/2261413981","cluster_addr":"172.21.15.134:6806/2261413981","heartbeat_back_addr":"172.21.15.134:6812/2261413981","heartbeat_front_addr":"172.21.15.134:6809/2261413981","state":["exists","up"]},{"osd":6,"uuid":"b6e7a5f1-fa7e-497d-abac-a19994d26820","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6825","nonce":2841082767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6827","nonce":2841082767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6831","nonce":2841082767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2841082767},{"type":"v1","addr":"172.21.15.134:6829","nonce":2841082767}]},"public_addr":"172.21.15.134:6825/2841082767","cluster_addr":"172.21.15.134:6827/2841082767","heartbeat_back_addr":"172.21.15.134:6831/2841082767","heartbeat_front_addr":"172.21.15.134:6829/2841082767","state":["exists","up"]},{"osd":7,"uuid":"c5597e50-1962-4103-9124-dd7bceb8ac97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6817","nonce":1277404274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6819","nonce":1277404274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6823","nonce":1277404274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1277404274},{"type":"v1","addr":"172.21.15.134:6821","nonce":1277404274}]},"public_addr":"172.21.15.134:6817/1277404274","cluster_addr":"172.21.15.134:6819/1277404274","heartbeat_back_addr":"172.21.15.134:6823/1277404274","heartbeat_front_addr":"172.21.15.134:6821/1277404274","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.018125+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.157958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.113619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:07.136904+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.844514+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.872629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.775339+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:06.822867+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":7,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.33","mappings":[{"from":3,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T12:23:24.201 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.197+0000 7fa52f23b640 1 -- 172.21.15.86:0/565919162 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fa50c0683b0 msgr2=0x7fa50c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:23:24.201 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.197+0000 7fa52f23b640 1 --2- 172.21.15.86:0/565919162 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fa50c0683b0 0x7fa50c06a870 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa51c00a970 tx=0x7fa51c008040 comp rx=0 tx=0).stop 2024-04-25T12:23:24.202 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.197+0000 7fa52f23b640 1 -- 172.21.15.86:0/565919162 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa52814ffa0 msgr2=0x7fa5281f42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:23:24.202 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.197+0000 7fa52f23b640 1 --2- 172.21.15.86:0/565919162 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa52814ffa0 0x7fa5281f42a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa52000c7b0 tx=0x7fa52000cc70 comp rx=0 tx=0).stop 2024-04-25T12:23:24.202 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.197+0000 7fa52f23b640 1 -- 172.21.15.86:0/565919162 shutdown_connections 2024-04-25T12:23:24.202 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.197+0000 7fa52f23b640 1 --2- 172.21.15.86:0/565919162 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fa50c0683b0 0x7fa50c06a870 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:24.202 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.197+0000 7fa52f23b640 1 --2- 172.21.15.86:0/565919162 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa52814ffa0 0x7fa5281f42a0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:24.202 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.197+0000 7fa52f23b640 1 --2- 172.21.15.86:0/565919162 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa52814fbc0 0x7fa5281f3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:24.203 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.197+0000 7fa52f23b640 1 --2- 172.21.15.86:0/565919162 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa528074100 0x7fa52814c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:24.203 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.197+0000 7fa52f23b640 1 -- 172.21.15.86:0/565919162 >> 172.21.15.86:0/565919162 conn(0x7fa52806b9d0 msgr2=0x7fa52814a120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:23:24.203 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.197+0000 7fa52f23b640 1 -- 172.21.15.86:0/565919162 shutdown_connections 2024-04-25T12:23:24.203 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.197+0000 7fa52f23b640 1 -- 172.21.15.86:0/565919162 wait complete. 2024-04-25T12:23:24.219 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T12:23:24.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.333+0000 7fb6661df640 1 Processor -- start 2024-04-25T12:23:24.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.333+0000 7fb6661df640 1 -- start start 2024-04-25T12:23:24.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.337+0000 7fb6661df640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb66014fbc0 0x7fb66006f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:23:24.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.337+0000 7fb6661df640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb66014ffa0 0x7fb6600c8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:23:24.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.337+0000 7fb6661df640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb660074100 0x7fb6600c8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:23:24.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.337+0000 7fb6661df640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7fb6600c5d70 con 0x7fb66014ffa0 2024-04-25T12:23:24.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.337+0000 7fb6661df640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7fb6600c6050 con 0x7fb660074100 2024-04-25T12:23:24.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.337+0000 7fb6661df640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fb6600c6330 con 0x7fb66014fbc0 2024-04-25T12:23:24.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.337+0000 7fb65effd640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb66014ffa0 0x7fb6600c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:23:24.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.337+0000 7fb65effd640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb66014ffa0 0x7fb6600c8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38336/0 (socket says 172.21.15.86:38336) 2024-04-25T12:23:24.342 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.337+0000 7fb65effd640 1 -- 172.21.15.86:0/1704632219 learned_addr learned my addr 172.21.15.86:0/1704632219 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:23:24.342 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.337+0000 7fb65effd640 1 -- 172.21.15.86:0/1704632219 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb66014fbc0 msgr2=0x7fb66006f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:23:24.342 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.337+0000 7fb65effd640 1 --2- 172.21.15.86:0/1704632219 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb66014fbc0 0x7fb66006f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:24.342 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.337+0000 7fb65effd640 1 -- 172.21.15.86:0/1704632219 >> v2:172.21.15.134:3300/0 conn(0x7fb660074100 msgr2=0x7fb6600c8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:23:24.342 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.337+0000 7fb65effd640 1 --2- 172.21.15.86:0/1704632219 >> v2:172.21.15.134:3300/0 conn(0x7fb660074100 0x7fb6600c8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:24.342 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.337+0000 7fb65effd640 1 -- 172.21.15.86:0/1704632219 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6600c6610 con 0x7fb66014ffa0 2024-04-25T12:23:24.345 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.337+0000 7fb65effd640 1 --2- 172.21.15.86:0/1704632219 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb66014ffa0 0x7fb6600c8220 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fb6600744e0 tx=0x7fb65401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fc3ffb65a84ad44 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:23:24.345 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.337+0000 7fb65e7fc640 1 -- 172.21.15.86:0/1704632219 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6540aa660 con 0x7fb66014ffa0 2024-04-25T12:23:24.346 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.337+0000 7fb65e7fc640 1 -- 172.21.15.86:0/1704632219 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fb6540af070 con 0x7fb66014ffa0 2024-04-25T12:23:24.346 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.337+0000 7fb65e7fc640 1 -- 172.21.15.86:0/1704632219 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6540aaa40 con 0x7fb66014ffa0 2024-04-25T12:23:24.346 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.337+0000 7fb6661df640 1 -- 172.21.15.86:0/1704632219 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb66014ffa0 msgr2=0x7fb6600c8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:23:24.346 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.337+0000 7fb6661df640 1 --2- 172.21.15.86:0/1704632219 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb66014ffa0 0x7fb6600c8220 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fb6600744e0 tx=0x7fb65401c520 comp rx=0 tx=0).stop 2024-04-25T12:23:24.346 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.337+0000 7fb6661df640 1 -- 172.21.15.86:0/1704632219 shutdown_connections 2024-04-25T12:23:24.346 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.337+0000 7fb6661df640 1 --2- 172.21.15.86:0/1704632219 >> v2:172.21.15.134:3300/0 conn(0x7fb660074100 0x7fb6600c8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:24.346 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.337+0000 7fb6661df640 1 --2- 172.21.15.86:0/1704632219 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb66014ffa0 0x7fb6600c8220 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:24.346 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.337+0000 7fb6661df640 1 --2- 172.21.15.86:0/1704632219 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb66014fbc0 0x7fb66006f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:24.347 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.337+0000 7fb6661df640 1 -- 172.21.15.86:0/1704632219 >> 172.21.15.86:0/1704632219 conn(0x7fb66006b9d0 msgr2=0x7fb66006bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:23:24.347 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.337+0000 7fb6661df640 1 -- 172.21.15.86:0/1704632219 shutdown_connections 2024-04-25T12:23:24.347 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.337+0000 7fb6661df640 1 -- 172.21.15.86:0/1704632219 wait complete. 2024-04-25T12:23:24.347 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.341+0000 7fb6661df640 1 Processor -- start 2024-04-25T12:23:24.347 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.341+0000 7fb6661df640 1 -- start start 2024-04-25T12:23:24.347 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.341+0000 7fb6661df640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb660074100 0x7fb66014b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:23:24.347 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.341+0000 7fb6661df640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb66014fbc0 0x7fb66013de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:23:24.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.341+0000 7fb6661df640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb66014ffa0 0x7fb66013f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:23:24.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.341+0000 7fb6661df640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb6601592e0 con 0x7fb66014ffa0 2024-04-25T12:23:24.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.341+0000 7fb6661df640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb660159160 con 0x7fb660074100 2024-04-25T12:23:24.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.341+0000 7fb6661df640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fb660159460 con 0x7fb66014fbc0 2024-04-25T12:23:24.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.341+0000 7fb65ffff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb66014ffa0 0x7fb66013f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:23:24.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.341+0000 7fb65ffff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb66014ffa0 0x7fb66013f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38352/0 (socket says 172.21.15.86:38352) 2024-04-25T12:23:24.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.341+0000 7fb65ffff640 1 -- 172.21.15.86:0/1085501924 learned_addr learned my addr 172.21.15.86:0/1085501924 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:23:24.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.341+0000 7fb65effd640 1 --2- 172.21.15.86:0/1085501924 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb66014fbc0 0x7fb66013de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:23:24.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.341+0000 7fb65f7fe640 1 --2- 172.21.15.86:0/1085501924 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb660074100 0x7fb66014b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:23:24.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.341+0000 7fb65ffff640 1 -- 172.21.15.86:0/1085501924 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb66014fbc0 msgr2=0x7fb66013de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:23:24.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.341+0000 7fb65ffff640 1 --2- 172.21.15.86:0/1085501924 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb66014fbc0 0x7fb66013de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:24.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.341+0000 7fb65ffff640 1 -- 172.21.15.86:0/1085501924 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb660074100 msgr2=0x7fb66014b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:23:24.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.341+0000 7fb65ffff640 1 --2- 172.21.15.86:0/1085501924 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb660074100 0x7fb66014b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:24.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.341+0000 7fb65ffff640 1 -- 172.21.15.86:0/1085501924 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6601444a0 con 0x7fb66014ffa0 2024-04-25T12:23:24.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.341+0000 7fb65ffff640 1 --2- 172.21.15.86:0/1085501924 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb66014ffa0 0x7fb66013f7a0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb65800ba10 tx=0x7fb65800bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:23:24.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.341+0000 7fb647fff640 1 -- 172.21.15.86:0/1085501924 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb658019070 con 0x7fb66014ffa0 2024-04-25T12:23:24.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.341+0000 7fb647fff640 1 -- 172.21.15.86:0/1085501924 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fb65800cae0 con 0x7fb66014ffa0 2024-04-25T12:23:24.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.341+0000 7fb6661df640 1 -- 172.21.15.86:0/1085501924 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb660141440 con 0x7fb66014ffa0 2024-04-25T12:23:24.350 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.341+0000 7fb647fff640 1 -- 172.21.15.86:0/1085501924 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb658014440 con 0x7fb66014ffa0 2024-04-25T12:23:24.350 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.341+0000 7fb6661df640 1 -- 172.21.15.86:0/1085501924 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb660140e80 con 0x7fb66014ffa0 2024-04-25T12:23:24.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.341+0000 7fb6661df640 1 -- 172.21.15.86:0/1085501924 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb660075df0 con 0x7fb66014ffa0 2024-04-25T12:23:24.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.345+0000 7fb647fff640 1 -- 172.21.15.86:0/1085501924 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb65801c070 con 0x7fb66014ffa0 2024-04-25T12:23:24.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.345+0000 7fb647fff640 1 --2- 172.21.15.86:0/1085501924 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fb64c068380 0x7fb64c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:23:24.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.345+0000 7fb647fff640 1 -- 172.21.15.86:0/1085501924 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fb658086b30 con 0x7fb66014ffa0 2024-04-25T12:23:24.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.345+0000 7fb65f7fe640 1 --2- 172.21.15.86:0/1085501924 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fb64c068380 0x7fb64c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:23:24.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.345+0000 7fb65f7fe640 1 --2- 172.21.15.86:0/1085501924 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fb64c068380 0x7fb64c06a840 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb650006fd0 tx=0x7fb650008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:23:24.352 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.349+0000 7fb647fff640 1 -- 172.21.15.86:0/1085501924 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb658056c60 con 0x7fb66014ffa0 2024-04-25T12:23:24.547 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.545+0000 7fb6661df640 1 -- 172.21.15.86:0/1085501924 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fb660158d30 con 0x7fb66014ffa0 2024-04-25T12:23:24.551 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.549+0000 7fb647fff640 1 -- 172.21.15.86:0/1085501924 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v20) ==== 161+0+0 (secure 0 0 0) 0x7fb658056560 con 0x7fb66014ffa0 2024-04-25T12:23:24.551 INFO:teuthology.orchestra.run.smithi086.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T12:23:24.555 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.553+0000 7fb6661df640 1 -- 172.21.15.86:0/1085501924 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fb64c068380 msgr2=0x7fb64c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:23:24.555 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.553+0000 7fb6661df640 1 --2- 172.21.15.86:0/1085501924 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fb64c068380 0x7fb64c06a840 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb650006fd0 tx=0x7fb650008040 comp rx=0 tx=0).stop 2024-04-25T12:23:24.555 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.553+0000 7fb6661df640 1 -- 172.21.15.86:0/1085501924 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb66014ffa0 msgr2=0x7fb66013f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:23:24.555 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.553+0000 7fb6661df640 1 --2- 172.21.15.86:0/1085501924 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb66014ffa0 0x7fb66013f7a0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb65800ba10 tx=0x7fb65800bed0 comp rx=0 tx=0).stop 2024-04-25T12:23:24.556 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.553+0000 7fb6661df640 1 -- 172.21.15.86:0/1085501924 shutdown_connections 2024-04-25T12:23:24.556 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.553+0000 7fb6661df640 1 --2- 172.21.15.86:0/1085501924 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fb64c068380 0x7fb64c06a840 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:24.556 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.553+0000 7fb6661df640 1 --2- 172.21.15.86:0/1085501924 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb66014ffa0 0x7fb66013f7a0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:24.556 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.553+0000 7fb6661df640 1 --2- 172.21.15.86:0/1085501924 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb66014fbc0 0x7fb66013de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:24.556 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.553+0000 7fb6661df640 1 --2- 172.21.15.86:0/1085501924 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb660074100 0x7fb66014b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:24.556 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.553+0000 7fb6661df640 1 -- 172.21.15.86:0/1085501924 >> 172.21.15.86:0/1085501924 conn(0x7fb66006b9d0 msgr2=0x7fb66014c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:23:24.556 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.553+0000 7fb6661df640 1 -- 172.21.15.86:0/1085501924 shutdown_connections 2024-04-25T12:23:24.557 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.553+0000 7fb6661df640 1 -- 172.21.15.86:0/1085501924 wait complete. 2024-04-25T12:23:24.571 INFO:tasks.ceph.mds.f.smithi134.stderr: -5509> 2024-04-25T12:21:38.407+0000 7f970442b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T12:23:24.576 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T12:23:24.577 INFO:tasks.ceph.mds.f.smithi134.stderr: -4066> 2024-04-25T12:21:58.406+0000 7f970442b640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-04-25T12:23:24.579 INFO:tasks.ceph.mds.f.smithi134.stderr: -2945> 2024-04-25T12:22:18.410+0000 7f970442b640 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-04-25T12:23:24.597 INFO:tasks.ceph.mds.c.smithi086.stdout:starting mds.c at 2024-04-25T12:23:24.597 INFO:tasks.ceph.mds.a.smithi086.stdout:starting mds.a at 2024-04-25T12:23:24.615 INFO:tasks.ceph.mds.b.smithi134.stdout:starting mds.b at 2024-04-25T12:23:24.622 INFO:tasks.ceph.mds.f.smithi134.stdout:starting mds.f at 2024-04-25T12:23:24.623 INFO:tasks.ceph.mds.d.smithi134.stdout:starting mds.d at 2024-04-25T12:23:24.693 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.689+0000 7f6b0af3a640 1 Processor -- start 2024-04-25T12:23:24.693 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.689+0000 7f6b0af3a640 1 -- start start 2024-04-25T12:23:24.694 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.689+0000 7f6b0af3a640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6b0406dde0 0x7f6b04164770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:23:24.694 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.689+0000 7f6b0af3a640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b04159290 con 0x7f6b04158e00 2024-04-25T12:23:24.694 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.689+0000 7f6b0af3a640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b04159570 con 0x7f6b04153020 2024-04-25T12:23:24.694 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.689+0000 7f6b0af3a640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f6b04159e10 con 0x7f6b0406dde0 2024-04-25T12:23:24.695 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.689+0000 7f6b094d7640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6b0406dde0 0x7f6b04164770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:23:24.695 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.689+0000 7f6b03fff640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f6b04158e00 0x7f6b040cd3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:60046/0 (socket says 172.21.15.86:60046) 2024-04-25T12:23:24.695 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.689+0000 7f6b03fff640 1 -- 172.21.15.86:0/4264947306 learned_addr learned my addr 172.21.15.86:0/4264947306 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-04-25T12:23:24.695 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.689+0000 7f6b094d7640 1 -- 172.21.15.86:0/4264947306 >> v1:172.21.15.134:6789/0 conn(0x7f6b04153020 legacy=0x7f6b0415ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:23:24.695 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.689+0000 7f6b094d7640 1 -- 172.21.15.86:0/4264947306 >> v1:172.21.15.86:6789/0 conn(0x7f6b04158e00 legacy=0x7f6b040cd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:23:24.695 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.689+0000 7f6b094d7640 1 -- 172.21.15.86:0/4264947306 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b04159850 con 0x7f6b0406dde0 2024-04-25T12:23:24.695 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.689+0000 7f6b037fe640 1 -- 172.21.15.86:0/4264947306 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 273867870 0 0) 0x7f6b04159290 con 0x7f6b04158e00 2024-04-25T12:23:24.696 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.693+0000 7f6b094d7640 1 --2- 172.21.15.86:0/4264947306 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b0406dde0 0x7f6b04164770 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f6afc0097c0 tx=0x7f6afc01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=762f8eee7fe51dea server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:23:24.696 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.693+0000 7f6b037fe640 1 -- 172.21.15.86:0/4264947306 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6afc0ab430 con 0x7f6b0406dde0 2024-04-25T12:23:24.696 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.693+0000 7f6b037fe640 1 -- 172.21.15.86:0/4264947306 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f6afc0b0070 con 0x7f6b0406dde0 2024-04-25T12:23:24.696 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.693+0000 7f6b037fe640 1 -- 172.21.15.86:0/4264947306 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6afc0ab810 con 0x7f6b0406dde0 2024-04-25T12:23:24.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.693+0000 7f6b0af3a640 1 -- 172.21.15.86:0/4264947306 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b0406dde0 msgr2=0x7f6b04164770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:23:24.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.693+0000 7f6b0af3a640 1 --2- 172.21.15.86:0/4264947306 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b0406dde0 0x7f6b04164770 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f6afc0097c0 tx=0x7f6afc01c430 comp rx=0 tx=0).stop 2024-04-25T12:23:24.698 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.693+0000 7f6b0af3a640 1 -- 172.21.15.86:0/4264947306 shutdown_connections 2024-04-25T12:23:24.698 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.693+0000 7f6b0af3a640 1 --2- 172.21.15.86:0/4264947306 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b0406dde0 0x7f6b04164770 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:24.698 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.693+0000 7f6b0af3a640 1 -- 172.21.15.86:0/4264947306 >> 172.21.15.86:0/4264947306 conn(0x7f6b0406bdd0 msgr2=0x7f6b0406c1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:23:24.698 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.693+0000 7f6b0af3a640 1 -- 172.21.15.86:0/4264947306 shutdown_connections 2024-04-25T12:23:24.698 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.693+0000 7f6b0af3a640 1 -- 172.21.15.86:0/4264947306 wait complete. 2024-04-25T12:23:24.700 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.693+0000 7f6b0af3a640 1 Processor -- start 2024-04-25T12:23:24.701 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.693+0000 7f6b0af3a640 1 -- start start 2024-04-25T12:23:24.701 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.697+0000 7f6b0af3a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b0406dde0 0x7f6b04147ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:23:24.701 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.697+0000 7f6b0af3a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b04153020 0x7f6b040c99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:23:24.701 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.697+0000 7f6b0af3a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b04147830 0x7f6b04158260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:23:24.701 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.697+0000 7f6b0af3a640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6b0415d320 con 0x7f6b04153020 2024-04-25T12:23:24.701 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.697+0000 7f6b0af3a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6b0415d1a0 con 0x7f6b0406dde0 2024-04-25T12:23:24.701 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.697+0000 7f6b0af3a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f6b0406e610 con 0x7f6b04147830 2024-04-25T12:23:24.702 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.697+0000 7f6b03fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b04153020 0x7f6b040c99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:23:24.702 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.697+0000 7f6b03fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b04153020 0x7f6b040c99b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38412/0 (socket says 172.21.15.86:38412) 2024-04-25T12:23:24.702 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.697+0000 7f6b03fff640 1 -- 172.21.15.86:0/4210977361 learned_addr learned my addr 172.21.15.86:0/4210977361 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:23:24.702 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.697+0000 7f6b094d7640 1 --2- 172.21.15.86:0/4210977361 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b04147830 0x7f6b04158260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:23:24.702 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.697+0000 7f6b03fff640 1 -- 172.21.15.86:0/4210977361 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b04147830 msgr2=0x7f6b04158260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:23:24.702 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.697+0000 7f6b03fff640 1 --2- 172.21.15.86:0/4210977361 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b04147830 0x7f6b04158260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:24.702 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.697+0000 7f6b08cd6640 1 --2- 172.21.15.86:0/4210977361 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b0406dde0 0x7f6b04147ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:23:24.702 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.697+0000 7f6b03fff640 1 -- 172.21.15.86:0/4210977361 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b0406dde0 msgr2=0x7f6b04147ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:23:24.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.697+0000 7f6b03fff640 1 --2- 172.21.15.86:0/4210977361 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b0406dde0 0x7f6b04147ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:24.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.697+0000 7f6b03fff640 1 -- 172.21.15.86:0/4210977361 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b0414a550 con 0x7f6b04153020 2024-04-25T12:23:24.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.697+0000 7f6b08cd6640 1 --2- 172.21.15.86:0/4210977361 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b0406dde0 0x7f6b04147ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:23:24.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.697+0000 7f6b03fff640 1 --2- 172.21.15.86:0/4210977361 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b04153020 0x7f6b040c99b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f6aec00c440 tx=0x7f6aec00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:23:24.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.697+0000 7f6b017fa640 1 -- 172.21.15.86:0/4210977361 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aec0074e0 con 0x7f6b04153020 2024-04-25T12:23:24.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.697+0000 7f6b017fa640 1 -- 172.21.15.86:0/4210977361 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f6aec0047f0 con 0x7f6b04153020 2024-04-25T12:23:24.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.697+0000 7f6b017fa640 1 -- 172.21.15.86:0/4210977361 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aec007680 con 0x7f6b04153020 2024-04-25T12:23:24.703 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.697+0000 7f6b0af3a640 1 -- 172.21.15.86:0/4210977361 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b041f5800 con 0x7f6b04153020 2024-04-25T12:23:24.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.697+0000 7f6b0af3a640 1 -- 172.21.15.86:0/4210977361 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b040c8bf0 con 0x7f6b04153020 2024-04-25T12:23:24.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.697+0000 7f6b0af3a640 1 -- 172.21.15.86:0/4210977361 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b04075df0 con 0x7f6b04153020 2024-04-25T12:23:24.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.697+0000 7f6b017fa640 1 -- 172.21.15.86:0/4210977361 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6aec011070 con 0x7f6b04153020 2024-04-25T12:23:24.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.697+0000 7f6b017fa640 1 --2- 172.21.15.86:0/4210977361 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f6ae4068380 0x7f6ae406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:23:24.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.697+0000 7f6b08cd6640 1 --2- 172.21.15.86:0/4210977361 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f6ae4068380 0x7f6ae406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:23:24.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.697+0000 7f6b017fa640 1 -- 172.21.15.86:0/4210977361 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 7165+0+0 (secure 0 0 0) 0x7f6aec086b80 con 0x7f6b04153020 2024-04-25T12:23:24.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.697+0000 7f6b08cd6640 1 --2- 172.21.15.86:0/4210977361 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f6ae4068380 0x7f6ae406a840 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6af4007fd0 tx=0x7f6af4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:23:24.706 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.701+0000 7f6b017fa640 1 -- 172.21.15.86:0/4210977361 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6aec056b00 con 0x7f6b04153020 2024-04-25T12:23:24.905 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:24.901+0000 7f6b0af3a640 1 -- 172.21.15.86:0/4210977361 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f6b0406e990 con 0x7f6b04153020 2024-04-25T12:23:25.553 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.549+0000 7f6b017fa640 1 -- 172.21.15.86:0/4210977361 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v21) ==== 104+0+0 (secure 0 0 0) 0x7f6aec056400 con 0x7f6b04153020 2024-04-25T12:23:25.557 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.553+0000 7f6b0af3a640 1 -- 172.21.15.86:0/4210977361 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f6ae4068380 msgr2=0x7f6ae406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:23:25.557 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.553+0000 7f6b0af3a640 1 --2- 172.21.15.86:0/4210977361 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f6ae4068380 0x7f6ae406a840 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6af4007fd0 tx=0x7f6af4009040 comp rx=0 tx=0).stop 2024-04-25T12:23:25.557 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.553+0000 7f6b0af3a640 1 -- 172.21.15.86:0/4210977361 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b04153020 msgr2=0x7f6b040c99b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:23:25.557 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.553+0000 7f6b0af3a640 1 --2- 172.21.15.86:0/4210977361 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b04153020 0x7f6b040c99b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f6aec00c440 tx=0x7f6aec00c900 comp rx=0 tx=0).stop 2024-04-25T12:23:25.557 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.553+0000 7f6b0af3a640 1 -- 172.21.15.86:0/4210977361 shutdown_connections 2024-04-25T12:23:25.557 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.553+0000 7f6b0af3a640 1 --2- 172.21.15.86:0/4210977361 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b04147830 0x7f6b04158260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:25.557 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.553+0000 7f6b0af3a640 1 --2- 172.21.15.86:0/4210977361 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f6ae4068380 0x7f6ae406a840 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:25.558 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.553+0000 7f6b0af3a640 1 --2- 172.21.15.86:0/4210977361 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b04153020 0x7f6b040c99b0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:25.558 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.553+0000 7f6b0af3a640 1 --2- 172.21.15.86:0/4210977361 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b0406dde0 0x7f6b04147ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:25.558 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.553+0000 7f6b0af3a640 1 -- 172.21.15.86:0/4210977361 >> 172.21.15.86:0/4210977361 conn(0x7f6b0406bdd0 msgr2=0x7f6b0415ad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:23:25.558 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.553+0000 7f6b0af3a640 1 -- 172.21.15.86:0/4210977361 shutdown_connections 2024-04-25T12:23:25.558 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.553+0000 7f6b0af3a640 1 -- 172.21.15.86:0/4210977361 wait complete. 2024-04-25T12:23:25.579 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T12:23:25.747 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.745+0000 7f37942a1640 1 Processor -- start 2024-04-25T12:23:25.748 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.745+0000 7f37942a1640 1 -- start start 2024-04-25T12:23:25.749 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.745+0000 7f37942a1640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f378c073e00 0x7f378c0676a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:23:25.749 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.745+0000 7f37942a1640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f378c0741e0 0x7f378c06ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:23:25.749 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.745+0000 7f37942a1640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f378c0c8910 0x7f378c159110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:23:25.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.745+0000 7f37942a1640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f378c067cc0 con 0x7f378c0c8910 2024-04-25T12:23:25.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.745+0000 7f37942a1640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f378c0c7fe0 con 0x7f378c073e00 2024-04-25T12:23:25.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.745+0000 7f37942a1640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f378c0c82c0 con 0x7f378c0741e0 2024-04-25T12:23:25.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.745+0000 7f379283e640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f378c0c8910 0x7f378c159110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:23:25.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.745+0000 7f379283e640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f378c0c8910 0x7f378c159110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38418/0 (socket says 172.21.15.86:38418) 2024-04-25T12:23:25.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.745+0000 7f379283e640 1 -- 172.21.15.86:0/1247495207 learned_addr learned my addr 172.21.15.86:0/1247495207 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:23:25.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.745+0000 7f379183c640 1 --2- 172.21.15.86:0/1247495207 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f378c0741e0 0x7f378c06ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:23:25.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.745+0000 7f379283e640 1 -- 172.21.15.86:0/1247495207 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f378c0741e0 msgr2=0x7f378c06ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:23:25.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.745+0000 7f379283e640 1 --2- 172.21.15.86:0/1247495207 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f378c0741e0 0x7f378c06ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:25.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.745+0000 7f379283e640 1 -- 172.21.15.86:0/1247495207 >> v2:172.21.15.134:3300/0 conn(0x7f378c073e00 msgr2=0x7f378c0676a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:23:25.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.745+0000 7f379203d640 1 --2- 172.21.15.86:0/1247495207 >> v2:172.21.15.134:3300/0 conn(0x7f378c073e00 0x7f378c0676a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:23:25.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.745+0000 7f379283e640 1 --2- 172.21.15.86:0/1247495207 >> v2:172.21.15.134:3300/0 conn(0x7f378c073e00 0x7f378c0676a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:25.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.745+0000 7f379283e640 1 -- 172.21.15.86:0/1247495207 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f378c0c85a0 con 0x7f378c0c8910 2024-04-25T12:23:25.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.749+0000 7f379283e640 1 --2- 172.21.15.86:0/1247495207 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f378c0c8910 0x7f378c159110 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f3784009e50 tx=0x7f378401f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c46d2e4f264529cf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:23:25.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.749+0000 7f379103b640 1 -- 172.21.15.86:0/1247495207 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37840b4070 con 0x7f378c0c8910 2024-04-25T12:23:25.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.749+0000 7f379103b640 1 -- 172.21.15.86:0/1247495207 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f37840af400 con 0x7f378c0c8910 2024-04-25T12:23:25.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.749+0000 7f379103b640 1 -- 172.21.15.86:0/1247495207 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37840af7f0 con 0x7f378c0c8910 2024-04-25T12:23:25.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.749+0000 7f37942a1640 1 -- 172.21.15.86:0/1247495207 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f378c0c8910 msgr2=0x7f378c159110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:23:25.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.749+0000 7f37942a1640 1 --2- 172.21.15.86:0/1247495207 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f378c0c8910 0x7f378c159110 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f3784009e50 tx=0x7f378401f1e0 comp rx=0 tx=0).stop 2024-04-25T12:23:25.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.749+0000 7f37942a1640 1 -- 172.21.15.86:0/1247495207 shutdown_connections 2024-04-25T12:23:25.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.749+0000 7f37942a1640 1 --2- 172.21.15.86:0/1247495207 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f378c0c8910 0x7f378c159110 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:25.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.749+0000 7f37942a1640 1 --2- 172.21.15.86:0/1247495207 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f378c0741e0 0x7f378c06ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:25.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.749+0000 7f37942a1640 1 --2- 172.21.15.86:0/1247495207 >> v2:172.21.15.134:3300/0 conn(0x7f378c073e00 0x7f378c0676a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:25.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.749+0000 7f37942a1640 1 -- 172.21.15.86:0/1247495207 >> 172.21.15.86:0/1247495207 conn(0x7f378c06f430 msgr2=0x7f378c06f840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:23:25.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.749+0000 7f37942a1640 1 -- 172.21.15.86:0/1247495207 shutdown_connections 2024-04-25T12:23:25.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.749+0000 7f37942a1640 1 -- 172.21.15.86:0/1247495207 wait complete. 2024-04-25T12:23:25.755 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.749+0000 7f37942a1640 1 Processor -- start 2024-04-25T12:23:25.756 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.749+0000 7f37942a1640 1 -- start start 2024-04-25T12:23:25.756 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.749+0000 7f37942a1640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f378c073e00 0x7f378c149570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:23:25.756 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.749+0000 7f37942a1640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f378c0741e0 0x7f378c15baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:23:25.756 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.749+0000 7f37942a1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f378c0c8910 0x7f378c15bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:23:25.756 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.749+0000 7f37942a1640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f378c159650 con 0x7f378c0741e0 2024-04-25T12:23:25.756 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.749+0000 7f37942a1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f378c0c9400 con 0x7f378c0c8910 2024-04-25T12:23:25.756 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.749+0000 7f37942a1640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f378c1597d0 con 0x7f378c073e00 2024-04-25T12:23:25.756 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.749+0000 7f379183c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f378c0741e0 0x7f378c15baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:23:25.756 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.749+0000 7f379183c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f378c0741e0 0x7f378c15baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38432/0 (socket says 172.21.15.86:38432) 2024-04-25T12:23:25.757 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.749+0000 7f379183c640 1 -- 172.21.15.86:0/2814887267 learned_addr learned my addr 172.21.15.86:0/2814887267 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:23:25.757 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.749+0000 7f379203d640 1 --2- 172.21.15.86:0/2814887267 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f378c073e00 0x7f378c149570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:23:25.757 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.749+0000 7f379183c640 1 -- 172.21.15.86:0/2814887267 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f378c073e00 msgr2=0x7f378c149570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:23:25.757 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.749+0000 7f379283e640 1 --2- 172.21.15.86:0/2814887267 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f378c0c8910 0x7f378c15bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:23:25.757 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.749+0000 7f379183c640 1 --2- 172.21.15.86:0/2814887267 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f378c073e00 0x7f378c149570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:25.757 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.749+0000 7f379183c640 1 -- 172.21.15.86:0/2814887267 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f378c0c8910 msgr2=0x7f378c15bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:23:25.757 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.749+0000 7f379183c640 1 --2- 172.21.15.86:0/2814887267 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f378c0c8910 0x7f378c15bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:25.757 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.749+0000 7f379183c640 1 -- 172.21.15.86:0/2814887267 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f378c149ab0 con 0x7f378c0741e0 2024-04-25T12:23:25.758 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.749+0000 7f379203d640 1 --2- 172.21.15.86:0/2814887267 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f378c073e00 0x7f378c149570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:23:25.758 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.749+0000 7f379183c640 1 --2- 172.21.15.86:0/2814887267 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f378c0741e0 0x7f378c15baa0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f377c00c820 tx=0x7f377c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:23:25.758 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.749+0000 7f3782ffd640 1 -- 172.21.15.86:0/2814887267 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f377c004230 con 0x7f378c0741e0 2024-04-25T12:23:25.758 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.753+0000 7f3782ffd640 1 -- 172.21.15.86:0/2814887267 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f377c0043d0 con 0x7f378c0741e0 2024-04-25T12:23:25.758 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.753+0000 7f37942a1640 1 -- 172.21.15.86:0/2814887267 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f378c15c5f0 con 0x7f378c0741e0 2024-04-25T12:23:25.758 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.753+0000 7f3782ffd640 1 -- 172.21.15.86:0/2814887267 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f377c007a30 con 0x7f378c0741e0 2024-04-25T12:23:25.758 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.753+0000 7f37942a1640 1 -- 172.21.15.86:0/2814887267 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f378c15c890 con 0x7f378c0741e0 2024-04-25T12:23:25.758 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.753+0000 7f37942a1640 1 -- 172.21.15.86:0/2814887267 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f378c075e60 con 0x7f378c0741e0 2024-04-25T12:23:25.759 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.753+0000 7f3782ffd640 1 -- 172.21.15.86:0/2814887267 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f377c007bd0 con 0x7f378c0741e0 2024-04-25T12:23:25.759 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.753+0000 7f3782ffd640 1 --2- 172.21.15.86:0/2814887267 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f3770068380 0x7f377006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:23:25.760 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.753+0000 7f379203d640 1 --2- 172.21.15.86:0/2814887267 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f3770068380 0x7f377006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:23:25.760 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.753+0000 7f3782ffd640 1 -- 172.21.15.86:0/2814887267 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 7165+0+0 (secure 0 0 0) 0x7f377c087000 con 0x7f378c0741e0 2024-04-25T12:23:25.760 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.753+0000 7f379203d640 1 --2- 172.21.15.86:0/2814887267 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f3770068380 0x7f377006a840 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f378800b840 tx=0x7f3788008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:23:25.761 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.757+0000 7f3782ffd640 1 -- 172.21.15.86:0/2814887267 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f377c015020 con 0x7f378c0741e0 2024-04-25T12:23:25.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:25.905+0000 7f37942a1640 1 -- 172.21.15.86:0/2814887267 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f378c15d320 con 0x7f378c0741e0 2024-04-25T12:23:26.563 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.561+0000 7f3782ffd640 1 -- 172.21.15.86:0/2814887267 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v28) ==== 181+0+0 (secure 0 0 0) 0x7f377c056f80 con 0x7f378c0741e0 2024-04-25T12:23:26.563 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_metadata' removed 2024-04-25T12:23:26.566 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.561+0000 7f37942a1640 1 -- 172.21.15.86:0/2814887267 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f3770068380 msgr2=0x7f377006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:23:26.566 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.561+0000 7f37942a1640 1 --2- 172.21.15.86:0/2814887267 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f3770068380 0x7f377006a840 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f378800b840 tx=0x7f3788008040 comp rx=0 tx=0).stop 2024-04-25T12:23:26.566 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.561+0000 7f37942a1640 1 -- 172.21.15.86:0/2814887267 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f378c0741e0 msgr2=0x7f378c15baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:23:26.566 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.561+0000 7f37942a1640 1 --2- 172.21.15.86:0/2814887267 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f378c0741e0 0x7f378c15baa0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f377c00c820 tx=0x7f377c00cce0 comp rx=0 tx=0).stop 2024-04-25T12:23:26.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.561+0000 7f37942a1640 1 -- 172.21.15.86:0/2814887267 shutdown_connections 2024-04-25T12:23:26.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.561+0000 7f37942a1640 1 --2- 172.21.15.86:0/2814887267 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f378c0c8910 0x7f378c15bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:26.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.561+0000 7f37942a1640 1 --2- 172.21.15.86:0/2814887267 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f3770068380 0x7f377006a840 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:26.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.561+0000 7f37942a1640 1 --2- 172.21.15.86:0/2814887267 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f378c0741e0 0x7f378c15baa0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:26.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.561+0000 7f37942a1640 1 --2- 172.21.15.86:0/2814887267 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f378c073e00 0x7f378c149570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:26.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.561+0000 7f37942a1640 1 -- 172.21.15.86:0/2814887267 >> 172.21.15.86:0/2814887267 conn(0x7f378c06f430 msgr2=0x7f378c154330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:23:26.568 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.561+0000 7f37942a1640 1 -- 172.21.15.86:0/2814887267 shutdown_connections 2024-04-25T12:23:26.568 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.561+0000 7f37942a1640 1 -- 172.21.15.86:0/2814887267 wait complete. 2024-04-25T12:23:26.592 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T12:23:26.719 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.717+0000 7f6a21831640 1 Processor -- start 2024-04-25T12:23:26.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.717+0000 7f6a21831640 1 -- start start 2024-04-25T12:23:26.721 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.717+0000 7f6a21831640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6a1c06cdf0 0x7f6a1c073ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:23:26.721 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.717+0000 7f6a21831640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6a1c0741e0 0x7f6a1c0731c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:23:26.721 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.717+0000 7f6a21831640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a1c072670 con 0x7f6a1c155460 2024-04-25T12:23:26.721 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.717+0000 7f6a21831640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7f6a1c0c87c0 con 0x7f6a1c06cdf0 2024-04-25T12:23:26.722 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.717+0000 7f6a21831640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 -- 0x7f6a1c072440 con 0x7f6a1c0741e0 2024-04-25T12:23:26.722 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.717+0000 7f6a1a7fc640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6a1c06cdf0 0x7f6a1c073ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:23:26.722 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.717+0000 7f6a1a7fc640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6a1c06cdf0 0x7f6a1c073ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38438/0 (socket says 172.21.15.86:38438) 2024-04-25T12:23:26.722 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.717+0000 7f6a1a7fc640 1 -- 172.21.15.86:0/1497894 learned_addr learned my addr 172.21.15.86:0/1497894 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:23:26.722 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.717+0000 7f6a1b7fe640 1 --2- 172.21.15.86:0/1497894 >> v2:172.21.15.134:3300/0 conn(0x7f6a1c0741e0 0x7f6a1c0731c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:23:26.722 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.717+0000 7f6a1a7fc640 1 -- 172.21.15.86:0/1497894 >> v2:172.21.15.134:3300/0 conn(0x7f6a1c0741e0 msgr2=0x7f6a1c0731c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:23:26.722 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.717+0000 7f6a1a7fc640 1 --2- 172.21.15.86:0/1497894 >> v2:172.21.15.134:3300/0 conn(0x7f6a1c0741e0 0x7f6a1c0731c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:26.722 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.717+0000 7f6a1a7fc640 1 -- 172.21.15.86:0/1497894 >> v1:172.21.15.134:6789/0 conn(0x7f6a1c155460 legacy=0x7f6a1c0c80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:23:26.723 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.717+0000 7f6a1a7fc640 1 -- 172.21.15.86:0/1497894 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a1c072950 con 0x7f6a1c06cdf0 2024-04-25T12:23:26.723 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.721+0000 7f6a1a7fc640 1 --2- 172.21.15.86:0/1497894 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a1c06cdf0 0x7f6a1c073ca0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c070c60 tx=0x7f6a0401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caa10c22fbc6cb8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:23:26.724 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.721+0000 7f6a19ffb640 1 -- 172.21.15.86:0/1497894 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a040b0070 con 0x7f6a1c06cdf0 2024-04-25T12:23:26.724 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.721+0000 7f6a19ffb640 1 -- 172.21.15.86:0/1497894 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f6a040ab600 con 0x7f6a1c06cdf0 2024-04-25T12:23:26.724 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.721+0000 7f6a19ffb640 1 -- 172.21.15.86:0/1497894 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a040ab9f0 con 0x7f6a1c06cdf0 2024-04-25T12:23:26.725 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.721+0000 7f6a21831640 1 -- 172.21.15.86:0/1497894 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a1c06cdf0 msgr2=0x7f6a1c073ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:23:26.725 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.721+0000 7f6a21831640 1 --2- 172.21.15.86:0/1497894 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a1c06cdf0 0x7f6a1c073ca0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c070c60 tx=0x7f6a0401c4e0 comp rx=0 tx=0).stop 2024-04-25T12:23:26.725 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.721+0000 7f6a21831640 1 -- 172.21.15.86:0/1497894 shutdown_connections 2024-04-25T12:23:26.725 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.721+0000 7f6a21831640 1 --2- 172.21.15.86:0/1497894 >> v2:172.21.15.134:3300/0 conn(0x7f6a1c0741e0 0x7f6a1c0731c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:26.725 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.721+0000 7f6a21831640 1 --2- 172.21.15.86:0/1497894 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a1c06cdf0 0x7f6a1c073ca0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:26.725 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.721+0000 7f6a21831640 1 -- 172.21.15.86:0/1497894 >> 172.21.15.86:0/1497894 conn(0x7f6a1c0ca1b0 msgr2=0x7f6a1c0ca5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:23:26.725 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.721+0000 7f6a21831640 1 -- 172.21.15.86:0/1497894 shutdown_connections 2024-04-25T12:23:26.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.721+0000 7f6a21831640 1 -- 172.21.15.86:0/1497894 wait complete. 2024-04-25T12:23:26.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.721+0000 7f6a21831640 1 Processor -- start 2024-04-25T12:23:26.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.721+0000 7f6a21831640 1 -- start start 2024-04-25T12:23:26.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.725+0000 7f6a21831640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a1c06cdf0 0x7f6a1c1482b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:23:26.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.725+0000 7f6a21831640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6a1c0741e0 0x7f6a1c14f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:23:26.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.725+0000 7f6a21831640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a1c155460 0x7f6a1c148c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:23:26.729 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.725+0000 7f6a21831640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6a1c15bd90 con 0x7f6a1c06cdf0 2024-04-25T12:23:26.729 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.725+0000 7f6a21831640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6a1c1680a0 con 0x7f6a1c155460 2024-04-25T12:23:26.729 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.725+0000 7f6a21831640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7f6a1c1f7bf0 con 0x7f6a1c0741e0 2024-04-25T12:23:26.729 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.725+0000 7f6a1affd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a1c06cdf0 0x7f6a1c1482b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:23:26.729 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.725+0000 7f6a1affd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a1c06cdf0 0x7f6a1c1482b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38454/0 (socket says 172.21.15.86:38454) 2024-04-25T12:23:26.729 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.725+0000 7f6a1affd640 1 -- 172.21.15.86:0/2410401771 learned_addr learned my addr 172.21.15.86:0/2410401771 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:23:26.729 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.725+0000 7f6a1b7fe640 1 --2- 172.21.15.86:0/2410401771 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a1c155460 0x7f6a1c148c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:23:26.729 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.725+0000 7f6a1a7fc640 1 --2- 172.21.15.86:0/2410401771 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6a1c0741e0 0x7f6a1c14f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:23:26.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.725+0000 7f6a1affd640 1 -- 172.21.15.86:0/2410401771 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6a1c0741e0 msgr2=0x7f6a1c14f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:23:26.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.725+0000 7f6a1affd640 1 --2- 172.21.15.86:0/2410401771 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6a1c0741e0 0x7f6a1c14f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:26.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.725+0000 7f6a1affd640 1 -- 172.21.15.86:0/2410401771 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a1c155460 msgr2=0x7f6a1c148c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:23:26.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.725+0000 7f6a1affd640 1 --2- 172.21.15.86:0/2410401771 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a1c155460 0x7f6a1c148c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:26.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.725+0000 7f6a1affd640 1 -- 172.21.15.86:0/2410401771 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a1c1f7e40 con 0x7f6a1c06cdf0 2024-04-25T12:23:26.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.725+0000 7f6a1affd640 1 --2- 172.21.15.86:0/2410401771 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a1c06cdf0 0x7f6a1c1482b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f6a1400ba80 tx=0x7f6a1400bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:23:26.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.725+0000 7f6a13fff640 1 -- 172.21.15.86:0/2410401771 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a1400cc00 con 0x7f6a1c06cdf0 2024-04-25T12:23:26.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.725+0000 7f6a13fff640 1 -- 172.21.15.86:0/2410401771 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f6a1400cda0 con 0x7f6a1c06cdf0 2024-04-25T12:23:26.731 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.725+0000 7f6a21831640 1 -- 172.21.15.86:0/2410401771 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a1c1f8120 con 0x7f6a1c06cdf0 2024-04-25T12:23:26.731 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.725+0000 7f6a13fff640 1 -- 172.21.15.86:0/2410401771 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a14003be0 con 0x7f6a1c06cdf0 2024-04-25T12:23:26.731 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.725+0000 7f6a21831640 1 -- 172.21.15.86:0/2410401771 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a1c1f86e0 con 0x7f6a1c06cdf0 2024-04-25T12:23:26.732 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.725+0000 7f6a21831640 1 -- 172.21.15.86:0/2410401771 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a1c1f4680 con 0x7f6a1c06cdf0 2024-04-25T12:23:26.732 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.725+0000 7f6a13fff640 1 -- 172.21.15.86:0/2410401771 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6a14006d10 con 0x7f6a1c06cdf0 2024-04-25T12:23:26.732 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.725+0000 7f6a13fff640 1 --2- 172.21.15.86:0/2410401771 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f69fc068380 0x7f69fc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:23:26.732 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.725+0000 7f6a13fff640 1 -- 172.21.15.86:0/2410401771 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6727+0+0 (secure 0 0 0) 0x7f6a140869f0 con 0x7f6a1c06cdf0 2024-04-25T12:23:26.732 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.725+0000 7f6a1a7fc640 1 --2- 172.21.15.86:0/2410401771 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f69fc068380 0x7f69fc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:23:26.732 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.725+0000 7f6a1a7fc640 1 --2- 172.21.15.86:0/2410401771 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f69fc068380 0x7f69fc06a840 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6a040ad000 tx=0x7f6a04008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:23:26.734 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.729+0000 7f6a13fff640 1 -- 172.21.15.86:0/2410401771 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6a1c1f4680 con 0x7f6a1c06cdf0 2024-04-25T12:23:26.916 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:26.913+0000 7f6a21831640 1 -- 172.21.15.86:0/2410401771 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f6a1c075e60 con 0x7f6a1c06cdf0 2024-04-25T12:23:27.566 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.561+0000 7f6a13fff640 1 -- 172.21.15.86:0/2410401771 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v29) ==== 169+0+0 (secure 0 0 0) 0x7f6a14056bb0 con 0x7f6a1c06cdf0 2024-04-25T12:23:27.566 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_data' removed 2024-04-25T12:23:27.570 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.565+0000 7f6a21831640 1 -- 172.21.15.86:0/2410401771 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f69fc068380 msgr2=0x7f69fc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:23:27.570 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.565+0000 7f6a21831640 1 --2- 172.21.15.86:0/2410401771 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f69fc068380 0x7f69fc06a840 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6a040ad000 tx=0x7f6a04008040 comp rx=0 tx=0).stop 2024-04-25T12:23:27.570 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.565+0000 7f6a21831640 1 -- 172.21.15.86:0/2410401771 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a1c06cdf0 msgr2=0x7f6a1c1482b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:23:27.570 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.565+0000 7f6a21831640 1 --2- 172.21.15.86:0/2410401771 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a1c06cdf0 0x7f6a1c1482b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f6a1400ba80 tx=0x7f6a1400bf40 comp rx=0 tx=0).stop 2024-04-25T12:23:27.570 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.565+0000 7f6a21831640 1 -- 172.21.15.86:0/2410401771 shutdown_connections 2024-04-25T12:23:27.570 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.565+0000 7f6a21831640 1 --2- 172.21.15.86:0/2410401771 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a1c155460 0x7f6a1c148c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:27.570 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.565+0000 7f6a21831640 1 --2- 172.21.15.86:0/2410401771 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6a1c0741e0 0x7f6a1c14f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:27.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.565+0000 7f6a21831640 1 --2- 172.21.15.86:0/2410401771 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7f69fc068380 0x7f69fc06a840 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:27.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.565+0000 7f6a21831640 1 --2- 172.21.15.86:0/2410401771 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a1c06cdf0 0x7f6a1c1482b0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:27.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.565+0000 7f6a21831640 1 -- 172.21.15.86:0/2410401771 >> 172.21.15.86:0/2410401771 conn(0x7f6a1c0ca1b0 msgr2=0x7f6a1c06c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:23:27.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.565+0000 7f6a21831640 1 -- 172.21.15.86:0/2410401771 shutdown_connections 2024-04-25T12:23:27.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.565+0000 7f6a21831640 1 -- 172.21.15.86:0/2410401771 wait complete. 2024-04-25T12:23:27.596 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-04-25T12:23:27.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.717+0000 7fb237029640 1 Processor -- start 2024-04-25T12:23:27.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.717+0000 7fb237029640 1 -- start start 2024-04-25T12:23:27.721 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.717+0000 7fb237029640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb23006b9d0 0x7fb230164740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:23:27.722 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.717+0000 7fb237029640 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb23006dd70 con 0x7fb23006e040 2024-04-25T12:23:27.722 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.717+0000 7fb237029640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2301597e0 con 0x7fb2301530a0 2024-04-25T12:23:27.722 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.717+0000 7fb237029640 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 -- 0x7fb230159d70 con 0x7fb23006b9d0 2024-04-25T12:23:27.722 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.717+0000 7fb2355c6640 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb23006b9d0 0x7fb230164740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:23:27.722 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.717+0000 7fb22ffff640 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fb23006e040 0x7fb2300c4bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:60058/0 (socket says 172.21.15.86:60058) 2024-04-25T12:23:27.722 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.717+0000 7fb22ffff640 1 -- 172.21.15.86:0/1161685640 learned_addr learned my addr 172.21.15.86:0/1161685640 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-04-25T12:23:27.722 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.717+0000 7fb22f7fe640 1 -- 172.21.15.86:0/1161685640 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3008361566 0 0) 0x7fb23006dd70 con 0x7fb23006e040 2024-04-25T12:23:27.723 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.717+0000 7fb22f7fe640 1 -- 172.21.15.86:0/1161685640 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb218003530 con 0x7fb23006e040 2024-04-25T12:23:27.723 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.717+0000 7fb2355c6640 1 -- 172.21.15.86:0/1161685640 >> v1:172.21.15.134:6789/0 conn(0x7fb2301530a0 legacy=0x7fb23015c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:23:27.723 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.717+0000 7fb2355c6640 1 -- 172.21.15.86:0/1161685640 >> v1:172.21.15.86:6789/0 conn(0x7fb23006e040 legacy=0x7fb2300c4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:23:27.723 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.717+0000 7fb2355c6640 1 -- 172.21.15.86:0/1161685640 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb230153480 con 0x7fb23006b9d0 2024-04-25T12:23:27.724 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.721+0000 7fb2355c6640 1 --2- 172.21.15.86:0/1161685640 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb23006b9d0 0x7fb230164740 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fb2200097c0 tx=0x7fb22001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=917cb3f45e2482f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:23:27.724 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.721+0000 7fb22f7fe640 1 -- 172.21.15.86:0/1161685640 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2200b0070 con 0x7fb23006b9d0 2024-04-25T12:23:27.724 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.721+0000 7fb22f7fe640 1 -- 172.21.15.86:0/1161685640 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fb220004230 con 0x7fb23006b9d0 2024-04-25T12:23:27.724 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.721+0000 7fb22f7fe640 1 -- 172.21.15.86:0/1161685640 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb220003620 con 0x7fb23006b9d0 2024-04-25T12:23:27.725 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.721+0000 7fb237029640 1 -- 172.21.15.86:0/1161685640 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb23006b9d0 msgr2=0x7fb230164740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:23:27.725 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.721+0000 7fb237029640 1 --2- 172.21.15.86:0/1161685640 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb23006b9d0 0x7fb230164740 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fb2200097c0 tx=0x7fb22001c460 comp rx=0 tx=0).stop 2024-04-25T12:23:27.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.721+0000 7fb237029640 1 -- 172.21.15.86:0/1161685640 shutdown_connections 2024-04-25T12:23:27.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.721+0000 7fb237029640 1 --2- 172.21.15.86:0/1161685640 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb23006b9d0 0x7fb230164740 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:27.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.721+0000 7fb237029640 1 -- 172.21.15.86:0/1161685640 >> 172.21.15.86:0/1161685640 conn(0x7fb2300ca1b0 msgr2=0x7fb2300ca5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:23:27.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.721+0000 7fb237029640 1 -- 172.21.15.86:0/1161685640 shutdown_connections 2024-04-25T12:23:27.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.721+0000 7fb237029640 1 -- 172.21.15.86:0/1161685640 wait complete. 2024-04-25T12:23:27.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.721+0000 7fb237029640 1 Processor -- start 2024-04-25T12:23:27.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.721+0000 7fb237029640 1 -- start start 2024-04-25T12:23:27.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.721+0000 7fb237029640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb23006b9d0 0x7fb230145360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:23:27.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.721+0000 7fb237029640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb23006e040 0x7fb2301f4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:23:27.729 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.721+0000 7fb237029640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2301530a0 0x7fb23014a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:23:27.729 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.721+0000 7fb237029640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb23015cab0 con 0x7fb23006e040 2024-04-25T12:23:27.729 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.721+0000 7fb237029640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb23006d570 con 0x7fb2301530a0 2024-04-25T12:23:27.729 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.721+0000 7fb237029640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 -- 0x7fb23006bdf0 con 0x7fb23006b9d0 2024-04-25T12:23:27.729 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.721+0000 7fb22ffff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb23006e040 0x7fb2301f4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:23:27.729 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.721+0000 7fb22ffff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb23006e040 0x7fb2301f4a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38474/0 (socket says 172.21.15.86:38474) 2024-04-25T12:23:27.729 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.721+0000 7fb22ffff640 1 -- 172.21.15.86:0/1124243708 learned_addr learned my addr 172.21.15.86:0/1124243708 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-04-25T12:23:27.729 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.725+0000 7fb2355c6640 1 --2- 172.21.15.86:0/1124243708 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2301530a0 0x7fb23014a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:23:27.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.725+0000 7fb234dc5640 1 --2- 172.21.15.86:0/1124243708 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb23006b9d0 0x7fb230145360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:23:27.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.725+0000 7fb22ffff640 1 -- 172.21.15.86:0/1124243708 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb23006b9d0 msgr2=0x7fb230145360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:23:27.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.725+0000 7fb22ffff640 1 --2- 172.21.15.86:0/1124243708 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb23006b9d0 0x7fb230145360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:27.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.725+0000 7fb22ffff640 1 -- 172.21.15.86:0/1124243708 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2301530a0 msgr2=0x7fb23014a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:23:27.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.725+0000 7fb22ffff640 1 --2- 172.21.15.86:0/1124243708 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2301530a0 0x7fb23014a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:27.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.725+0000 7fb22ffff640 1 -- 172.21.15.86:0/1124243708 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb230152770 con 0x7fb23006e040 2024-04-25T12:23:27.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.725+0000 7fb234dc5640 1 --2- 172.21.15.86:0/1124243708 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb23006b9d0 0x7fb230145360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:23:27.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.725+0000 7fb2355c6640 1 --2- 172.21.15.86:0/1124243708 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2301530a0 0x7fb23014a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:23:27.731 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.725+0000 7fb22ffff640 1 --2- 172.21.15.86:0/1124243708 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb23006e040 0x7fb2301f4a80 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fb22400cb40 tx=0x7fb22400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:23:27.731 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.725+0000 7fb22d7fa640 1 -- 172.21.15.86:0/1124243708 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb224017070 con 0x7fb23006e040 2024-04-25T12:23:27.731 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.725+0000 7fb22d7fa640 1 -- 172.21.15.86:0/1124243708 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fb22400aca0 con 0x7fb23006e040 2024-04-25T12:23:27.731 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.725+0000 7fb22d7fa640 1 -- 172.21.15.86:0/1124243708 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb224012640 con 0x7fb23006e040 2024-04-25T12:23:27.731 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.725+0000 7fb237029640 1 -- 172.21.15.86:0/1124243708 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2301458a0 con 0x7fb23006e040 2024-04-25T12:23:27.731 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.725+0000 7fb237029640 1 -- 172.21.15.86:0/1124243708 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb23015c540 con 0x7fb23006e040 2024-04-25T12:23:27.731 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.725+0000 7fb237029640 1 -- 172.21.15.86:0/1124243708 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb230075e60 con 0x7fb23006e040 2024-04-25T12:23:27.732 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.725+0000 7fb22d7fa640 1 -- 172.21.15.86:0/1124243708 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb22401a070 con 0x7fb23006e040 2024-04-25T12:23:27.732 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.725+0000 7fb22d7fa640 1 --2- 172.21.15.86:0/1124243708 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fb21c0683b0 0x7fb21c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:23:27.732 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.725+0000 7fb22d7fa640 1 -- 172.21.15.86:0/1124243708 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6197+0+0 (secure 0 0 0) 0x7fb2240869c0 con 0x7fb23006e040 2024-04-25T12:23:27.732 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.725+0000 7fb234dc5640 1 --2- 172.21.15.86:0/1124243708 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fb21c0683b0 0x7fb21c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:23:27.732 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.725+0000 7fb234dc5640 1 --2- 172.21.15.86:0/1124243708 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fb21c0683b0 0x7fb21c06a870 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb22800a850 tx=0x7fb228008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:23:27.733 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.729+0000 7fb22d7fa640 1 -- 172.21.15.86:0/1124243708 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb224088e20 con 0x7fb23006e040 2024-04-25T12:23:27.901 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:27.897+0000 7fb237029640 1 -- 172.21.15.86:0/1124243708 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb23006c3c0 con 0x7fb23006e040 2024-04-25T12:23:28.593 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:28.589+0000 7fb22d7fa640 1 -- 172.21.15.86:0/1124243708 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v30) ==== 178+0+0 (secure 0 0 0) 0x7fb224056d90 con 0x7fb23006e040 2024-04-25T12:23:28.594 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_data_ec' removed 2024-04-25T12:23:28.601 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:28.597+0000 7fb237029640 1 -- 172.21.15.86:0/1124243708 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fb21c0683b0 msgr2=0x7fb21c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:23:28.601 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:28.597+0000 7fb237029640 1 --2- 172.21.15.86:0/1124243708 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fb21c0683b0 0x7fb21c06a870 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb22800a850 tx=0x7fb228008040 comp rx=0 tx=0).stop 2024-04-25T12:23:28.601 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:28.597+0000 7fb237029640 1 -- 172.21.15.86:0/1124243708 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb23006e040 msgr2=0x7fb2301f4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:23:28.601 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:28.597+0000 7fb237029640 1 --2- 172.21.15.86:0/1124243708 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb23006e040 0x7fb2301f4a80 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fb22400cb40 tx=0x7fb22400a060 comp rx=0 tx=0).stop 2024-04-25T12:23:28.602 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:28.597+0000 7fb237029640 1 -- 172.21.15.86:0/1124243708 shutdown_connections 2024-04-25T12:23:28.602 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:28.597+0000 7fb237029640 1 --2- 172.21.15.86:0/1124243708 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2301530a0 0x7fb23014a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:28.602 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:28.597+0000 7fb237029640 1 --2- 172.21.15.86:0/1124243708 >> [v2:172.21.15.86:6832/3708662606,v1:172.21.15.86:6833/3708662606] conn(0x7fb21c0683b0 0x7fb21c06a870 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:28.602 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:28.597+0000 7fb237029640 1 --2- 172.21.15.86:0/1124243708 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb23006e040 0x7fb2301f4a80 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:28.602 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:28.597+0000 7fb237029640 1 --2- 172.21.15.86:0/1124243708 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb23006b9d0 0x7fb230145360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:23:28.603 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:28.597+0000 7fb237029640 1 -- 172.21.15.86:0/1124243708 >> 172.21.15.86:0/1124243708 conn(0x7fb2300ca1b0 msgr2=0x7fb2300cbc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:23:28.603 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:28.597+0000 7fb237029640 1 -- 172.21.15.86:0/1124243708 shutdown_connections 2024-04-25T12:23:28.603 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-25T12:23:28.597+0000 7fb237029640 1 -- 172.21.15.86:0/1124243708 wait complete. 2024-04-25T12:23:28.627 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-25T12:23:28.628 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T12:23:28.628 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T12:23:28.639 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T12:23:28.639 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T12:23:28.639 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T12:23:28.693 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T12:23:28.693 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-04-25T12:23:28.693 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T12:23:28.750 INFO:tasks.ceph.mds.e:Stopped 2024-04-25T12:23:28.750 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T12:23:28.750 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T12:23:28.766 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T12:23:28.766 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T12:23:28.766 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T12:23:28.821 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T12:23:28.821 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-04-25T12:23:28.821 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T12:23:28.880 INFO:tasks.ceph.mds.f:Stopped 2024-04-25T12:23:28.880 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-25T12:23:28.880 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-25T12:23:28.880 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T12:23:28.952 INFO:tasks.ceph.osd.0:Stopped 2024-04-25T12:23:28.952 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-25T12:23:28.952 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T12:23:29.032 INFO:tasks.ceph.osd.1:Stopped 2024-04-25T12:23:29.032 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-25T12:23:29.032 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T12:23:29.107 INFO:tasks.ceph.osd.2:Stopped 2024-04-25T12:23:29.108 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-25T12:23:29.108 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T12:23:29.181 INFO:tasks.ceph.osd.3:Stopped 2024-04-25T12:23:29.182 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-25T12:23:29.182 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T12:23:29.262 INFO:tasks.ceph.osd.4:Stopped 2024-04-25T12:23:29.263 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-25T12:23:29.263 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T12:23:29.334 INFO:tasks.ceph.osd.5:Stopped 2024-04-25T12:23:29.335 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-25T12:23:29.335 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T12:23:29.422 INFO:tasks.ceph.osd.6:Stopped 2024-04-25T12:23:29.422 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-25T12:23:29.422 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T12:23:29.518 INFO:tasks.ceph.osd.7:Stopped 2024-04-25T12:23:29.519 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-25T12:23:29.519 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-25T12:23:29.519 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T12:23:29.549 INFO:tasks.ceph.mgr.y:Stopped 2024-04-25T12:23:29.549 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-25T12:23:29.549 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T12:23:29.578 INFO:tasks.ceph.mgr.x:Stopped 2024-04-25T12:23:29.578 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-25T12:23:29.578 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-25T12:23:29.578 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T12:23:29.607 INFO:tasks.ceph.mon.a:Stopped 2024-04-25T12:23:29.607 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-25T12:23:29.607 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T12:23:29.635 INFO:tasks.ceph.mon.b:Stopped 2024-04-25T12:23:29.635 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-25T12:23:29.635 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T12:23:29.694 INFO:tasks.ceph.mon.c:Stopped 2024-04-25T12:23:29.694 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-25T12:23:29.695 DEBUG:teuthology.orchestra.run.smithi086:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | head -n 1 2024-04-25T12:23:29.719 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi086.front.sepia.ceph.com 2024-04-25T12:23:29.719 DEBUG:teuthology.orchestra.run.smithi086:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-25T12:23:30.231 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi086.front.sepia.ceph.com 2024-04-25T12:23:30.232 DEBUG:teuthology.orchestra.run.smithi086:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-25T12:23:30.449 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi086.front.sepia.ceph.com 2024-04-25T12:23:30.449 DEBUG:teuthology.orchestra.run.smithi086:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-25T12:23:30.639 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi086.front.sepia.ceph.com 2024-04-25T12:23:30.639 DEBUG:teuthology.orchestra.run.smithi086:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-25T12:23:30.823 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi134.front.sepia.ceph.com 2024-04-25T12:23:30.823 DEBUG:teuthology.orchestra.run.smithi134:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-25T12:23:31.282 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi134.front.sepia.ceph.com 2024-04-25T12:23:31.282 DEBUG:teuthology.orchestra.run.smithi134:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-25T12:23:31.472 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi134.front.sepia.ceph.com 2024-04-25T12:23:31.472 DEBUG:teuthology.orchestra.run.smithi134:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-25T12:23:31.638 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi134.front.sepia.ceph.com 2024-04-25T12:23:31.638 DEBUG:teuthology.orchestra.run.smithi134:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-25T12:23:31.823 INFO:tasks.ceph:Archiving mon data... 2024-04-25T12:23:31.824 DEBUG:teuthology.misc:Transferring archived files from smithi086:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/leonidus-2024-04-25_11:13:36-fs-wip-lusov-quiescer-distro-default-smithi/7673357/data/mon.a.tgz 2024-04-25T12:23:31.824 DEBUG:teuthology.orchestra.run.smithi086:> mktemp 2024-04-25T12:23:31.830 INFO:teuthology.orchestra.run.smithi086.stdout:/tmp/tmp.PcgYbNz9ig 2024-04-25T12:23:31.830 DEBUG:teuthology.orchestra.run.smithi086:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.PcgYbNz9ig 2024-04-25T12:23:31.948 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 0666 /tmp/tmp.PcgYbNz9ig 2024-04-25T12:23:32.012 DEBUG:teuthology.orchestra.remote:smithi086:/tmp/tmp.PcgYbNz9ig is 284KB 2024-04-25T12:23:32.073 DEBUG:teuthology.orchestra.run.smithi086:> rm -fr /tmp/tmp.PcgYbNz9ig 2024-04-25T12:23:32.078 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/leonidus-2024-04-25_11:13:36-fs-wip-lusov-quiescer-distro-default-smithi/7673357/data/mon.b.tgz 2024-04-25T12:23:32.078 DEBUG:teuthology.orchestra.run.smithi134:> mktemp 2024-04-25T12:23:32.084 INFO:teuthology.orchestra.run.smithi134.stdout:/tmp/tmp.ln3p9Vx8Bs 2024-04-25T12:23:32.084 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.ln3p9Vx8Bs 2024-04-25T12:23:32.224 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0666 /tmp/tmp.ln3p9Vx8Bs 2024-04-25T12:23:32.289 DEBUG:teuthology.orchestra.remote:smithi134:/tmp/tmp.ln3p9Vx8Bs is 388KB 2024-04-25T12:23:32.351 DEBUG:teuthology.orchestra.run.smithi134:> rm -fr /tmp/tmp.ln3p9Vx8Bs 2024-04-25T12:23:32.356 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/leonidus-2024-04-25_11:13:36-fs-wip-lusov-quiescer-distro-default-smithi/7673357/data/mon.c.tgz 2024-04-25T12:23:32.356 DEBUG:teuthology.orchestra.run.smithi134:> mktemp 2024-04-25T12:23:32.405 INFO:teuthology.orchestra.run.smithi134.stdout:/tmp/tmp.PfkPG4cAg7 2024-04-25T12:23:32.406 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.PfkPG4cAg7 2024-04-25T12:23:32.537 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0666 /tmp/tmp.PfkPG4cAg7 2024-04-25T12:23:32.603 DEBUG:teuthology.orchestra.remote:smithi134:/tmp/tmp.PfkPG4cAg7 is 388KB 2024-04-25T12:23:32.663 DEBUG:teuthology.orchestra.run.smithi134:> rm -fr /tmp/tmp.PfkPG4cAg7 2024-04-25T12:23:32.669 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-25T12:23:32.670 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T12:23:32.672 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T12:23:32.731 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T12:23:32.773 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T12:23:32.773 INFO:tasks.ceph:Archiving crash dumps... 2024-04-25T12:23:32.775 DEBUG:teuthology.misc:Transferring archived files from smithi086:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-04-25_11:13:36-fs-wip-lusov-quiescer-distro-default-smithi/7673357/remote/smithi086/crash 2024-04-25T12:23:32.776 DEBUG:teuthology.orchestra.run.smithi086:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T12:23:32.789 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-04-25_11:13:36-fs-wip-lusov-quiescer-distro-default-smithi/7673357/remote/smithi134/crash 2024-04-25T12:23:32.790 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T12:23:32.829 INFO:tasks.ceph:Shutting down logrotate 2024-04-25T12:23:32.830 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T12:23:32.836 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T12:23:32.902 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-25T12:23:32.934 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-25T12:23:32.956 INFO:tasks.ceph:Compressing logs... 2024-04-25T12:23:32.957 DEBUG:teuthology.orchestra.run.smithi086:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T12:23:32.980 DEBUG:teuthology.orchestra.run.smithi134:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T12:23:33.003 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35457.log 2024-04-25T12:23:33.003 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35717.log 2024-04-25T12:23:33.003 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.35457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33288.log 2024-04-25T12:23:33.005 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36705.log 2024-04-25T12:23:33.005 INFO:teuthology.orchestra.run.smithi086.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.35457.log.gz 2024-04-25T12:23:33.005 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.35717.log: /var/log/ceph/ceph-client.admin.33288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35284.log 2024-04-25T12:23:33.005 INFO:teuthology.orchestra.run.smithi086.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33288.log.gz 2024-04-25T12:23:33.005 INFO:teuthology.orchestra.run.smithi086.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35717.log.gz 2024-04-25T12:23:33.006 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34289.log 2024-04-25T12:23:33.006 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.36705.log: /var/log/ceph/ceph-client.admin.35284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37422.log 2024-04-25T12:23:33.006 INFO:teuthology.orchestra.run.smithi086.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35284.log.gz 2024-04-25T12:23:33.014 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.34289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36533.log 2024-04-25T12:23:33.015 INFO:teuthology.orchestra.run.smithi086.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.34289.log.gz 2024-04-25T12:23:33.015 INFO:teuthology.orchestra.run.smithi086.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36705.log.gz 2024-04-25T12:23:33.015 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.37422.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-25T12:23:33.015 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.36533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35100.log 2024-04-25T12:23:33.015 INFO:teuthology.orchestra.run.smithi086.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37422.log.gz 2024-04-25T12:23:33.015 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-mgr.y.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36533.log.gz 2024-04-25T12:23:33.015 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37175.log 2024-04-25T12:23:33.015 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.35100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35743.log 2024-04-25T12:23:33.016 INFO:teuthology.orchestra.run.smithi086.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35100.log.gz 2024-04-25T12:23:33.016 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.37175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36679.log 2024-04-25T12:23:33.016 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.35743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34346.log 2024-04-25T12:23:33.016 INFO:teuthology.orchestra.run.smithi086.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37175.log.gz 2024-04-25T12:23:33.016 INFO:teuthology.orchestra.run.smithi086.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.35743.log.gz 2024-04-25T12:23:33.016 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.36679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33504.log 2024-04-25T12:23:33.016 INFO:teuthology.orchestra.run.smithi086.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36679.log.gz 2024-04-25T12:23:33.016 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.34346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35795.log 2024-04-25T12:23:33.017 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.33504.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-25T12:23:33.017 INFO:teuthology.orchestra.run.smithi086.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34346.log.gz 2024-04-25T12:23:33.017 INFO:teuthology.orchestra.run.smithi086.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33504.log.gz 2024-04-25T12:23:33.017 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.35795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34687.log 2024-04-25T12:23:33.017 INFO:teuthology.orchestra.run.smithi086.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35795.log.gz 2024-04-25T12:23:33.017 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36376.log 2024-04-25T12:23:33.017 INFO:teuthology.orchestra.run.smithi086.stderr:gzip/var/log/ceph/ceph-client.admin.34687.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.33394.log 2024-04-25T12:23:33.017 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.36376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37121.log 2024-04-25T12:23:33.018 INFO:teuthology.orchestra.run.smithi086.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34687.log.gz 2024-04-25T12:23:33.018 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.33394.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36376.log.gz 2024-04-25T12:23:33.018 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33168.log 2024-04-25T12:23:33.018 INFO:teuthology.orchestra.run.smithi086.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33394.log.gz 2024-04-25T12:23:33.018 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.37121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33204.log 2024-04-25T12:23:33.018 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.33168.log: gzip -5 --verbose -- 87.8% /var/log/ceph/ceph-client.admin.34877.log -- replaced with /var/log/ceph/ceph-client.admin.37121.log.gz 2024-04-25T12:23:33.018 INFO:teuthology.orchestra.run.smithi086.stderr: 2024-04-25T12:23:33.018 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.33204.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33168.log.gz 2024-04-25T12:23:33.019 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34372.log 2024-04-25T12:23:33.019 INFO:teuthology.orchestra.run.smithi086.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33204.log.gz 2024-04-25T12:23:33.019 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.34877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34608.log 2024-04-25T12:23:33.019 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.34372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33740.log 2024-04-25T12:23:33.019 INFO:teuthology.orchestra.run.smithi086.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34877.log.gz 2024-04-25T12:23:33.019 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.34608.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34372.log.gz 2024-04-25T12:23:33.019 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33766.log 2024-04-25T12:23:33.020 INFO:teuthology.orchestra.run.smithi086.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34608.log.gz 2024-04-25T12:23:33.020 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.33740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34132.log 2024-04-25T12:23:33.020 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.33766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34675.log 2024-04-25T12:23:33.020 INFO:teuthology.orchestra.run.smithi086.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33740.log.gz 2024-04-25T12:23:33.020 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.34132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36627.log 2024-04-25T12:23:33.020 INFO:teuthology.orchestra.run.smithi086.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34132.log.gz 2024-04-25T12:23:33.020 INFO:teuthology.orchestra.run.smithi086.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.33766.log.gz 2024-04-25T12:23:33.020 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.34675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37226.log 2024-04-25T12:23:33.038 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-25T12:23:33.038 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-25T12:23:33.038 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27702.log 2024-04-25T12:23:33.038 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27822.log 2024-04-25T12:23:33.038 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.27702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27846.log 2024-04-25T12:23:33.038 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.27822.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.27702.log.gz 2024-04-25T12:23:33.038 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-25T12:23:33.039 INFO:teuthology.orchestra.run.smithi134.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.27822.log.gz 2024-04-25T12:23:33.039 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-25T12:23:33.039 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.27846.log: gzip -5 --verbose/var/log/ceph/ceph-osd.5.log: -- /var/log/ceph/ceph-mds.f.log 2024-04-25T12:23:33.039 INFO:teuthology.orchestra.run.smithi134.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.27846.log.gz 2024-04-25T12:23:33.039 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-25T12:23:33.039 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-25T12:23:33.040 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-mds.f.log: /var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27726.log 2024-04-25T12:23:33.040 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27750.log 2024-04-25T12:23:33.040 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-mon.c.log: /var/log/ceph/ceph-client.admin.27726.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.27726.log.gz 91.4% 2024-04-25T12:23:33.040 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph.log.gz 2024-04-25T12:23:33.040 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-25T12:23:33.040 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.27750.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-04-25T12:23:33.040 INFO:teuthology.orchestra.run.smithi134.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.27750.log.gz/var/log/ceph/ceph.audit.log: 2024-04-25T12:23:33.040 INFO:teuthology.orchestra.run.smithi134.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-25T12:23:33.040 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27774.log 2024-04-25T12:23:33.041 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-25T12:23:33.041 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.27774.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.27774.log.gz 2024-04-25T12:23:33.041 INFO:teuthology.orchestra.run.smithi134.stderr: 93.8%gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-25T12:23:33.041 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-25T12:23:33.041 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-25T12:23:33.054 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27798.log 2024-04-25T12:23:33.054 INFO:teuthology.orchestra.run.smithi134.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-25T12:23:33.054 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-osd.4.log: 91.1% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-25T12:23:33.054 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27678.log 2024-04-25T12:23:33.054 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.27798.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.27798.log.gz 2024-04-25T12:23:33.054 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.27678.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.27678.log.gz 2024-04-25T12:23:33.063 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.36627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34685.log 2024-04-25T12:23:33.063 INFO:teuthology.orchestra.run.smithi086.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34675.log.gz 2024-04-25T12:23:33.064 INFO:teuthology.orchestra.run.smithi086.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36627.log.gz 2024-04-25T12:23:33.064 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.37226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33610.log 2024-04-25T12:23:33.064 INFO:teuthology.orchestra.run.smithi086.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37226.log.gz 2024-04-25T12:23:33.064 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.34685.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-25T12:23:33.064 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.33610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36585.log 2024-04-25T12:23:33.064 INFO:teuthology.orchestra.run.smithi086.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34685.log.gz 2024-04-25T12:23:33.064 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-osd.2.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33610.log.gz 2024-04-25T12:23:33.064 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36861.log 2024-04-25T12:23:33.065 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.36585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35587.log 2024-04-25T12:23:33.065 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.36861.log: 89.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.36585.log.gz -5 2024-04-25T12:23:33.065 INFO:teuthology.orchestra.run.smithi086.stderr: --verbose -- /var/log/ceph/ceph-client.admin.34889.log 2024-04-25T12:23:33.065 INFO:teuthology.orchestra.run.smithi086.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36861.log.gz 2024-04-25T12:23:33.065 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.35587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34556.log 2024-04-25T12:23:33.065 INFO:teuthology.orchestra.run.smithi086.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35587.log.gz 2024-04-25T12:23:33.065 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.34889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34504.log 2024-04-25T12:23:33.065 INFO:teuthology.orchestra.run.smithi086.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34889.log.gz 2024-04-25T12:23:33.065 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.34556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34634.log 2024-04-25T12:23:33.066 INFO:teuthology.orchestra.run.smithi086.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34556.log.gz 2024-04-25T12:23:33.066 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.34504.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-25T12:23:33.066 INFO:teuthology.orchestra.run.smithi086.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34504.log.gz 2024-04-25T12:23:33.066 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.34634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34582.log 2024-04-25T12:23:33.066 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35396.log 2024-04-25T12:23:33.066 INFO:teuthology.orchestra.run.smithi086.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34634.log.gz 2024-04-25T12:23:33.066 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.34582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36298.log 2024-04-25T12:23:33.066 INFO:teuthology.orchestra.run.smithi086.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34582.log.gz 2024-04-25T12:23:33.067 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.35396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37147.log 2024-04-25T12:23:33.067 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34671.log 2024-04-25T12:23:33.067 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.36298.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.35396.log.gz 2024-04-25T12:23:33.067 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.37147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34185.log 2024-04-25T12:23:33.067 INFO:teuthology.orchestra.run.smithi086.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36298.log.gz 2024-04-25T12:23:33.067 INFO:teuthology.orchestra.run.smithi086.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37147.log.gz 2024-04-25T12:23:33.067 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.34671.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34671.log.gz 2024-04-25T12:23:33.067 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36428.log 2024-04-25T12:23:33.067 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33368.log 2024-04-25T12:23:33.068 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.34185.log: /var/log/ceph/ceph-client.admin.36428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36809.log 2024-04-25T12:23:33.068 INFO:teuthology.orchestra.run.smithi086.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34185.log.gz 2024-04-25T12:23:33.068 INFO:teuthology.orchestra.run.smithi086.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36428.log.gz 2024-04-25T12:23:33.068 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.33368.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.33368.log.gz 2024-04-25T12:23:33.068 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36243.log 2024-04-25T12:23:33.068 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.36809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36991.log 2024-04-25T12:23:33.068 INFO:teuthology.orchestra.run.smithi086.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36809.log.gz 2024-04-25T12:23:33.068 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.0.36243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37095.log 2024-04-25T12:23:33.069 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.36991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36324.log 2024-04-25T12:23:33.069 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.37095.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36991.log.gz 2024-04-25T12:23:33.069 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35535.log 2024-04-25T12:23:33.069 INFO:teuthology.orchestra.run.smithi086.stderr: 89.6% 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37095.log.gz 2024-04-25T12:23:33.069 INFO:teuthology.orchestra.run.smithi086.stderr: -- replaced with /var/log/ceph/ceph-client.0.36243.log.gz/var/log/ceph/ceph-client.admin.36324.log: 2024-04-25T12:23:33.069 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36913.log 2024-04-25T12:23:33.069 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.35535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37254.log 2024-04-25T12:23:33.069 INFO:teuthology.orchestra.run.smithi086.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36324.log.gz 2024-04-25T12:23:33.070 INFO:teuthology.orchestra.run.smithi086.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35535.log.gz 2024-04-25T12:23:33.070 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.36913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34896.log 2024-04-25T12:23:33.070 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.37254.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36913.log.gz 2024-04-25T12:23:33.070 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34159.log 2024-04-25T12:23:33.070 INFO:teuthology.orchestra.run.smithi086.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37254.log.gz 2024-04-25T12:23:33.070 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.34896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33714.log 2024-04-25T12:23:33.070 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34894.log 2024-04-25T12:23:33.070 INFO:teuthology.orchestra.run.smithi086.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34896.log.gz 2024-04-25T12:23:33.071 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.34159.log: /var/log/ceph/ceph-client.admin.33714.log: gzip 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34159.log.gz -5 2024-04-25T12:23:33.071 INFO:teuthology.orchestra.run.smithi086.stderr: --verbose -- /var/log/ceph/ceph-client.admin.36653.log 2024-04-25T12:23:33.071 INFO:teuthology.orchestra.run.smithi086.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33714.log.gz 2024-04-25T12:23:33.071 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.34894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35076.log 2024-04-25T12:23:33.071 INFO:teuthology.orchestra.run.smithi086.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34894.log.gz 2024-04-25T12:23:33.071 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.36653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35769.log 2024-04-25T12:23:33.072 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.35076.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36653.log.gz 2024-04-25T12:23:33.072 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-25T12:23:33.072 INFO:teuthology.orchestra.run.smithi086.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35076.log.gz 2024-04-25T12:23:33.072 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.35769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36835.log 2024-04-25T12:23:33.072 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35613.log 2024-04-25T12:23:33.072 INFO:teuthology.orchestra.run.smithi086.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.35769.log.gz 2024-04-25T12:23:33.072 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-osd.3.log: /var/log/ceph/ceph-client.admin.36835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27688.log 2024-04-25T12:23:33.072 INFO:teuthology.orchestra.run.smithi086.stderr: 89.4%/var/log/ceph/ceph-client.admin.35613.log: -- replaced with /var/log/ceph/ceph-client.admin.36835.log.gz 2024-04-25T12:23:33.072 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33688.log 2024-04-25T12:23:33.073 INFO:teuthology.orchestra.run.smithi086.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35613.log.gz 2024-04-25T12:23:33.073 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.27688.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.27688.log.gz 2024-04-25T12:23:33.073 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34237.log 2024-04-25T12:23:33.073 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.33688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34002.log 2024-04-25T12:23:33.073 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.34237.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.33688.log.gz 2024-04-25T12:23:33.073 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35665.log 2024-04-25T12:23:33.073 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34895.log 2024-04-25T12:23:33.073 INFO:teuthology.orchestra.run.smithi086.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34237.log.gz 2024-04-25T12:23:33.074 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.34002.log: /var/log/ceph/ceph-client.admin.35665.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35665.log.gz 2024-04-25T12:23:33.074 INFO:teuthology.orchestra.run.smithi086.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34002.log.gz 2024-04-25T12:23:33.074 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34211.log 2024-04-25T12:23:33.074 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.34895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35095.log 2024-04-25T12:23:33.074 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.34211.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34895.log.gz 2024-04-25T12:23:33.074 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34677.log 2024-04-25T12:23:33.074 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-25T12:23:33.074 INFO:teuthology.orchestra.run.smithi086.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34211.log.gz 2024-04-25T12:23:33.075 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.35095.log: /var/log/ceph/ceph-client.admin.34677.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.35095.log.gz 2024-04-25T12:23:33.075 INFO:teuthology.orchestra.run.smithi086.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34677.log.gz 2024-04-25T12:23:33.075 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35691.log 2024-04-25T12:23:33.075 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35310.log 2024-04-25T12:23:33.075 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-osd.1.log: /var/log/ceph/ceph-client.admin.35691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35097.log 2024-04-25T12:23:33.075 INFO:teuthology.orchestra.run.smithi086.stderr: 89.4%/var/log/ceph/ceph-client.admin.35310.log: -- replaced with /var/log/ceph/ceph-client.admin.35691.log.gz 2024-04-25T12:23:33.076 INFO:teuthology.orchestra.run.smithi086.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35310.log.gz 2024-04-25T12:23:33.076 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33636.log 2024-04-25T12:23:33.076 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.35097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37069.log 2024-04-25T12:23:33.076 INFO:teuthology.orchestra.run.smithi086.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35097.log.gz/var/log/ceph/ceph-client.admin.33636.log: 2024-04-25T12:23:33.076 INFO:teuthology.orchestra.run.smithi086.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.33636.log.gz 2024-04-25T12:23:33.076 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35639.log 2024-04-25T12:23:33.076 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.37069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33420.log 2024-04-25T12:23:33.076 INFO:teuthology.orchestra.run.smithi086.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37069.log.gz/var/log/ceph/ceph-client.admin.35639.log: 2024-04-25T12:23:33.077 INFO:teuthology.orchestra.run.smithi086.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35639.log.gz 2024-04-25T12:23:33.077 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34028.log 2024-04-25T12:23:33.077 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.33420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34686.log 2024-04-25T12:23:33.077 INFO:teuthology.orchestra.run.smithi086.stderr: 88.9%/var/log/ceph/ceph-client.admin.34028.log: -- replaced with /var/log/ceph/ceph-client.admin.33420.log.gz 2024-04-25T12:23:33.077 INFO:teuthology.orchestra.run.smithi086.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.34028.log.gz 2024-04-25T12:23:33.077 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36116.log 2024-04-25T12:23:33.077 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.34686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35905.log 2024-04-25T12:23:33.078 INFO:teuthology.orchestra.run.smithi086.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34686.log.gz 2024-04-25T12:23:33.078 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.36116.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36116.log.gz 2024-04-25T12:23:33.078 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36783.log 2024-04-25T12:23:33.078 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.35905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36481.log 2024-04-25T12:23:33.078 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.36783.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.35905.log.gz 2024-04-25T12:23:33.078 INFO:teuthology.orchestra.run.smithi086.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36783.log.gz 2024-04-25T12:23:33.078 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35102.log 2024-04-25T12:23:33.078 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.36481.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.22764.log 2024-04-25T12:23:33.079 INFO:teuthology.orchestra.run.smithi086.stderr: 87.5%/var/log/ceph/ceph-client.admin.35102.log: -- replaced with /var/log/ceph/ceph-client.admin.36481.log.gz 2024-04-25T12:23:33.079 INFO:teuthology.orchestra.run.smithi086.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35102.log.gz 2024-04-25T12:23:33.079 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36507.log 2024-04-25T12:23:33.079 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph.tmp-client.admin.22764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34886.log 2024-04-25T12:23:33.079 INFO:teuthology.orchestra.run.smithi086.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.22764.log.gz 2024-04-25T12:23:33.079 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.36507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35509.log 2024-04-25T12:23:33.080 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.34886.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36507.log.gz 2024-04-25T12:23:33.080 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35826.log 2024-04-25T12:23:33.080 INFO:teuthology.orchestra.run.smithi086.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34886.log.gz 2024-04-25T12:23:33.080 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.35509.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35509.log.gz 2024-04-25T12:23:33.080 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36350.log 2024-04-25T12:23:33.080 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.35826.log: 91.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-25T12:23:33.080 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-25T12:23:33.081 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37017.log 2024-04-25T12:23:33.081 INFO:teuthology.orchestra.run.smithi086.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.35826.log.gz 2024-04-25T12:23:33.081 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.36350.log: /var/log/ceph/ceph.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.36350.log.gz 2024-04-25T12:23:33.081 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33530.log 2024-04-25T12:23:33.081 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.37017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37358.log 2024-04-25T12:23:33.081 INFO:teuthology.orchestra.run.smithi086.stderr: 85.0% -- replaced with /var/log/ceph/ceph.log.gz 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37017.log.gz 2024-04-25T12:23:33.081 INFO:teuthology.orchestra.run.smithi086.stderr: 2024-04-25T12:23:33.082 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.33530.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33530.log.gz 2024-04-25T12:23:33.082 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36965.log 2024-04-25T12:23:33.082 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33100.log/var/log/ceph/ceph-client.admin.37358.log: 2024-04-25T12:23:33.082 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.36965.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37358.log.gz 2024-04-25T12:23:33.082 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35423.log 2024-04-25T12:23:33.082 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36455.log 2024-04-25T12:23:33.083 INFO:teuthology.orchestra.run.smithi086.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36965.log.gz 2024-04-25T12:23:33.083 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.33100.log: /var/log/ceph/ceph-client.admin.35423.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33100.log.gz 2024-04-25T12:23:33.083 INFO:teuthology.orchestra.run.smithi086.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35423.log.gz 2024-04-25T12:23:33.083 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33556.log 2024-04-25T12:23:33.083 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.36455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34424.log 2024-04-25T12:23:33.083 INFO:teuthology.orchestra.run.smithi086.stderr: 89.5%/var/log/ceph/ceph-client.admin.33556.log: -- replaced with /var/log/ceph/ceph-client.admin.36455.log.gz 2024-04-25T12:23:33.083 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36402.log 2024-04-25T12:23:33.083 INFO:teuthology.orchestra.run.smithi086.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33556.log.gz 2024-04-25T12:23:33.084 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.34424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34263.log 2024-04-25T12:23:33.084 INFO:teuthology.orchestra.run.smithi086.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34424.log.gz/var/log/ceph/ceph-client.admin.36402.log: 2024-04-25T12:23:33.084 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33446.log 2024-04-25T12:23:33.084 INFO:teuthology.orchestra.run.smithi086.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.36402.log.gz 2024-04-25T12:23:33.084 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.34263.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34263.log.gz 2024-04-25T12:23:33.084 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33314.log 2024-04-25T12:23:33.084 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.33446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36731.log 2024-04-25T12:23:33.084 INFO:teuthology.orchestra.run.smithi086.stderr: 88.1%/var/log/ceph/ceph-client.admin.33314.log: -- replaced with /var/log/ceph/ceph-client.admin.33446.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33816.log 2024-04-25T12:23:33.085 INFO:teuthology.orchestra.run.smithi086.stderr: 2024-04-25T12:23:33.085 INFO:teuthology.orchestra.run.smithi086.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.33314.log.gz 2024-04-25T12:23:33.085 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.36731.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36731.log.gz 2024-04-25T12:23:33.085 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34530.log 2024-04-25T12:23:33.085 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.33816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35483.log 2024-04-25T12:23:33.085 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.34530.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33816.log.gz 2024-04-25T12:23:33.085 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35104.log 2024-04-25T12:23:33.085 INFO:teuthology.orchestra.run.smithi086.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34530.log.gz 2024-04-25T12:23:33.086 INFO:teuthology.orchestra.run.smithi134.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2024-04-25T12:23:33.103 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.35483.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35483.log.gz 2024-04-25T12:23:33.103 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34320.log 2024-04-25T12:23:33.104 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.35104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34452.log 2024-04-25T12:23:33.104 INFO:teuthology.orchestra.run.smithi086.stderr: 88.0%/var/log/ceph/ceph-client.admin.34320.log: -- replaced with /var/log/ceph/ceph-client.admin.35104.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36559.log 2024-04-25T12:23:33.104 INFO:teuthology.orchestra.run.smithi086.stderr: 2024-04-25T12:23:33.104 INFO:teuthology.orchestra.run.smithi086.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34320.log.gz 2024-04-25T12:23:33.104 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.34452.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34452.log.gz 2024-04-25T12:23:33.104 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37474.log 2024-04-25T12:23:33.104 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.36559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34688.log 2024-04-25T12:23:33.105 INFO:teuthology.orchestra.run.smithi086.stderr: 88.8%/var/log/ceph/ceph-client.admin.37474.log: -- replaced with /var/log/ceph/ceph-client.admin.36559.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34106.log 2024-04-25T12:23:33.105 INFO:teuthology.orchestra.run.smithi086.stderr: 2024-04-25T12:23:33.105 INFO:teuthology.orchestra.run.smithi086.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37474.log.gz 2024-04-25T12:23:33.105 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.34688.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34688.log.gz 2024-04-25T12:23:33.105 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36005.log 2024-04-25T12:23:33.105 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.34106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33944.log 2024-04-25T12:23:33.105 INFO:teuthology.orchestra.run.smithi086.stderr: 88.7%/var/log/ceph/ceph-client.admin.36005.log: -- replaced with /var/log/ceph/ceph-client.admin.34106.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35955.log 2024-04-25T12:23:33.105 INFO:teuthology.orchestra.run.smithi086.stderr: 2024-04-25T12:23:33.106 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.33944.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.36005.log.gz 2024-04-25T12:23:33.106 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-25T12:23:33.106 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.35955.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-25T12:23:33.106 INFO:teuthology.orchestra.run.smithi086.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.33944.log.gz 2024-04-25T12:23:33.106 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph.audit.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.35955.log.gz 2024-04-25T12:23:33.106 INFO:teuthology.orchestra.run.smithi086.stderr: 89.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-25T12:23:33.106 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37332.log 2024-04-25T12:23:33.106 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33474.log 2024-04-25T12:23:33.107 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.37332.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-25T12:23:33.107 INFO:teuthology.orchestra.run.smithi086.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37332.log.gz 2024-04-25T12:23:33.107 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.33474.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33474.log.gz 2024-04-25T12:23:33.107 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34682.log 2024-04-25T12:23:33.107 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35852.log 2024-04-25T12:23:33.107 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.34682.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34682.log.gz 2024-04-25T12:23:33.108 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36757.log 2024-04-25T12:23:33.108 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.35852.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.35852.log.gz 2024-04-25T12:23:33.108 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34892.log 2024-04-25T12:23:33.108 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.36757.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36757.log.gz 2024-04-25T12:23:33.108 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34054.log 2024-04-25T12:23:33.108 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.34892.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34892.log.gz 2024-04-25T12:23:33.108 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35362.log 2024-04-25T12:23:33.108 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.34054.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34054.log.gz 2024-04-25T12:23:33.109 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37448.log 2024-04-25T12:23:33.109 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.35362.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35362.log.gz 2024-04-25T12:23:33.109 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33342.log 2024-04-25T12:23:33.109 INFO:teuthology.orchestra.run.smithi086.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-25T12:23:33.109 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.37448.log: 91.2% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-25T12:23:33.109 INFO:teuthology.orchestra.run.smithi086.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37448.log.gz 2024-04-25T12:23:33.109 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37280.log 2024-04-25T12:23:33.110 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.33342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37306.log 2024-04-25T12:23:33.110 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.37280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34398.log 2024-04-25T12:23:33.110 INFO:teuthology.orchestra.run.smithi086.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.33342.log.gz 2024-04-25T12:23:33.110 INFO:teuthology.orchestra.run.smithi086.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37280.log.gz 2024-04-25T12:23:33.110 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.37306.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37306.log.gz 2024-04-25T12:23:33.110 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27572.log 2024-04-25T12:23:33.110 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.34398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37043.log 2024-04-25T12:23:33.111 INFO:teuthology.orchestra.run.smithi086.stderr: 89.4%/var/log/ceph/ceph-client.admin.27572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34080.log 2024-04-25T12:23:33.111 INFO:teuthology.orchestra.run.smithi086.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34398.log.gz 2024-04-25T12:23:33.111 INFO:teuthology.orchestra.run.smithi086.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.27572.log.gz 2024-04-25T12:23:33.111 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.37043.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37043.log.gz 2024-04-25T12:23:33.111 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27791.log 2024-04-25T12:23:33.111 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.34080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35336.log 2024-04-25T12:23:33.111 INFO:teuthology.orchestra.run.smithi086.stderr: 88.0%/var/log/ceph/ceph-client.admin.27791.log: -- replaced with /var/log/ceph/ceph-client.admin.34080.log.gzgzip 2024-04-25T12:23:33.112 INFO:teuthology.orchestra.run.smithi086.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.36939.log 2024-04-25T12:23:33.112 INFO:teuthology.orchestra.run.smithi086.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.27791.log.gz 2024-04-25T12:23:33.112 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.35336.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35336.log.gz 2024-04-25T12:23:33.112 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34478.log 2024-04-25T12:23:33.112 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.36939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33584.log 2024-04-25T12:23:33.112 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.34478.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.36939.log.gz 2024-04-25T12:23:33.112 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35561.log 2024-04-25T12:23:33.112 INFO:teuthology.orchestra.run.smithi086.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34478.log.gz 2024-04-25T12:23:33.113 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.33584.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33584.log.gz 2024-04-25T12:23:33.113 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36887.log 2024-04-25T12:23:33.113 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.35561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36055.log 2024-04-25T12:23:33.113 INFO:teuthology.orchestra.run.smithi086.stderr: 87.8%/var/log/ceph/ceph-client.admin.36887.log: -- replaced with /var/log/ceph/ceph-client.admin.35561.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33662.log 2024-04-25T12:23:33.113 INFO:teuthology.orchestra.run.smithi086.stderr: 2024-04-25T12:23:33.113 INFO:teuthology.orchestra.run.smithi086.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36887.log.gz 2024-04-25T12:23:33.113 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.36055.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.36055.log.gz 2024-04-25T12:23:33.114 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2024-04-25T12:23:33.114 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.33662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37202.log 2024-04-25T12:23:33.114 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-mds.e.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.33662.log.gz 2024-04-25T12:23:33.114 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34893.log 2024-04-25T12:23:33.114 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35092.log 2024-04-25T12:23:33.114 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.37202.log: /var/log/ceph/ceph-client.admin.34893.log: 92.1% 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37202.log.gz 2024-04-25T12:23:33.114 INFO:teuthology.orchestra.run.smithi086.stderr: -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2024-04-25T12:23:33.114 INFO:teuthology.orchestra.run.smithi086.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34893.log.gz 2024-04-25T12:23:33.115 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35098.log 2024-04-25T12:23:33.115 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.35092.log: /var/log/ceph/ceph-client.admin.35098.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35092.log.gz 2024-04-25T12:23:33.115 INFO:teuthology.orchestra.run.smithi086.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35098.log.gz 2024-04-25T12:23:33.115 INFO:teuthology.orchestra.run.smithi134.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-25T12:23:33.122 INFO:teuthology.orchestra.run.smithi134.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-25T12:23:33.257 INFO:teuthology.orchestra.run.smithi086.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-25T12:23:33.671 INFO:teuthology.orchestra.run.smithi086.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-25T12:23:33.671 INFO:teuthology.orchestra.run.smithi134.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-25T12:23:33.672 INFO:teuthology.orchestra.run.smithi134.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-25T12:23:33.673 INFO:teuthology.orchestra.run.smithi086.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-25T12:23:33.683 INFO:teuthology.orchestra.run.smithi134.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-25T12:23:33.689 INFO:teuthology.orchestra.run.smithi086.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-25T12:23:33.697 INFO:teuthology.orchestra.run.smithi086.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-25T12:23:33.699 INFO:teuthology.orchestra.run.smithi086.stderr: 2024-04-25T12:23:33.699 INFO:teuthology.orchestra.run.smithi086.stderr:real 0m0.717s 2024-04-25T12:23:33.699 INFO:teuthology.orchestra.run.smithi086.stderr:user 0m3.015s 2024-04-25T12:23:33.699 INFO:teuthology.orchestra.run.smithi086.stderr:sys 0m0.152s 2024-04-25T12:23:33.726 INFO:teuthology.orchestra.run.smithi134.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-25T12:23:33.728 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-04-25T12:23:33.728 INFO:teuthology.orchestra.run.smithi134.stderr:real 0m0.723s 2024-04-25T12:23:33.728 INFO:teuthology.orchestra.run.smithi134.stderr:user 0m2.827s 2024-04-25T12:23:33.728 INFO:teuthology.orchestra.run.smithi134.stderr:sys 0m0.090s 2024-04-25T12:23:33.728 INFO:tasks.ceph:Archiving logs... 2024-04-25T12:23:33.729 DEBUG:teuthology.misc:Transferring archived files from smithi086:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-04-25_11:13:36-fs-wip-lusov-quiescer-distro-default-smithi/7673357/remote/smithi086/log 2024-04-25T12:23:33.729 DEBUG:teuthology.orchestra.run.smithi086:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T12:23:34.245 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-04-25_11:13:36-fs-wip-lusov-quiescer-distro-default-smithi/7673357/remote/smithi134/log 2024-04-25T12:23:34.246 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T12:23:34.604 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-25T12:23:34.614 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-25T12:23:34.614 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T12:23:34.617 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T12:23:34.695 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-25T12:23:34.704 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-25T12:23:34.704 DEBUG:teuthology.orchestra.run.smithi086:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T12:23:34.707 DEBUG:teuthology.orchestra.run.smithi134:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T12:23:34.717 INFO:teuthology.orchestra.run.smithi086.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T12:23:34.718 INFO:teuthology.orchestra.run.smithi086.stdout:============================================================================== 2024-04-25T12:23:34.718 INFO:teuthology.orchestra.run.smithi086.stdout:+hv01.front.sepi 67.205.162.81 3 u 49 64 77 0.088 -1.790 0.871 2024-04-25T12:23:34.718 INFO:teuthology.orchestra.run.smithi086.stdout:+hv02.front.sepi 63.231.80.2 3 u 49 64 77 0.096 +0.723 1.271 2024-04-25T12:23:34.718 INFO:teuthology.orchestra.run.smithi086.stdout:*hv03.front.sepi 74.6.168.72 3 u 44 64 77 0.132 -0.050 1.358 2024-04-25T12:23:34.718 INFO:teuthology.orchestra.run.smithi086.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T12:23:34.720 INFO:teuthology.orchestra.run.smithi134.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T12:23:34.720 INFO:teuthology.orchestra.run.smithi134.stdout:============================================================================== 2024-04-25T12:23:34.720 INFO:teuthology.orchestra.run.smithi134.stdout:+hv01.front.sepi 67.205.162.81 3 u 46 64 77 0.129 -1.814 1.037 2024-04-25T12:23:34.720 INFO:teuthology.orchestra.run.smithi134.stdout:+hv02.front.sepi 63.231.80.2 3 u 48 64 77 0.104 -0.052 1.037 2024-04-25T12:23:34.721 INFO:teuthology.orchestra.run.smithi134.stdout:*hv03.front.sepi 74.6.168.72 3 u 45 64 77 0.109 -1.053 1.005 2024-04-25T12:23:34.721 INFO:teuthology.orchestra.run.smithi134.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T12:23:34.722 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-25T12:23:34.731 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-25T12:23:34.731 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-25T12:23:34.741 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-25T12:23:34.750 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-25T12:23:34.759 INFO:teuthology.task.internal:Duration was 814.955048 seconds 2024-04-25T12:23:34.759 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-25T12:23:34.768 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-25T12:23:34.768 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T12:23:34.771 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T12:23:34.806 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-25T12:23:34.806 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi086.front.sepia.ceph.com 2024-04-25T12:23:34.807 DEBUG:teuthology.orchestra.run.smithi086:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T12:23:34.859 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi134.front.sepia.ceph.com 2024-04-25T12:23:34.860 DEBUG:teuthology.orchestra.run.smithi134:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T12:23:34.870 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-25T12:23:34.870 DEBUG:teuthology.orchestra.run.smithi086:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T12:23:34.908 DEBUG:teuthology.orchestra.run.smithi134:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T12:23:34.936 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-25T12:23:34.936 DEBUG:teuthology.orchestra.run.smithi086:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T12:23:34.976 DEBUG:teuthology.orchestra.run.smithi134:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T12:23:35.036 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-25T12:23:35.047 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-25T12:23:35.047 DEBUG:teuthology.orchestra.run.smithi086:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T12:23:35.058 DEBUG:teuthology.orchestra.run.smithi134:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T12:23:35.071 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-25T12:23:35.080 DEBUG:teuthology.orchestra.run.smithi086:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T12:23:35.103 DEBUG:teuthology.orchestra.run.smithi134:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T12:23:35.112 INFO:teuthology.orchestra.run.smithi086.stdout:kernel.core_pattern = core 2024-04-25T12:23:35.121 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = core 2024-04-25T12:23:35.205 DEBUG:teuthology.orchestra.run.smithi086:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T12:23:35.209 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T12:23:35.209 DEBUG:teuthology.orchestra.run.smithi134:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T12:23:35.254 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T12:23:35.255 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-25T12:23:35.266 INFO:teuthology.task.internal:Transferring archived files... 2024-04-25T12:23:35.267 DEBUG:teuthology.misc:Transferring archived files from smithi086:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-04-25_11:13:36-fs-wip-lusov-quiescer-distro-default-smithi/7673357/remote/smithi086 2024-04-25T12:23:35.267 DEBUG:teuthology.orchestra.run.smithi086:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T12:23:35.289 DEBUG:teuthology.misc:Transferring archived files from smithi134:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-04-25_11:13:36-fs-wip-lusov-quiescer-distro-default-smithi/7673357/remote/smithi134 2024-04-25T12:23:35.289 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T12:23:35.317 INFO:teuthology.task.internal:Removing archive directory... 2024-04-25T12:23:35.317 DEBUG:teuthology.orchestra.run.smithi086:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T12:23:35.328 DEBUG:teuthology.orchestra.run.smithi134:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T12:23:35.365 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-25T12:23:35.376 INFO:teuthology.task.internal:Not uploading archives. 2024-04-25T12:23:35.376 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-25T12:23:35.386 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-25T12:23:35.386 DEBUG:teuthology.orchestra.run.smithi086:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T12:23:35.389 DEBUG:teuthology.orchestra.run.smithi134:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T12:23:35.393 INFO:teuthology.orchestra.run.smithi086.stdout: 658466 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 12:23 /home/ubuntu/cephtest 2024-04-25T12:23:35.413 INFO:teuthology.orchestra.run.smithi134.stdout: 658617 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 12:23 /home/ubuntu/cephtest 2024-04-25T12:23:35.415 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-25T12:23:35.425 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-25T12:23:35.447 INFO:teuthology.nuke:Checking targets against current locks 2024-04-25T12:23:35.474 DEBUG:teuthology.nuke:shortname: smithi086 2024-04-25T12:23:35.474 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T12:23:35.500 DEBUG:teuthology.nuke:shortname: smithi134 2024-04-25T12:23:35.501 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T12:23:35.504 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi086.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-25_11:13:36-fs-wip-lusov-quiescer-distro-default-smithi/7673357', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 12:01:37.755735', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHo8N7c/YWSybwHA+a7Tv1+st7ysgPgiVfCZFBdeUqjAZ2binlyWG7lz9dvyIy3nH4cop4tjWeGSX2zpk3pj0oM='} 2024-04-25T12:23:35.529 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi134.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-25_11:13:36-fs-wip-lusov-quiescer-distro-default-smithi/7673357', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 12:01:37.753702', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ25y5bcI/9cypDnUvYlftagGEe4lLgZ1W6VOuDVCDHlhivGEkgVG1JqQRcGpEpPD10DkKnJf5LAZ5gLdjt54UI='} 2024-04-25T12:23:35.556 INFO:teuthology.orchestra.console.smithi086:Power off 2024-04-25T12:23:35.556 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-25T12:23:35.582 DEBUG:teuthology.orchestra.console.smithi086:power off output: Chassis Power Control: Down/Off 2024-04-25T12:23:35.582 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T12:23:35.600 INFO:teuthology.orchestra.console.smithi134:Power off 2024-04-25T12:23:35.600 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-25T12:23:35.611 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is on 2024-04-25T12:23:35.624 DEBUG:teuthology.orchestra.console.smithi134:power off output: Chassis Power Control: Down/Off 2024-04-25T12:23:35.624 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T12:23:35.646 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on 2024-04-25T12:23:39.612 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T12:23:39.648 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T12:23:39.723 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is on 2024-04-25T12:23:39.760 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on 2024-04-25T12:23:43.725 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T12:23:43.761 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T12:23:43.837 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is off 2024-04-25T12:23:43.872 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on 2024-04-25T12:23:43.939 INFO:teuthology.orchestra.console.smithi086:Power off completed 2024-04-25T12:23:47.873 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T12:23:47.983 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is off 2024-04-25T12:23:48.084 INFO:teuthology.orchestra.console.smithi134:Power off completed 2024-04-25T12:23:48.189 INFO:teuthology.run:Summary data: description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/with-quiesce 2-workunit/suites/fsstress}} duration: 814.9550476074219 failure_reason: '''cluster''' flavor: default owner: scheduled_leonidus@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=b64a312726424570aee96b6eb448fb9f status: fail success: false 2024-04-25T12:23:48.190 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T12:23:48.273 INFO:teuthology.run:FAIL